2023-10-14T09:00:24.726 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T09:00:24.727 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143 --name rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi --owner scheduled_rishabh@teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} --verbose -- /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143/orig.config.yaml 2023-10-14T09:00:24.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:00:24.848 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143 branch: rishabh-2023oct13 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} email: null first_in_suite: false job_id: '7425143' kernel: flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-2023oct13 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds - \(MDS_INSUFFICIENT_STANDBY\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_DAMAGE\) - \(FS_DEGRADED\) sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: disabled: true install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdn8snkywa347m3Vm++j/7zGb0bP1DuqZrs03Tlk65YGWV1sN7+opB4oVBc817xO1lvLUtO36qUhJ6w+UsU+hw= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVtw7vNZj/l0SLmC2AuhNX31JfCkue1KDpMCHJBMQdkODprV+rab9GcwgdALBISm5/EjTEyEraPySW/2rvK7L8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - exec: mon.a: - ceph config set mgr mgr/crash/warn_recent_interval 0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_failover teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_18:04:14 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T09:00:24.848 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa; will attempt to use it 2023-10-14T09:00:24.849 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks 2023-10-14T09:00:24.849 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T09:00:24.851 INFO:teuthology.task.internal:Checking packages... 2023-10-14T09:00:24.874 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-14T09:00:24.874 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T09:00:24.875 INFO:teuthology.packaging:ref: None 2023-10-14T09:00:24.875 INFO:teuthology.packaging:tag: None 2023-10-14T09:00:24.875 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-14T09:00:24.876 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T09:00:24.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-2023oct13 2023-10-14T09:00:25.097 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730-g4ba8a190-1jammy 2023-10-14T09:00:25.098 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T09:00:25.105 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T09:00:25.105 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T09:00:25.114 INFO:teuthology.task.internal:Saving configuration 2023-10-14T09:00:25.129 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T09:00:25.136 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:00:25.162 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 08:54:09.644079', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGgu9njWTbIwRArDHmSFpbSIaQkVtWOetcRNi5HMfvtH'} 2023-10-14T09:00:25.183 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 08:54:09.646161', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqF3JUYHr7A1vllWsltEumeUiYrbNzFXEdRc3hsHITu'} 2023-10-14T09:00:25.183 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T09:00:25.190 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-10-14T09:00:25.191 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-10-14T09:00:25.191 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T09:00:25.267 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8ab28a4af0>, signals=[15]) 2023-10-14T09:00:25.268 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T09:00:25.280 INFO:teuthology.task.internal:Opening connections... 2023-10-14T09:00:25.280 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:00:25.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:00:25.356 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:00:25.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:00:25.433 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T09:00:25.444 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-10-14T09:00:25.450 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-10-14T09:00:25.450 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-10-14T09:00:25.498 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-14T09:00:25.498 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2023-10-14T09:00:25.499 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="22.04" 2023-10-14T09:00:25.499 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-14T09:00:25.499 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=jammy 2023-10-14T09:00:25.499 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2023-10-14T09:00:25.499 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2023-10-14T09:00:25.500 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-14T09:00:25.500 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-14T09:00:25.500 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-14T09:00:25.500 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-14T09:00:25.500 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=jammy 2023-10-14T09:00:25.501 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-10-14T09:00:25.524 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-10-14T09:00:25.529 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-10-14T09:00:25.530 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-10-14T09:00:25.575 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-14T09:00:25.575 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2023-10-14T09:00:25.575 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="22.04" 2023-10-14T09:00:25.576 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-14T09:00:25.576 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=jammy 2023-10-14T09:00:25.576 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2023-10-14T09:00:25.576 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2023-10-14T09:00:25.576 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-14T09:00:25.577 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-14T09:00:25.577 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-14T09:00:25.577 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-14T09:00:25.577 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=jammy 2023-10-14T09:00:25.577 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-10-14T09:00:25.599 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T09:00:25.614 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T09:00:25.630 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T09:00:25.631 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2023-10-14T09:00:25.634 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2023-10-14T09:00:25.639 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T09:00:25.740 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T09:00:25.740 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2023-10-14T09:00:25.743 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2023-10-14T09:00:25.783 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T09:00:25.841 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T09:00:25.860 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-14T09:00:25.861 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, timeout 300 2023-10-14T09:00:25.861 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T09:00:25.862 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T09:00:25.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:00:25.867 DEBUG:teuthology.task.kernel:sha1 for mon.a is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:00:25.867 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-14T09:00:25.867 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-10-14T09:00:25.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:00:25.869 DEBUG:teuthology.task.kernel:sha1 for mon.b is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:00:25.869 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-14T09:00:25.869 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2023-10-14T09:00:25.915 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-56-generic 2023-10-14T09:00:25.915 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:00:25.916 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-14T09:00:25.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:00:25.920 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-56-generic 2023-10-14T09:00:25.920 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:00:25.921 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-14T09:00:25.921 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:00:26.128 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-10-14T09:00:26.128 DEBUG:teuthology.orchestra.run.smithi078:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-14T09:00:26.136 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-10-14T09:00:26.137 DEBUG:teuthology.orchestra.run.smithi157:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-14T09:00:26.140 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-10-14T09:00:26.160 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-10-14T09:00:26.290 INFO:teuthology.orchestra.run.smithi078.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-10-14T09:00:26.291 INFO:teuthology.orchestra.run.smithi078.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-10-14T09:00:26.291 INFO:teuthology.orchestra.run.smithi078.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-10-14T09:00:26.291 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2023-10-14T09:00:26.291 INFO:teuthology.orchestra.run.smithi078.stderr:hint: git config --global init.defaultBranch 2023-10-14T09:00:26.292 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2023-10-14T09:00:26.292 INFO:teuthology.orchestra.run.smithi078.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-10-14T09:00:26.292 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-10-14T09:00:26.292 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2023-10-14T09:00:26.292 INFO:teuthology.orchestra.run.smithi078.stderr:hint: git branch -m 2023-10-14T09:00:26.293 INFO:teuthology.orchestra.run.smithi078.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-14T09:00:26.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-14T09:00:26.318 INFO:teuthology.orchestra.run.smithi157.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-10-14T09:00:26.318 INFO:teuthology.orchestra.run.smithi157.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-10-14T09:00:26.318 INFO:teuthology.orchestra.run.smithi157.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-10-14T09:00:26.318 INFO:teuthology.orchestra.run.smithi157.stderr:hint: 2023-10-14T09:00:26.319 INFO:teuthology.orchestra.run.smithi157.stderr:hint: git config --global init.defaultBranch 2023-10-14T09:00:26.319 INFO:teuthology.orchestra.run.smithi157.stderr:hint: 2023-10-14T09:00:26.319 INFO:teuthology.orchestra.run.smithi157.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-10-14T09:00:26.319 INFO:teuthology.orchestra.run.smithi157.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-10-14T09:00:26.319 INFO:teuthology.orchestra.run.smithi157.stderr:hint: 2023-10-14T09:00:26.320 INFO:teuthology.orchestra.run.smithi157.stderr:hint: git branch -m 2023-10-14T09:00:26.320 INFO:teuthology.orchestra.run.smithi157.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-14T09:00:26.321 DEBUG:teuthology.orchestra.run.smithi157:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-14T09:00:26.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-14T09:00:26.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-14T09:00:26.420 DEBUG:teuthology.orchestra.run.smithi078:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-14T09:00:26.443 DEBUG:teuthology.orchestra.run.smithi157:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-14T09:01:37.452 INFO:teuthology.orchestra.run.smithi078.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-14T09:01:37.452 INFO:teuthology.orchestra.run.smithi078.stderr: * [new branch] main -> origin/main 2023-10-14T09:01:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190312 -> 20190312 2023-10-14T09:01:37.482 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190416 -> 20190416 2023-10-14T09:01:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190514 -> 20190514 2023-10-14T09:01:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190618 -> 20190618 2023-10-14T09:01:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190717 -> 20190717 2023-10-14T09:01:37.483 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190815 -> 20190815 2023-10-14T09:01:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190923 -> 20190923 2023-10-14T09:01:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20191022 -> 20191022 2023-10-14T09:01:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20191215 -> 20191215 2023-10-14T09:01:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200122 -> 20200122 2023-10-14T09:01:37.484 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200316 -> 20200316 2023-10-14T09:01:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200421 -> 20200421 2023-10-14T09:01:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200519 -> 20200519 2023-10-14T09:01:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200619 -> 20200619 2023-10-14T09:01:37.488 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200721 -> 20200721 2023-10-14T09:01:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200817 -> 20200817 2023-10-14T09:01:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200918 -> 20200918 2023-10-14T09:01:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201022 -> 20201022 2023-10-14T09:01:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201118 -> 20201118 2023-10-14T09:01:37.489 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201218 -> 20201218 2023-10-14T09:01:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210208 -> 20210208 2023-10-14T09:01:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210315 -> 20210315 2023-10-14T09:01:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210511 -> 20210511 2023-10-14T09:01:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210716 -> 20210716 2023-10-14T09:01:37.490 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210818 -> 20210818 2023-10-14T09:01:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210919 -> 20210919 2023-10-14T09:01:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20211027 -> 20211027 2023-10-14T09:01:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20211216 -> 20211216 2023-10-14T09:01:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220209 -> 20220209 2023-10-14T09:01:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220310 -> 20220310 2023-10-14T09:01:37.491 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220411 -> 20220411 2023-10-14T09:01:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220509 -> 20220509 2023-10-14T09:01:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220610 -> 20220610 2023-10-14T09:01:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220708 -> 20220708 2023-10-14T09:01:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220815 -> 20220815 2023-10-14T09:01:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220913 -> 20220913 2023-10-14T09:01:37.492 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221012 -> 20221012 2023-10-14T09:01:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221109 -> 20221109 2023-10-14T09:01:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221214 -> 20221214 2023-10-14T09:01:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230117 -> 20230117 2023-10-14T09:01:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230210 -> 20230210 2023-10-14T09:01:37.493 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230310 -> 20230310 2023-10-14T09:01:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230404 -> 20230404 2023-10-14T09:01:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230515 -> 20230515 2023-10-14T09:01:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230625 -> 20230625 2023-10-14T09:01:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230804 -> 20230804 2023-10-14T09:01:37.494 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230919 -> 20230919 2023-10-14T09:01:41.162 INFO:teuthology.orchestra.run.smithi078.stderr:Updating files: 51% (1629/3159) Updating files: 52% (1643/3159) Updating files: 53% (1675/3159) Updating files: 54% (1706/3159) Updating files: 55% (1738/3159) Updating files: 56% (1770/3159) Updating files: 57% (1801/3159) Updating files: 58% (1833/3159) Updating files: 59% (1864/3159) Updating files: 60% (1896/3159) Updating files: 61% (1927/3159) Updating files: 62% (1959/3159) Updating files: 63% (1991/3159) Updating files: 64% (2022/3159) Updating files: 65% (2054/3159) Updating files: 66% (2085/3159) Updating files: 66% (2104/3159) Updating files: 67% (2117/3159) Updating files: 68% (2149/3159) Updating files: 69% (2180/3159) Updating files: 70% (2212/3159) Updating files: 71% (2243/3159) Updating files: 72% (2275/3159) Updating files: 73% (2307/3159) Updating files: 74% (2338/3159) Updating files: 75% (2370/3159) Updating files: 76% (2401/3159) Updating files: 77% (2433/3159) Updating files: 78% (2465/3159) Updating files: 79% (2496/3159) Updating files: 80% (2528/3159) Updating files: 81% (2559/3159) Updating files: 81% (2587/3159) Updating files: 82% (2591/3159) Updating files: 83% (2622/3159) Updating files: 84% (2654/3159) Updating files: 85% (2686/3159) Updating files: 86% (2717/3159) Updating files: 87% (2749/3159) Updating files: 88% (2780/3159) Updating files: 89% (2812/3159) Updating files: 90% (2844/3159) Updating files: 91% (2875/3159) Updating files: 92% (2907/3159) Updating files: 93% (2938/3159) Updating files: 94% (2970/3159) Updating files: 95% (3002/3159) Updating files: 96% (3033/3159) Updating files: 97% (3065/3159) Updating files: 98% (3096/3159) Updating files: 99% (3128/3159) Updating files: 100% (3159/3159) Updating files: 100% (3159/3159), done. 2023-10-14T09:01:41.167 INFO:teuthology.orchestra.run.smithi078.stdout:HEAD is now at 1be48f85 Merge branch 'pr-24-1697222431' into 'main' 2023-10-14T09:01:41.186 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-14T09:01:41.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:01:41.411 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ 2023-10-14T09:01:41.412 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ --input-file=- 2023-10-14T09:01:41.414 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi078.front.sepia.ceph.com to complete... 2023-10-14T09:01:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14 09:01:44 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb [38909314/38909314] -> "/tmp/linux-image.deb" [1] 2023-10-14T09:01:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:FINISHED --2023-10-14 09:01:44-- 2023-10-14T09:01:44.066 INFO:teuthology.orchestra.run.smithi078.stderr:Total wall clock time: 2.6s 2023-10-14T09:01:44.066 INFO:teuthology.orchestra.run.smithi078.stderr:Downloaded: 1 files, 37M in 2.4s (15.3 MB/s) 2023-10-14T09:01:44.068 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-14T09:01:44.068 DEBUG:teuthology.orchestra.run.smithi078:> sudo dpkg -i /tmp/linux-image.deb 2023-10-14T09:01:44.290 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g47672119149b. 2023-10-14T09:01:46.348 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-10-14T09:01:46.353 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-14T09:01:46.474 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-14T09:01:49.022 INFO:teuthology.orchestra.run.smithi157.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-14T09:01:49.022 INFO:teuthology.orchestra.run.smithi157.stderr: * [new branch] main -> origin/main 2023-10-14T09:01:49.045 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20190312 -> 20190312 2023-10-14T09:01:49.045 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20190416 -> 20190416 2023-10-14T09:01:49.045 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20190514 -> 20190514 2023-10-14T09:01:49.045 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20190618 -> 20190618 2023-10-14T09:01:49.045 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20190717 -> 20190717 2023-10-14T09:01:49.046 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20190815 -> 20190815 2023-10-14T09:01:49.046 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20190923 -> 20190923 2023-10-14T09:01:49.046 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20191022 -> 20191022 2023-10-14T09:01:49.049 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20191215 -> 20191215 2023-10-14T09:01:49.049 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20200122 -> 20200122 2023-10-14T09:01:49.049 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20200316 -> 20200316 2023-10-14T09:01:49.049 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20200421 -> 20200421 2023-10-14T09:01:49.050 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20200519 -> 20200519 2023-10-14T09:01:49.050 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20200619 -> 20200619 2023-10-14T09:01:49.050 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20200721 -> 20200721 2023-10-14T09:01:49.050 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20200817 -> 20200817 2023-10-14T09:01:49.050 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20200918 -> 20200918 2023-10-14T09:01:49.051 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20201022 -> 20201022 2023-10-14T09:01:49.051 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20201118 -> 20201118 2023-10-14T09:01:49.051 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20201218 -> 20201218 2023-10-14T09:01:49.051 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20210208 -> 20210208 2023-10-14T09:01:49.051 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20210315 -> 20210315 2023-10-14T09:01:49.052 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20210511 -> 20210511 2023-10-14T09:01:49.052 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20210716 -> 20210716 2023-10-14T09:01:49.052 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20210818 -> 20210818 2023-10-14T09:01:49.052 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20210919 -> 20210919 2023-10-14T09:01:49.052 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20211027 -> 20211027 2023-10-14T09:01:49.052 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20211216 -> 20211216 2023-10-14T09:01:49.053 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20220209 -> 20220209 2023-10-14T09:01:49.053 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20220310 -> 20220310 2023-10-14T09:01:49.053 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20220411 -> 20220411 2023-10-14T09:01:49.053 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20220509 -> 20220509 2023-10-14T09:01:49.053 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20220610 -> 20220610 2023-10-14T09:01:49.054 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20220708 -> 20220708 2023-10-14T09:01:49.054 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20220815 -> 20220815 2023-10-14T09:01:49.054 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20220913 -> 20220913 2023-10-14T09:01:49.054 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20221012 -> 20221012 2023-10-14T09:01:49.054 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20221109 -> 20221109 2023-10-14T09:01:49.055 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20221214 -> 20221214 2023-10-14T09:01:49.056 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20230117 -> 20230117 2023-10-14T09:01:49.056 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20230210 -> 20230210 2023-10-14T09:01:49.056 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20230310 -> 20230310 2023-10-14T09:01:49.056 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20230404 -> 20230404 2023-10-14T09:01:49.056 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20230515 -> 20230515 2023-10-14T09:01:49.057 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20230625 -> 20230625 2023-10-14T09:01:49.057 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20230804 -> 20230804 2023-10-14T09:01:49.057 INFO:teuthology.orchestra.run.smithi157.stderr: * [new tag] 20230919 -> 20230919 2023-10-14T09:01:50.230 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-14T09:01:50.324 INFO:teuthology.orchestra.run.smithi078.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T09:01:52.745 INFO:teuthology.orchestra.run.smithi157.stderr:Updating files: 51% (1629/3159) Updating files: 52% (1643/3159) Updating files: 53% (1675/3159) Updating files: 54% (1706/3159) Updating files: 55% (1738/3159) Updating files: 56% (1770/3159) Updating files: 57% (1801/3159) Updating files: 58% (1833/3159) Updating files: 59% (1864/3159) Updating files: 60% (1896/3159) Updating files: 61% (1927/3159) Updating files: 62% (1959/3159) Updating files: 63% (1991/3159) Updating files: 64% (2022/3159) Updating files: 65% (2054/3159) Updating files: 66% (2085/3159) Updating files: 66% (2104/3159) Updating files: 67% (2117/3159) Updating files: 68% (2149/3159) Updating files: 69% (2180/3159) Updating files: 70% (2212/3159) Updating files: 71% (2243/3159) Updating files: 72% (2275/3159) Updating files: 73% (2307/3159) Updating files: 74% (2338/3159) Updating files: 75% (2370/3159) Updating files: 76% (2401/3159) Updating files: 77% (2433/3159) Updating files: 78% (2465/3159) Updating files: 79% (2496/3159) Updating files: 80% (2528/3159) Updating files: 81% (2559/3159) Updating files: 81% (2587/3159) Updating files: 82% (2591/3159) Updating files: 83% (2622/3159) Updating files: 84% (2654/3159) Updating files: 85% (2686/3159) Updating files: 86% (2717/3159) Updating files: 87% (2749/3159) Updating files: 88% (2780/3159) Updating files: 89% (2812/3159) Updating files: 90% (2844/3159) Updating files: 91% (2875/3159) Updating files: 92% (2907/3159) Updating files: 93% (2938/3159) Updating files: 94% (2970/3159) Updating files: 95% (3002/3159) Updating files: 96% (3033/3159) Updating files: 97% (3065/3159) Updating files: 98% (3096/3159) Updating files: 99% (3128/3159) Updating files: 100% (3159/3159) Updating files: 100% (3159/3159), done. 2023-10-14T09:01:52.750 INFO:teuthology.orchestra.run.smithi157.stdout:HEAD is now at 1be48f85 Merge branch 'pr-24-1697222431' into 'main' 2023-10-14T09:01:52.770 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-14T09:01:52.770 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T09:01:52.915 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ 2023-10-14T09:01:52.915 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ --input-file=- 2023-10-14T09:01:52.918 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi157.front.sepia.ceph.com to complete... 2023-10-14T09:01:54.651 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14 09:01:54 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb [38909314/38909314] -> "/tmp/linux-image.deb" [1] 2023-10-14T09:01:54.651 INFO:teuthology.orchestra.run.smithi157.stderr:FINISHED --2023-10-14 09:01:54-- 2023-10-14T09:01:54.651 INFO:teuthology.orchestra.run.smithi157.stderr:Total wall clock time: 1.6s 2023-10-14T09:01:54.652 INFO:teuthology.orchestra.run.smithi157.stderr:Downloaded: 1 files, 37M in 1.4s (25.9 MB/s) 2023-10-14T09:01:54.654 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-14T09:01:54.654 DEBUG:teuthology.orchestra.run.smithi157:> sudo dpkg -i /tmp/linux-image.deb 2023-10-14T09:01:54.844 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g47672119149b. 2023-10-14T09:01:56.843 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-10-14T09:01:56.847 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-14T09:01:56.941 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-14T09:02:00.579 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-14T09:02:00.672 INFO:teuthology.orchestra.run.smithi157.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T09:02:10.485 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2023-10-14T09:02:10.499 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-14T09:02:10.528 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2023-10-14T09:02:10.843 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T09:02:10.865 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T09:02:11.166 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-14T09:02:11.175 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-14T09:02:11.236 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-14T09:02:11.241 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-14T09:02:11.388 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-14T09:02:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-14T09:02:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-14T09:02:11.425 INFO:teuthology.orchestra.run.smithi078.stderr:done 2023-10-14T09:02:11.588 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-deb -c /tmp/linux-image.deb 2023-10-14T09:02:11.595 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./ 2023-10-14T09:02:11.595 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./boot/ 2023-10-14T09:02:11.595 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4415097 2023-10-10 19:56 ./boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T09:02:11.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 169298 2023-10-10 19:56 ./boot/config-6.6.0-rc5-g47672119149b 2023-10-14T09:02:11.607 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11352928 2023-10-10 19:56 ./boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T09:02:11.626 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/ 2023-10-14T09:02:11.626 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/ 2023-10-14T09:02:11.626 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/postinst.d/ 2023-10-14T09:02:11.626 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/postrm.d/ 2023-10-14T09:02:11.627 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/preinst.d/ 2023-10-14T09:02:11.627 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/prerm.d/ 2023-10-14T09:02:11.627 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/ 2023-10-14T09:02:11.627 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/ 2023-10-14T09:02:11.627 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/ 2023-10-14T09:02:11.628 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/ 2023-10-14T09:02:11.629 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/ 2023-10-14T09:02:11.629 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/ 2023-10-14T09:02:11.629 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ 2023-10-14T09:02:11.630 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 490233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-14T09:02:11.632 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-14T09:02:11.633 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-14T09:02:11.633 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-14T09:02:11.633 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-14T09:02:11.633 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-14T09:02:11.633 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 152241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-14T09:02:11.634 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-14T09:02:11.634 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-14T09:02:11.634 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-14T09:02:11.634 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-14T09:02:11.635 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-14T09:02:11.635 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-14T09:02:11.635 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-14T09:02:11.635 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-14T09:02:11.635 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-14T09:02:11.635 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-14T09:02:11.636 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-14T09:02:11.636 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-14T09:02:11.636 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-14T09:02:11.636 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/ 2023-10-14T09:02:11.636 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/ 2023-10-14T09:02:11.637 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-14T09:02:11.637 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-14T09:02:11.637 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpuid.ko 2023-10-14T09:02:11.637 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/msr.ko 2023-10-14T09:02:11.637 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/ 2023-10-14T09:02:11.638 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 353761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-14T09:02:11.638 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 881713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-14T09:02:11.638 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2276817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-14T09:02:11.674 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ 2023-10-14T09:02:11.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/af_alg.ko 2023-10-14T09:02:11.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_hash.ko 2023-10-14T09:02:11.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_skcipher.ko 2023-10-14T09:02:11.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-14T09:02:11.675 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-14T09:02:11.676 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-14T09:02:11.676 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/ 2023-10-14T09:02:11.676 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-14T09:02:11.676 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/ 2023-10-14T09:02:11.676 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-14T09:02:11.677 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-14T09:02:11.677 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-14T09:02:11.677 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-14T09:02:11.677 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-14T09:02:11.678 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-14T09:02:11.678 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-14T09:02:11.678 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-14T09:02:11.678 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-14T09:02:11.678 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-14T09:02:11.679 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-14T09:02:11.679 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-14T09:02:11.679 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-14T09:02:11.679 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-14T09:02:11.679 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-14T09:02:11.679 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-14T09:02:11.680 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-14T09:02:11.680 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-14T09:02:11.680 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cryptd.ko 2023-10-14T09:02:11.680 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-14T09:02:11.680 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_simd.ko 2023-10-14T09:02:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-14T09:02:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-14T09:02:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-14T09:02:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-14T09:02:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-14T09:02:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-14T09:02:11.682 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-14T09:02:11.682 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-14T09:02:11.682 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lrw.ko 2023-10-14T09:02:11.683 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-14T09:02:11.683 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-14T09:02:11.683 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-14T09:02:11.683 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-14T09:02:11.683 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-14T09:02:11.684 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-14T09:02:11.684 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-14T09:02:11.684 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-14T09:02:11.684 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-14T09:02:11.684 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 149193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-14T09:02:11.684 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-14T09:02:11.685 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-14T09:02:11.685 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-14T09:02:11.685 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-14T09:02:11.686 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-14T09:02:11.686 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-14T09:02:11.686 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-14T09:02:11.686 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xts.ko 2023-10-14T09:02:11.686 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-14T09:02:11.687 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ 2023-10-14T09:02:11.687 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ 2023-10-14T09:02:11.687 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-14T09:02:11.687 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-14T09:02:11.687 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-14T09:02:11.688 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/ 2023-10-14T09:02:11.688 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/einj.ko 2023-10-14T09:02:11.688 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-14T09:02:11.688 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-14T09:02:11.688 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-14T09:02:11.689 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-14T09:02:11.689 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-14T09:02:11.689 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ 2023-10-14T09:02:11.689 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-14T09:02:11.689 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 88865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci.ko 2023-10-14T09:02:11.690 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-14T09:02:11.690 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 88289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci.ko 2023-10-14T09:02:11.690 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-14T09:02:11.690 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-14T09:02:11.690 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-14T09:02:11.691 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-14T09:02:11.691 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-14T09:02:11.691 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-14T09:02:11.691 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-14T09:02:11.691 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-14T09:02:11.692 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-14T09:02:11.692 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-14T09:02:11.692 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-14T09:02:11.692 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-14T09:02:11.692 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-14T09:02:11.692 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-14T09:02:11.693 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-14T09:02:11.693 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-14T09:02:11.693 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-14T09:02:11.693 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-14T09:02:11.693 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_legacy.ko 2023-10-14T09:02:11.694 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-14T09:02:11.694 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-14T09:02:11.694 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-14T09:02:11.694 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-14T09:02:11.695 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-14T09:02:11.695 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-14T09:02:11.695 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-14T09:02:11.695 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-14T09:02:11.695 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-14T09:02:11.695 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-14T09:02:11.696 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-14T09:02:11.696 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-14T09:02:11.696 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-14T09:02:11.696 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_radisys.ko 2023-10-14T09:02:11.696 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-14T09:02:11.697 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rz1000.ko 2023-10-14T09:02:11.697 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-14T09:02:11.697 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-14T09:02:11.697 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-14T09:02:11.697 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-14T09:02:11.698 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-14T09:02:11.698 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-14T09:02:11.698 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-14T09:02:11.698 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-14T09:02:11.698 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-14T09:02:11.699 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-14T09:02:11.699 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-14T09:02:11.699 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-14T09:02:11.699 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-14T09:02:11.700 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-14T09:02:11.700 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-14T09:02:11.700 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-14T09:02:11.700 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-14T09:02:11.700 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-14T09:02:11.700 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-14T09:02:11.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-14T09:02:11.701 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ 2023-10-14T09:02:11.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-14T09:02:11.701 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/ 2023-10-14T09:02:11.701 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-14T09:02:11.702 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/ 2023-10-14T09:02:11.702 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/ 2023-10-14T09:02:11.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-14T09:02:11.702 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/ 2023-10-14T09:02:11.702 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 965585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-14T09:02:11.703 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 173225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-14T09:02:11.703 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/ 2023-10-14T09:02:11.703 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-14T09:02:11.703 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-14T09:02:11.703 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/ 2023-10-14T09:02:11.704 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 110449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-14T09:02:11.704 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 98193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-14T09:02:11.704 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 263769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-14T09:02:11.704 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/ 2023-10-14T09:02:11.704 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 98145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-14T09:02:11.705 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/ 2023-10-14T09:02:11.705 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-14T09:02:11.705 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ 2023-10-14T09:02:11.705 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/applicom.ko 2023-10-14T09:02:11.705 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-14T09:02:11.705 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/ 2023-10-14T09:02:11.706 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-14T09:02:11.706 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-14T09:02:11.706 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-14T09:02:11.706 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-14T09:02:11.707 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-14T09:02:11.707 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ 2023-10-14T09:02:11.707 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-14T09:02:11.707 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 148601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-14T09:02:11.707 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-14T09:02:11.707 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 139313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-14T09:02:11.708 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-14T09:02:11.708 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-14T09:02:11.708 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-14T09:02:11.708 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/ 2023-10-14T09:02:11.709 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-14T09:02:11.709 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/nvram.ko 2023-10-14T09:02:11.709 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-14T09:02:11.709 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-14T09:02:11.709 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/ 2023-10-14T09:02:11.710 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-14T09:02:11.710 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-14T09:02:11.710 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-14T09:02:11.710 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-14T09:02:11.710 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-14T09:02:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-14T09:02:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-14T09:02:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/ 2023-10-14T09:02:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-14T09:02:11.711 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-14T09:02:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-14T09:02:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/ 2023-10-14T09:02:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-palmas.ko 2023-10-14T09:02:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-si5351.ko 2023-10-14T09:02:11.712 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-twl6040.ko 2023-10-14T09:02:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-wm831x.ko 2023-10-14T09:02:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/ 2023-10-14T09:02:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-14T09:02:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-14T09:02:11.713 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-14T09:02:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ 2023-10-14T09:02:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ 2023-10-14T09:02:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-14T09:02:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 243025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-14T09:02:11.714 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/ 2023-10-14T09:02:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/ 2023-10-14T09:02:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-14T09:02:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 438761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-14T09:02:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-14T09:02:11.715 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-14T09:02:11.716 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-14T09:02:11.716 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-14T09:02:11.716 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/ 2023-10-14T09:02:11.716 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-14T09:02:11.717 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/ 2023-10-14T09:02:11.717 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-14T09:02:11.717 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ 2023-10-14T09:02:11.717 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/ 2023-10-14T09:02:11.717 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-14T09:02:11.717 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ 2023-10-14T09:02:11.718 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-14T09:02:11.718 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ 2023-10-14T09:02:11.718 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-14T09:02:11.718 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-14T09:02:11.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-14T09:02:11.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-14T09:02:11.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-14T09:02:11.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-14T09:02:11.719 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-14T09:02:11.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-14T09:02:11.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-14T09:02:11.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-14T09:02:11.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-14T09:02:11.720 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-14T09:02:11.721 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-14T09:02:11.721 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/ 2023-10-14T09:02:11.721 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-14T09:02:11.721 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-14T09:02:11.721 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-14T09:02:11.721 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-14T09:02:11.722 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-14T09:02:11.722 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-14T09:02:11.722 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-14T09:02:11.722 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/ 2023-10-14T09:02:11.722 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-14T09:02:11.723 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/ 2023-10-14T09:02:11.723 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-14T09:02:11.723 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-14T09:02:11.723 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/ 2023-10-14T09:02:11.723 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-14T09:02:11.724 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-14T09:02:11.724 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-14T09:02:11.724 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-14T09:02:11.724 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-14T09:02:11.724 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-14T09:02:11.725 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-14T09:02:11.725 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-generic.ko 2023-10-14T09:02:11.725 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-14T09:02:11.725 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-14T09:02:11.725 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-14T09:02:11.726 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-14T09:02:11.726 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-14T09:02:11.726 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-14T09:02:11.726 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-14T09:02:11.726 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-14T09:02:11.727 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-14T09:02:11.727 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-14T09:02:11.727 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-14T09:02:11.727 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch.ko 2023-10-14T09:02:11.727 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-14T09:02:11.728 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-14T09:02:11.728 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-14T09:02:11.728 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-14T09:02:11.728 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-14T09:02:11.728 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-14T09:02:11.729 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-14T09:02:11.729 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-14T09:02:11.729 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-14T09:02:11.729 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/ 2023-10-14T09:02:11.729 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-a4tech.ko 2023-10-14T09:02:11.730 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-apple.ko 2023-10-14T09:02:11.730 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-14T09:02:11.730 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-14T09:02:11.730 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-14T09:02:11.731 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-belkin.ko 2023-10-14T09:02:11.731 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cherry.ko 2023-10-14T09:02:11.731 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-chicony.ko 2023-10-14T09:02:11.731 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cp2112.ko 2023-10-14T09:02:11.731 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cypress.ko 2023-10-14T09:02:11.732 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-14T09:02:11.732 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-14T09:02:11.732 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-14T09:02:11.732 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-14T09:02:11.732 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ezkey.ko 2023-10-14T09:02:11.732 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-14T09:02:11.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-generic.ko 2023-10-14T09:02:11.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-14T09:02:11.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-14T09:02:11.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-14T09:02:11.733 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-14T09:02:11.734 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-14T09:02:11.734 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-14T09:02:11.734 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-14T09:02:11.734 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kensington.ko 2023-10-14T09:02:11.734 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-14T09:02:11.735 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-14T09:02:11.735 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-14T09:02:11.735 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-14T09:02:11.735 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-14T09:02:11.735 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-14T09:02:11.735 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-14T09:02:11.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-14T09:02:11.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech.ko 2023-10-14T09:02:11.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-14T09:02:11.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-microsoft.ko 2023-10-14T09:02:11.736 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-monterey.ko 2023-10-14T09:02:11.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-14T09:02:11.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ntrig.ko 2023-10-14T09:02:11.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-14T09:02:11.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-14T09:02:11.737 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-14T09:02:11.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-14T09:02:11.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-14T09:02:11.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-14T09:02:11.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-14T09:02:11.738 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-14T09:02:11.739 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-14T09:02:11.739 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-14T09:02:11.739 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-14T09:02:11.739 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-14T09:02:11.739 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-14T09:02:11.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-14T09:02:11.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-14T09:02:11.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-14T09:02:11.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-14T09:02:11.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-14T09:02:11.740 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-14T09:02:11.741 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-14T09:02:11.741 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-14T09:02:11.741 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-14T09:02:11.741 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-14T09:02:11.741 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-14T09:02:11.741 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-14T09:02:11.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-14T09:02:11.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-14T09:02:11.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-14T09:02:11.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-14T09:02:11.742 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-14T09:02:11.743 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-14T09:02:11.743 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-14T09:02:11.743 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-14T09:02:11.743 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-14T09:02:11.743 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-14T09:02:11.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 143473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-14T09:02:11.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-14T09:02:11.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-14T09:02:11.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-14T09:02:11.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 267825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid.ko 2023-10-14T09:02:11.744 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-14T09:02:11.745 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/ 2023-10-14T09:02:11.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-14T09:02:11.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-14T09:02:11.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-14T09:02:11.745 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 217873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-14T09:02:11.746 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/ 2023-10-14T09:02:11.746 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-14T09:02:11.746 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-14T09:02:11.746 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 305465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-14T09:02:11.746 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ 2023-10-14T09:02:11.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-14T09:02:11.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-14T09:02:11.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-14T09:02:11.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-14T09:02:11.747 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-14T09:02:11.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-14T09:02:11.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-14T09:02:11.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-14T09:02:11.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-14T09:02:11.748 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-14T09:02:11.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-14T09:02:11.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-14T09:02:11.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-14T09:02:11.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-14T09:02:11.749 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-14T09:02:11.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-14T09:02:11.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-14T09:02:11.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-14T09:02:11.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-14T09:02:11.750 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-14T09:02:11.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-14T09:02:11.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-14T09:02:11.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-14T09:02:11.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-14T09:02:11.751 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-14T09:02:11.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-14T09:02:11.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-14T09:02:11.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-14T09:02:11.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-14T09:02:11.752 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-14T09:02:11.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-14T09:02:11.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-14T09:02:11.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc2103.ko 2023-10-14T09:02:11.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-14T09:02:11.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-14T09:02:11.753 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-14T09:02:11.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-14T09:02:11.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-14T09:02:11.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-14T09:02:11.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-14T09:02:11.754 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-14T09:02:11.755 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-14T09:02:11.755 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-14T09:02:11.755 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hih6130.ko 2023-10-14T09:02:11.755 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-14T09:02:11.755 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-14T09:02:11.755 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-14T09:02:11.756 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-14T09:02:11.756 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-14T09:02:11.756 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-14T09:02:11.756 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-14T09:02:11.756 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 130449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-14T09:02:11.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/jc42.ko 2023-10-14T09:02:11.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-14T09:02:11.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-14T09:02:11.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-14T09:02:11.757 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-14T09:02:11.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-14T09:02:11.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-14T09:02:11.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-14T09:02:11.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-14T09:02:11.758 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-14T09:02:11.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-14T09:02:11.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-14T09:02:11.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-14T09:02:11.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-14T09:02:11.759 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-14T09:02:11.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-14T09:02:11.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-14T09:02:11.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-14T09:02:11.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-14T09:02:11.760 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-14T09:02:11.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-14T09:02:11.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-14T09:02:11.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-14T09:02:11.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-14T09:02:11.761 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-14T09:02:11.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-14T09:02:11.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-14T09:02:11.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-14T09:02:11.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-14T09:02:11.762 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-14T09:02:11.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-14T09:02:11.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-14T09:02:11.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-14T09:02:11.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-14T09:02:11.763 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-14T09:02:11.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-14T09:02:11.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-14T09:02:11.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-14T09:02:11.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-14T09:02:11.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-14T09:02:11.764 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-14T09:02:11.765 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-14T09:02:11.765 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-14T09:02:11.765 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ 2023-10-14T09:02:11.765 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-14T09:02:11.765 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-14T09:02:11.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-14T09:02:11.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-14T09:02:11.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-14T09:02:11.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-14T09:02:11.766 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-14T09:02:11.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-14T09:02:11.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-14T09:02:11.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-14T09:02:11.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-14T09:02:11.767 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-14T09:02:11.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-14T09:02:11.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-14T09:02:11.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-14T09:02:11.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-14T09:02:11.768 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-14T09:02:11.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-14T09:02:11.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-14T09:02:11.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-14T09:02:11.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-14T09:02:11.769 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-14T09:02:11.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-14T09:02:11.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-14T09:02:11.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-14T09:02:11.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-14T09:02:11.770 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-14T09:02:11.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-14T09:02:11.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-14T09:02:11.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-14T09:02:11.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-14T09:02:11.771 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-14T09:02:11.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-14T09:02:11.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-14T09:02:11.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-14T09:02:11.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-14T09:02:11.772 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-14T09:02:11.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-14T09:02:11.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-14T09:02:11.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-14T09:02:11.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-14T09:02:11.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-14T09:02:11.773 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-14T09:02:11.774 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/ 2023-10-14T09:02:11.774 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/ 2023-10-14T09:02:11.774 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-14T09:02:11.774 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-14T09:02:11.774 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/ 2023-10-14T09:02:11.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-14T09:02:11.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-14T09:02:11.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-14T09:02:11.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-14T09:02:11.775 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-14T09:02:11.776 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-14T09:02:11.776 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-14T09:02:11.776 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-14T09:02:11.776 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-14T09:02:11.776 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-14T09:02:11.777 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-14T09:02:11.777 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-14T09:02:11.777 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-14T09:02:11.777 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-14T09:02:11.777 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-14T09:02:11.778 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-14T09:02:11.778 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-14T09:02:11.778 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-14T09:02:11.778 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-14T09:02:11.778 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-14T09:02:11.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-14T09:02:11.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-14T09:02:11.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-14T09:02:11.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-14T09:02:11.779 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-14T09:02:11.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-14T09:02:11.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-14T09:02:11.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-14T09:02:11.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-14T09:02:11.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-14T09:02:11.780 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-14T09:02:11.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-14T09:02:11.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-14T09:02:11.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-14T09:02:11.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-14T09:02:11.781 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-14T09:02:11.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-14T09:02:11.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-14T09:02:11.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-14T09:02:11.782 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-14T09:02:11.783 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/ 2023-10-14T09:02:11.783 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-14T09:02:11.783 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-14T09:02:11.783 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-14T09:02:11.783 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ 2023-10-14T09:02:11.784 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ 2023-10-14T09:02:11.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 273609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-14T09:02:11.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 879969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-14T09:02:11.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-14T09:02:11.784 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 324217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-14T09:02:11.785 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-14T09:02:11.785 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 282273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-14T09:02:11.933 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-14T09:02:11.933 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ 2023-10-14T09:02:11.933 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-14T09:02:11.934 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 493073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-14T09:02:11.934 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-14T09:02:11.934 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 419737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-14T09:02:11.934 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-14T09:02:11.934 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 739025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-14T09:02:11.935 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ 2023-10-14T09:02:11.935 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 296625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-14T09:02:11.935 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-14T09:02:11.935 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 153697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-14T09:02:11.935 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/ 2023-10-14T09:02:11.936 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 168969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-14T09:02:11.936 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ 2023-10-14T09:02:11.936 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-14T09:02:11.936 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 263081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-14T09:02:11.936 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ 2023-10-14T09:02:11.937 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-14T09:02:11.937 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ 2023-10-14T09:02:11.937 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 111425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-14T09:02:11.937 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ 2023-10-14T09:02:11.937 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-14T09:02:11.938 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-14T09:02:11.938 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 129529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-14T09:02:11.938 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ 2023-10-14T09:02:11.938 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/evbug.ko 2023-10-14T09:02:11.938 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ff-memless.ko 2023-10-14T09:02:11.939 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/ 2023-10-14T09:02:11.939 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-14T09:02:11.939 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-14T09:02:11.939 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-14T09:02:11.939 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-14T09:02:11.940 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/ 2023-10-14T09:02:11.940 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-14T09:02:11.940 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-14T09:02:11.940 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-14T09:02:11.940 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-14T09:02:11.940 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-14T09:02:11.941 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-14T09:02:11.941 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-14T09:02:11.941 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-14T09:02:11.941 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-14T09:02:11.941 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-14T09:02:11.942 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-14T09:02:11.942 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-14T09:02:11.942 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-14T09:02:11.942 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-14T09:02:11.942 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-14T09:02:11.943 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-14T09:02:11.943 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-14T09:02:11.943 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-14T09:02:11.943 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-14T09:02:11.943 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-14T09:02:11.944 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-14T09:02:11.944 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-14T09:02:11.944 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-14T09:02:11.944 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-14T09:02:11.944 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/matrix-keymap.ko 2023-10-14T09:02:11.945 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/ 2023-10-14T09:02:11.945 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-14T09:02:11.945 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-14T09:02:11.945 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-14T09:02:11.945 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-14T09:02:11.946 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-14T09:02:11.946 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 335977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/psmouse.ko 2023-10-14T09:02:11.946 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-14T09:02:11.946 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-14T09:02:11.946 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-14T09:02:11.947 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-14T09:02:11.947 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/ 2023-10-14T09:02:11.947 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-14T09:02:11.947 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ 2023-10-14T09:02:11.947 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-14T09:02:11.947 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-14T09:02:11.948 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ct82c710.ko 2023-10-14T09:02:11.948 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-14T09:02:11.948 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/parkbd.ko 2023-10-14T09:02:11.948 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/pcips2.ko 2023-10-14T09:02:11.948 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ps2mult.ko 2023-10-14T09:02:11.949 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-14T09:02:11.949 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serport.ko 2023-10-14T09:02:11.949 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-14T09:02:11.949 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/ 2023-10-14T09:02:11.949 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/ 2023-10-14T09:02:11.950 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-14T09:02:11.950 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/ 2023-10-14T09:02:11.950 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-14T09:02:11.950 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-adp5520.ko 2023-10-14T09:02:11.950 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-bd2802.ko 2023-10-14T09:02:11.951 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-14T09:02:11.951 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da903x.ko 2023-10-14T09:02:11.951 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da9052.ko 2023-10-14T09:02:11.951 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-gpio.ko 2023-10-14T09:02:11.951 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-14T09:02:11.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3533.ko 2023-10-14T09:02:11.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm355x.ko 2023-10-14T09:02:11.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3642.ko 2023-10-14T09:02:11.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-14T09:02:11.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp8788.ko 2023-10-14T09:02:11.952 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-max8997.ko 2023-10-14T09:02:11.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-mc13783.ko 2023-10-14T09:02:11.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-14T09:02:11.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca9532.ko 2023-10-14T09:02:11.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca955x.ko 2023-10-14T09:02:11.953 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca963x.ko 2023-10-14T09:02:11.954 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-14T09:02:11.954 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-tca6507.ko 2023-10-14T09:02:11.954 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-14T09:02:11.954 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm8350.ko 2023-10-14T09:02:11.954 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ 2023-10-14T09:02:11.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-14T09:02:11.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-14T09:02:11.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-14T09:02:11.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-14T09:02:11.955 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-14T09:02:11.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-14T09:02:11.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-14T09:02:11.956 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-14T09:02:11.956 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/ 2023-10-14T09:02:11.956 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/ 2023-10-14T09:02:11.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 654969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-14T09:02:11.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-14T09:02:11.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bufio.ko 2023-10-14T09:02:11.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-14T09:02:11.957 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 156009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-14T09:02:11.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-14T09:02:11.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-14T09:02:11.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-era.ko 2023-10-14T09:02:11.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-14T09:02:11.958 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-14T09:02:11.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log.ko 2023-10-14T09:02:11.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-mirror.ko 2023-10-14T09:02:11.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-14T09:02:11.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-14T09:02:11.959 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-14T09:02:11.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-region-hash.ko 2023-10-14T09:02:11.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-14T09:02:11.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-14T09:02:11.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-snapshot.ko 2023-10-14T09:02:11.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-14T09:02:11.960 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 181865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-14T09:02:11.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-14T09:02:11.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-zero.ko 2023-10-14T09:02:11.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-14T09:02:11.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-14T09:02:11.961 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-14T09:02:11.962 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/ 2023-10-14T09:02:11.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 199937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-14T09:02:11.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-14T09:02:11.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-14T09:02:11.962 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 158681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-14T09:02:11.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 395721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-14T09:02:11.963 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/ 2023-10-14T09:02:11.963 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/ 2023-10-14T09:02:11.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 178137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-14T09:02:11.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-14T09:02:11.963 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-14T09:02:11.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-14T09:02:11.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-14T09:02:11.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-14T09:02:11.964 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-14T09:02:11.964 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ 2023-10-14T09:02:11.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm800.ko 2023-10-14T09:02:11.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm805.ko 2023-10-14T09:02:11.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm80x.ko 2023-10-14T09:02:11.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-14T09:02:11.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona.ko 2023-10-14T09:02:11.965 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/bcm590xx.ko 2023-10-14T09:02:11.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-14T09:02:11.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/dln2.ko 2023-10-14T09:02:11.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-14T09:02:11.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/kempld-core.ko 2023-10-14T09:02:11.966 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-core.ko 2023-10-14T09:02:11.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-14T09:02:11.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lp3943.ko 2023-10-14T09:02:11.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-14T09:02:11.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-14T09:02:11.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/max8907.ko 2023-10-14T09:02:11.967 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-14T09:02:11.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-14T09:02:11.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/menf21bmc.ko 2023-10-14T09:02:11.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-14T09:02:11.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-14T09:02:11.968 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633.ko 2023-10-14T09:02:11.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-14T09:02:11.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/retu-mfd.ko 2023-10-14T09:02:11.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/si476x-core.ko 2023-10-14T09:02:11.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-14T09:02:11.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-14T09:02:11.969 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps65010.ko 2023-10-14T09:02:11.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps6507x.ko 2023-10-14T09:02:11.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-14T09:02:11.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-14T09:02:11.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-14T09:02:11.970 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wm8994.ko 2023-10-14T09:02:11.971 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ 2023-10-14T09:02:11.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-14T09:02:11.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-14T09:02:11.971 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/ 2023-10-14T09:02:11.971 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-14T09:02:11.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-14T09:02:11.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-14T09:02:11.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-14T09:02:11.972 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/ 2023-10-14T09:02:11.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-14T09:02:11.972 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/core.ko 2023-10-14T09:02:11.973 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/ 2023-10-14T09:02:11.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-14T09:02:11.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ds1682.ko 2023-10-14T09:02:11.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/dummy-irq.ko 2023-10-14T09:02:11.973 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/ 2023-10-14T09:02:11.973 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/echo.ko 2023-10-14T09:02:11.974 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/ 2023-10-14T09:02:11.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-14T09:02:11.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-14T09:02:11.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-14T09:02:11.974 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-14T09:02:11.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-14T09:02:11.975 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/ 2023-10-14T09:02:11.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 152201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-14T09:02:11.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hmc6352.ko 2023-10-14T09:02:11.975 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-14T09:02:11.975 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ 2023-10-14T09:02:11.976 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-14T09:02:11.976 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ics932s401.ko 2023-10-14T09:02:11.976 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-14T09:02:11.976 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-14T09:02:11.976 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/ 2023-10-14T09:02:11.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-14T09:02:11.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-14T09:02:11.977 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/ 2023-10-14T09:02:11.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-14T09:02:11.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-14T09:02:11.977 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 310113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-14T09:02:11.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/phantom.ko 2023-10-14T09:02:11.978 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/ 2023-10-14T09:02:11.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-14T09:02:11.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-14T09:02:11.978 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-14T09:02:11.979 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-14T09:02:11.979 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-14T09:02:11.979 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/ 2023-10-14T09:02:11.979 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 183609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-14T09:02:11.979 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ 2023-10-14T09:02:11.980 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/ 2023-10-14T09:02:11.980 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 490129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-14T09:02:11.980 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/ 2023-10-14T09:02:11.980 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/ 2023-10-14T09:02:11.980 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-14T09:02:11.980 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-14T09:02:11.981 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-14T09:02:11.981 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-14T09:02:11.981 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 453737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-14T09:02:11.981 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-14T09:02:11.981 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-14T09:02:11.982 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ 2023-10-14T09:02:11.982 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/ 2023-10-14T09:02:11.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-14T09:02:11.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-14T09:02:11.982 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 130553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-14T09:02:11.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-14T09:02:11.983 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ 2023-10-14T09:02:11.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-14T09:02:11.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-14T09:02:11.983 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-14T09:02:11.984 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-14T09:02:11.984 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/ 2023-10-14T09:02:11.984 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-14T09:02:11.984 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/ 2023-10-14T09:02:11.984 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-14T09:02:11.984 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/ 2023-10-14T09:02:11.985 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-14T09:02:11.985 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/ 2023-10-14T09:02:11.985 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-14T09:02:11.985 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/ 2023-10-14T09:02:11.985 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-14T09:02:11.986 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-14T09:02:11.986 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-14T09:02:11.986 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/ 2023-10-14T09:02:11.986 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-14T09:02:11.986 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-14T09:02:11.987 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-14T09:02:11.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-14T09:02:11.987 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-14T09:02:11.987 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-14T09:02:11.987 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-14T09:02:11.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-14T09:02:11.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-14T09:02:11.988 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/ 2023-10-14T09:02:11.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-14T09:02:11.988 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 176761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-14T09:02:11.988 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-14T09:02:11.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1421497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-14T09:02:11.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-14T09:02:11.989 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-14T09:02:11.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 132089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-14T09:02:11.989 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 312081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-14T09:02:11.990 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/ 2023-10-14T09:02:11.990 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-14T09:02:11.990 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 323513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-14T09:02:11.990 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/ 2023-10-14T09:02:11.990 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-14T09:02:11.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 193497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-14T09:02:11.991 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-14T09:02:11.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 347417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-14T09:02:11.991 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-14T09:02:11.991 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1044433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-14T09:02:11.991 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-14T09:02:11.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 166193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-14T09:02:11.992 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-14T09:02:11.992 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-14T09:02:11.992 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/ 2023-10-14T09:02:11.992 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-14T09:02:11.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 204345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-14T09:02:11.993 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/ 2023-10-14T09:02:11.993 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-14T09:02:11.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-14T09:02:11.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-14T09:02:11.993 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 141225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-14T09:02:11.994 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-14T09:02:11.994 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-14T09:02:11.994 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-14T09:02:11.994 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/ 2023-10-14T09:02:11.994 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-14T09:02:11.995 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-14T09:02:11.995 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-14T09:02:11.995 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-14T09:02:11.995 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/ 2023-10-14T09:02:11.995 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-14T09:02:11.996 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 281137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-14T09:02:11.996 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-14T09:02:11.996 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-14T09:02:11.996 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-14T09:02:11.996 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-14T09:02:11.996 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ 2023-10-14T09:02:11.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-14T09:02:11.997 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-14T09:02:11.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 295577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-14T09:02:11.997 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-14T09:02:11.997 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 584497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-14T09:02:11.998 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-14T09:02:11.998 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 246209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-14T09:02:11.998 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-14T09:02:11.998 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 925697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-14T09:02:11.998 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-14T09:02:11.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 302849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-14T09:02:11.999 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-14T09:02:11.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 514681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-14T09:02:11.999 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-14T09:02:11.999 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-14T09:02:11.999 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-14T09:02:12.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 734305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-14T09:02:12.000 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-14T09:02:12.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 151769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-14T09:02:12.000 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-14T09:02:12.000 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/ 2023-10-14T09:02:12.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-14T09:02:12.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-14T09:02:12.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-14T09:02:12.001 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/ 2023-10-14T09:02:12.001 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-14T09:02:12.001 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 727601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-14T09:02:12.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 278937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-14T09:02:12.002 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-14T09:02:12.002 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-14T09:02:12.002 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1113993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-14T09:02:12.002 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ 2023-10-14T09:02:12.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-14T09:02:12.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-14T09:02:12.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-14T09:02:12.003 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 95665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-14T09:02:12.003 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/ 2023-10-14T09:02:12.004 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-14T09:02:12.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-14T09:02:12.004 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ 2023-10-14T09:02:12.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-14T09:02:12.004 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-14T09:02:12.004 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/ 2023-10-14T09:02:12.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 150905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-14T09:02:12.005 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/ 2023-10-14T09:02:12.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 136721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-14T09:02:12.005 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/ 2023-10-14T09:02:12.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-14T09:02:12.005 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-14T09:02:12.006 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/ 2023-10-14T09:02:12.006 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-14T09:02:12.006 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 227897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-14T09:02:12.006 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-14T09:02:12.006 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-14T09:02:12.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 672049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-14T09:02:12.007 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/ 2023-10-14T09:02:12.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-14T09:02:12.007 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/ 2023-10-14T09:02:12.007 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-14T09:02:12.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-14T09:02:12.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-14T09:02:12.008 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 189801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-14T09:02:12.008 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/ 2023-10-14T09:02:12.008 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-14T09:02:12.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-14T09:02:12.009 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/ 2023-10-14T09:02:12.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1053921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-14T09:02:12.009 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/ 2023-10-14T09:02:12.009 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-14T09:02:12.009 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/ 2023-10-14T09:02:12.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-14T09:02:12.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-14T09:02:12.010 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/ 2023-10-14T09:02:12.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-14T09:02:12.010 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-14T09:02:12.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-14T09:02:12.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-14T09:02:12.011 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/ 2023-10-14T09:02:12.011 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-14T09:02:12.011 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-14T09:02:12.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-14T09:02:12.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-14T09:02:12.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 486961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-14T09:02:12.012 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/ 2023-10-14T09:02:12.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-14T09:02:12.012 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 166161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-14T09:02:12.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-14T09:02:12.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-14T09:02:12.013 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/ 2023-10-14T09:02:12.013 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-14T09:02:12.013 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/ 2023-10-14T09:02:12.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-14T09:02:12.014 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/ 2023-10-14T09:02:12.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-14T09:02:12.014 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-14T09:02:12.014 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/ 2023-10-14T09:02:12.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-14T09:02:12.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-14T09:02:12.015 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/ 2023-10-14T09:02:12.015 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-14T09:02:12.015 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/ 2023-10-14T09:02:12.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/defxx.ko 2023-10-14T09:02:12.016 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/ 2023-10-14T09:02:12.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 216985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-14T09:02:12.016 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-14T09:02:12.016 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/ 2023-10-14T09:02:12.017 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 235521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-14T09:02:12.017 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/ 2023-10-14T09:02:12.017 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-14T09:02:12.017 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-14T09:02:12.017 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ 2023-10-14T09:02:12.017 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-14T09:02:12.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-14T09:02:12.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-14T09:02:12.018 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/ 2023-10-14T09:02:12.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-14T09:02:12.018 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-14T09:02:12.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-14T09:02:12.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-14T09:02:12.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-14T09:02:12.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-14T09:02:12.019 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-14T09:02:12.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-14T09:02:12.020 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/ 2023-10-14T09:02:12.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-14T09:02:12.020 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-14T09:02:12.020 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ 2023-10-14T09:02:12.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-14T09:02:12.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-14T09:02:12.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-14T09:02:12.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-14T09:02:12.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-14T09:02:12.021 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-14T09:02:12.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-14T09:02:12.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-14T09:02:12.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-14T09:02:12.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-14T09:02:12.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-14T09:02:12.022 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-14T09:02:12.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-14T09:02:12.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-14T09:02:12.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-14T09:02:12.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-14T09:02:12.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-14T09:02:12.023 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-14T09:02:12.024 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-14T09:02:12.024 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/ 2023-10-14T09:02:12.024 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/plip.ko 2023-10-14T09:02:12.024 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ 2023-10-14T09:02:12.024 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-14T09:02:12.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-14T09:02:12.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-14T09:02:12.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-14T09:02:12.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-14T09:02:12.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-14T09:02:12.025 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-14T09:02:12.026 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-14T09:02:12.026 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sb1000.ko 2023-10-14T09:02:12.026 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/ 2023-10-14T09:02:12.026 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-14T09:02:12.026 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-14T09:02:12.027 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-14T09:02:12.027 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/ 2023-10-14T09:02:12.027 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-14T09:02:12.027 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-14T09:02:12.027 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-14T09:02:12.027 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-14T09:02:12.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-14T09:02:12.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-14T09:02:12.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-14T09:02:12.028 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/ 2023-10-14T09:02:12.028 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 144297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-14T09:02:12.028 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/ 2023-10-14T09:02:12.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 297329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-14T09:02:12.029 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/ 2023-10-14T09:02:12.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 144649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-14T09:02:12.029 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ 2023-10-14T09:02:12.029 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-14T09:02:12.030 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/ 2023-10-14T09:02:12.030 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/ 2023-10-14T09:02:12.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 264937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-14T09:02:12.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-14T09:02:12.030 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/ 2023-10-14T09:02:12.030 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 133841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-14T09:02:12.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-14T09:02:12.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-14T09:02:12.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-14T09:02:12.031 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/ 2023-10-14T09:02:12.031 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/ 2023-10-14T09:02:12.031 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-14T09:02:12.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-14T09:02:12.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-14T09:02:12.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pci-stub.ko 2023-10-14T09:02:12.032 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-14T09:02:12.032 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/ 2023-10-14T09:02:12.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-14T09:02:12.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 145809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-14T09:02:12.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-14T09:02:12.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-14T09:02:12.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-14T09:02:12.033 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 112889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-14T09:02:12.034 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/ 2023-10-14T09:02:12.034 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/ 2023-10-14T09:02:12.034 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-14T09:02:12.034 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/ 2023-10-14T09:02:12.034 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-14T09:02:12.034 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/ 2023-10-14T09:02:12.035 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/ 2023-10-14T09:02:12.035 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-14T09:02:12.035 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/ 2023-10-14T09:02:12.035 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/ 2023-10-14T09:02:12.035 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-14T09:02:12.036 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-14T09:02:12.036 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-14T09:02:12.036 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-14T09:02:12.036 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-14T09:02:12.036 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-14T09:02:12.036 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-14T09:02:12.037 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ 2023-10-14T09:02:12.037 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-14T09:02:12.037 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-14T09:02:12.037 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-14T09:02:12.037 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-14T09:02:12.038 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-14T09:02:12.038 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 127569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-14T09:02:12.038 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-14T09:02:12.038 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-14T09:02:12.038 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-14T09:02:12.039 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-14T09:02:12.039 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-14T09:02:12.039 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-14T09:02:12.039 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-14T09:02:12.039 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/ 2023-10-14T09:02:12.040 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-14T09:02:12.040 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-14T09:02:12.040 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-14T09:02:12.040 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-14T09:02:12.040 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-14T09:02:12.040 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-14T09:02:12.041 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-14T09:02:12.041 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-14T09:02:12.041 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-14T09:02:12.041 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-14T09:02:12.041 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-14T09:02:12.041 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-14T09:02:12.042 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-14T09:02:12.042 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/ 2023-10-14T09:02:12.042 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ 2023-10-14T09:02:12.042 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-14T09:02:12.042 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-14T09:02:12.043 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-14T09:02:12.043 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-14T09:02:12.043 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-14T09:02:12.043 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-14T09:02:12.043 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-14T09:02:12.044 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-14T09:02:12.044 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-14T09:02:12.044 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-14T09:02:12.044 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-14T09:02:12.044 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-14T09:02:12.045 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-14T09:02:12.045 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-14T09:02:12.045 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-14T09:02:12.045 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-14T09:02:12.045 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-14T09:02:12.045 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-14T09:02:12.046 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-14T09:02:12.046 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8925_power.ko 2023-10-14T09:02:12.046 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-14T09:02:12.046 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-14T09:02:12.046 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/test_power.ko 2023-10-14T09:02:12.047 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-14T09:02:12.047 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-14T09:02:12.047 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-14T09:02:12.047 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-14T09:02:12.047 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/ 2023-10-14T09:02:12.047 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-14T09:02:12.048 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-14T09:02:12.048 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/ 2023-10-14T09:02:12.048 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/ 2023-10-14T09:02:12.048 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-14T09:02:12.048 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-14T09:02:12.049 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-14T09:02:12.049 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-14T09:02:12.049 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ 2023-10-14T09:02:12.049 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-14T09:02:12.049 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-14T09:02:12.050 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/ 2023-10-14T09:02:12.050 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-14T09:02:12.050 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-14T09:02:12.050 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-14T09:02:12.050 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-14T09:02:12.050 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-14T09:02:12.051 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-14T09:02:12.051 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-14T09:02:12.051 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-14T09:02:12.051 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-14T09:02:12.051 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-14T09:02:12.051 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-14T09:02:12.052 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-14T09:02:12.052 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-14T09:02:12.052 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-14T09:02:12.052 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-14T09:02:12.052 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-14T09:02:12.052 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-14T09:02:12.053 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-14T09:02:12.053 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-14T09:02:12.053 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-14T09:02:12.053 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-14T09:02:12.053 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-14T09:02:12.053 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-14T09:02:12.054 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-14T09:02:12.054 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-14T09:02:12.054 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-14T09:02:12.054 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-14T09:02:12.054 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-14T09:02:12.055 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-14T09:02:12.055 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-14T09:02:12.055 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-14T09:02:12.055 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-14T09:02:12.055 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-14T09:02:12.055 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-14T09:02:12.056 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-14T09:02:12.056 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-14T09:02:12.056 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-14T09:02:12.056 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-14T09:02:12.056 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-14T09:02:12.056 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-14T09:02:12.057 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-14T09:02:12.057 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-14T09:02:12.057 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-14T09:02:12.057 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-14T09:02:12.057 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-14T09:02:12.058 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-14T09:02:12.058 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-14T09:02:12.058 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-14T09:02:12.058 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-14T09:02:12.058 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-14T09:02:12.059 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-14T09:02:12.059 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ 2023-10-14T09:02:12.059 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-14T09:02:12.059 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-14T09:02:12.059 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-14T09:02:12.059 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 135185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-14T09:02:12.060 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-14T09:02:12.060 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/ 2023-10-14T09:02:12.060 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 272305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-14T09:02:12.060 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-14T09:02:12.060 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/ 2023-10-14T09:02:12.061 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 356265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-14T09:02:12.061 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 295801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-14T09:02:12.061 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/ 2023-10-14T09:02:12.061 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 189185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-14T09:02:12.061 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-14T09:02:12.061 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/ 2023-10-14T09:02:12.062 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-14T09:02:12.062 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-14T09:02:12.062 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/ 2023-10-14T09:02:12.062 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 246985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-14T09:02:12.062 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/ 2023-10-14T09:02:12.063 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1171945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-14T09:02:12.063 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/ 2023-10-14T09:02:12.063 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 237273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-14T09:02:12.063 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/ 2023-10-14T09:02:12.063 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-14T09:02:12.064 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-14T09:02:12.064 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/ 2023-10-14T09:02:12.064 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 308921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-14T09:02:12.064 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/ 2023-10-14T09:02:12.064 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-14T09:02:12.065 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-14T09:02:12.065 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-14T09:02:12.065 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-14T09:02:12.065 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 146689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-14T09:02:12.065 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-14T09:02:12.065 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-14T09:02:12.066 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/ 2023-10-14T09:02:12.066 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 212425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-14T09:02:12.066 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-14T09:02:12.066 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/ 2023-10-14T09:02:12.066 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-14T09:02:12.067 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 158505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-14T09:02:12.067 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fdomain.ko 2023-10-14T09:02:12.067 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/ 2023-10-14T09:02:12.067 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 263489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-14T09:02:12.067 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 201817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-14T09:02:12.067 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-14T09:02:12.068 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-14T09:02:12.068 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/imm.ko 2023-10-14T09:02:12.068 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-14T09:02:12.068 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 266537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-14T09:02:12.068 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-14T09:02:12.069 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/ 2023-10-14T09:02:12.069 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 317153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-14T09:02:12.069 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-14T09:02:12.069 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-14T09:02:12.069 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/ 2023-10-14T09:02:12.070 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 314865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-14T09:02:12.070 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 145585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-14T09:02:12.070 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-14T09:02:12.070 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/ 2023-10-14T09:02:12.070 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 216665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-14T09:02:12.071 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/ 2023-10-14T09:02:12.071 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2197249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-14T09:02:12.071 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/ 2023-10-14T09:02:12.071 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-14T09:02:12.071 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-14T09:02:12.071 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 310617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-14T09:02:12.072 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-14T09:02:12.072 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/ 2023-10-14T09:02:12.072 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 659777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-14T09:02:12.072 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/ 2023-10-14T09:02:12.072 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-14T09:02:12.073 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-14T09:02:12.073 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/ 2023-10-14T09:02:12.073 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-14T09:02:12.073 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-14T09:02:12.073 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-14T09:02:12.073 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-14T09:02:12.074 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/ 2023-10-14T09:02:12.074 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 364105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-14T09:02:12.074 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-14T09:02:12.074 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ppa.ko 2023-10-14T09:02:12.074 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-14T09:02:12.075 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/ 2023-10-14T09:02:12.075 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1876625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-14T09:02:12.075 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-14T09:02:12.075 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/ 2023-10-14T09:02:12.075 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 559033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-14T09:02:12.075 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-14T09:02:12.076 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-14T09:02:12.076 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 238825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-14T09:02:12.076 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 173937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-14T09:02:12.076 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 279313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-14T09:02:12.076 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-14T09:02:12.077 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-14T09:02:12.077 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-14T09:02:12.077 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-14T09:02:12.077 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-14T09:02:12.077 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-14T09:02:12.077 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-14T09:02:12.078 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 162121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-14T09:02:12.078 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-14T09:02:12.078 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-14T09:02:12.078 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-14T09:02:12.078 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-14T09:02:12.079 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ 2023-10-14T09:02:12.079 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 129441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-14T09:02:12.079 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/ 2023-10-14T09:02:12.079 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/ 2023-10-14T09:02:12.079 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 736601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-14T09:02:12.080 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/ 2023-10-14T09:02:12.080 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-14T09:02:12.080 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-14T09:02:12.080 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-14T09:02:12.080 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 930321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-14T09:02:12.080 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-14T09:02:12.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-14T09:02:12.081 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/ 2023-10-14T09:02:12.081 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-14T09:02:12.081 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/ 2023-10-14T09:02:12.081 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/ 2023-10-14T09:02:12.082 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-14T09:02:12.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-14T09:02:12.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-14T09:02:12.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-14T09:02:12.082 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-14T09:02:12.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-14T09:02:12.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-14T09:02:12.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-14T09:02:12.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-14T09:02:12.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-14T09:02:12.083 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-14T09:02:12.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-14T09:02:12.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-14T09:02:12.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-14T09:02:12.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-14T09:02:12.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-14T09:02:12.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-14T09:02:12.085 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ 2023-10-14T09:02:12.085 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ 2023-10-14T09:02:12.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-14T09:02:12.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/moxa.ko 2023-10-14T09:02:12.085 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/mxser.ko 2023-10-14T09:02:12.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-14T09:02:12.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-14T09:02:12.086 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-14T09:02:12.086 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/ 2023-10-14T09:02:12.086 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/ 2023-10-14T09:02:12.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-14T09:02:12.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-14T09:02:12.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-14T09:02:12.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-14T09:02:12.087 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-14T09:02:12.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-14T09:02:12.088 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/ 2023-10-14T09:02:12.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-14T09:02:12.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/rp2.ko 2023-10-14T09:02:12.088 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-14T09:02:12.088 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/ 2023-10-14T09:02:12.089 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ 2023-10-14T09:02:12.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 531265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-14T09:02:12.089 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ 2023-10-14T09:02:12.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-14T09:02:12.089 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-14T09:02:12.090 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/ 2023-10-14T09:02:12.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-14T09:02:12.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-14T09:02:12.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-14T09:02:12.090 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-14T09:02:12.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_mf624.ko 2023-10-14T09:02:12.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_netx.ko 2023-10-14T09:02:12.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-14T09:02:12.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-14T09:02:12.091 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-14T09:02:12.092 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/ 2023-10-14T09:02:12.092 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/ 2023-10-14T09:02:12.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-14T09:02:12.092 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ 2023-10-14T09:02:12.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 144377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-14T09:02:12.092 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-14T09:02:12.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-14T09:02:12.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-14T09:02:12.093 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/ 2023-10-14T09:02:12.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-14T09:02:12.093 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-14T09:02:12.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-14T09:02:12.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-14T09:02:12.094 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ 2023-10-14T09:02:12.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ulpi.ko 2023-10-14T09:02:12.094 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/ 2023-10-14T09:02:12.094 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-14T09:02:12.095 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/ 2023-10-14T09:02:12.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-14T09:02:12.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-14T09:02:12.095 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 444553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-14T09:02:12.095 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/ 2023-10-14T09:02:12.096 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/ 2023-10-14T09:02:12.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-14T09:02:12.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-14T09:02:12.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-14T09:02:12.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-14T09:02:12.096 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-14T09:02:12.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-14T09:02:12.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 92489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-14T09:02:12.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-14T09:02:12.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-14T09:02:12.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-14T09:02:12.097 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-14T09:02:12.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-14T09:02:12.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-14T09:02:12.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-14T09:02:12.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-14T09:02:12.098 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-14T09:02:12.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-14T09:02:12.099 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/ 2023-10-14T09:02:12.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-14T09:02:12.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-14T09:02:12.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-14T09:02:12.099 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-14T09:02:12.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-14T09:02:12.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-14T09:02:12.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-14T09:02:12.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-14T09:02:12.100 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-14T09:02:12.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-14T09:02:12.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-14T09:02:12.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-14T09:02:12.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-14T09:02:12.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-14T09:02:12.101 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 161225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-14T09:02:12.102 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/ 2023-10-14T09:02:12.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-14T09:02:12.102 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-14T09:02:12.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 157681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-14T09:02:12.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-14T09:02:12.102 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-14T09:02:12.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-14T09:02:12.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-14T09:02:12.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-14T09:02:12.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-14T09:02:12.103 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-14T09:02:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-14T09:02:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-14T09:02:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-14T09:02:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 156073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-14T09:02:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ 2023-10-14T09:02:12.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-14T09:02:12.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-14T09:02:12.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-14T09:02:12.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-14T09:02:12.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-14T09:02:12.105 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-14T09:02:12.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-14T09:02:12.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-14T09:02:12.106 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/ 2023-10-14T09:02:12.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-14T09:02:12.106 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-14T09:02:12.107 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ 2023-10-14T09:02:12.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-14T09:02:12.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-14T09:02:12.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-14T09:02:12.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cytherm.ko 2023-10-14T09:02:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ehset.ko 2023-10-14T09:02:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-14T09:02:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-14T09:02:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-14T09:02:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-14T09:02:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-14T09:02:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-14T09:02:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-14T09:02:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-14T09:02:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/lvstest.ko 2023-10-14T09:02:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-14T09:02:12.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-14T09:02:12.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-14T09:02:12.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-14T09:02:12.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-14T09:02:12.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-14T09:02:12.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbtest.ko 2023-10-14T09:02:12.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-14T09:02:12.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-14T09:02:12.111 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/ 2023-10-14T09:02:12.111 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/usbmon.ko 2023-10-14T09:02:12.112 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/ 2023-10-14T09:02:12.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 301545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-14T09:02:12.112 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/ 2023-10-14T09:02:12.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-14T09:02:12.112 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-14T09:02:12.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-14T09:02:12.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-14T09:02:12.113 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ 2023-10-14T09:02:12.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-14T09:02:12.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-14T09:02:12.113 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-14T09:02:12.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-14T09:02:12.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-14T09:02:12.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-14T09:02:12.114 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-14T09:02:12.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-14T09:02:12.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-14T09:02:12.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/f81232.ko 2023-10-14T09:02:12.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 175137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-14T09:02:12.115 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-14T09:02:12.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 137081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-14T09:02:12.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-14T09:02:12.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-14T09:02:12.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-14T09:02:12.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-14T09:02:12.116 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-14T09:02:12.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-14T09:02:12.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-14T09:02:12.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-14T09:02:12.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-14T09:02:12.117 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-14T09:02:12.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-14T09:02:12.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-14T09:02:12.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-14T09:02:12.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mxuport.ko 2023-10-14T09:02:12.118 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-14T09:02:12.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-14T09:02:12.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-14T09:02:12.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 190633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-14T09:02:12.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-14T09:02:12.119 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-14T09:02:12.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-14T09:02:12.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-14T09:02:12.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-14T09:02:12.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-14T09:02:12.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-14T09:02:12.120 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-14T09:02:12.121 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-14T09:02:12.121 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-14T09:02:12.121 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-14T09:02:12.121 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-14T09:02:12.121 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-14T09:02:12.122 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-14T09:02:12.122 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usbserial.ko 2023-10-14T09:02:12.122 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-14T09:02:12.122 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-14T09:02:12.122 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-14T09:02:12.123 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-14T09:02:12.123 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ 2023-10-14T09:02:12.123 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-14T09:02:12.123 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-14T09:02:12.123 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-14T09:02:12.124 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-14T09:02:12.124 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-14T09:02:12.124 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-14T09:02:12.124 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-14T09:02:12.124 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-14T09:02:12.125 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-14T09:02:12.125 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-14T09:02:12.125 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-14T09:02:12.125 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-14T09:02:12.125 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-14T09:02:12.125 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-14T09:02:12.126 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 179969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-14T09:02:12.126 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/ 2023-10-14T09:02:12.126 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-14T09:02:12.126 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-14T09:02:12.126 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-14T09:02:12.127 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/ 2023-10-14T09:02:12.127 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/ 2023-10-14T09:02:12.127 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 154297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-14T09:02:12.127 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-14T09:02:12.127 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-14T09:02:12.127 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-14T09:02:12.128 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/ 2023-10-14T09:02:12.128 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-14T09:02:12.128 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-14T09:02:12.128 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-14T09:02:12.128 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-14T09:02:12.128 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/ 2023-10-14T09:02:12.129 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/ 2023-10-14T09:02:12.129 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-14T09:02:12.129 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-14T09:02:12.129 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-14T09:02:12.129 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-14T09:02:12.129 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-14T09:02:12.130 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-14T09:02:12.130 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-14T09:02:12.130 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/bd6107.ko 2023-10-14T09:02:12.130 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-14T09:02:12.130 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-14T09:02:12.131 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-14T09:02:12.131 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-14T09:02:12.131 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-14T09:02:12.131 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-14T09:02:12.131 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-14T09:02:12.131 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-14T09:02:12.132 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-14T09:02:12.132 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-14T09:02:12.132 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-14T09:02:12.132 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-14T09:02:12.132 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-14T09:02:12.133 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/ 2023-10-14T09:02:12.133 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ 2023-10-14T09:02:12.133 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-14T09:02:12.133 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-14T09:02:12.133 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-14T09:02:12.133 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-14T09:02:12.134 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/ 2023-10-14T09:02:12.134 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-14T09:02:12.134 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-14T09:02:12.134 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-14T09:02:12.134 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-14T09:02:12.135 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-14T09:02:12.135 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-14T09:02:12.135 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-14T09:02:12.135 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-14T09:02:12.135 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-14T09:02:12.136 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-14T09:02:12.136 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-14T09:02:12.136 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-14T09:02:12.136 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ 2023-10-14T09:02:12.136 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-14T09:02:12.136 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-14T09:02:12.137 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-14T09:02:12.137 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-14T09:02:12.137 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-14T09:02:12.137 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-14T09:02:12.137 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-14T09:02:12.138 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-14T09:02:12.138 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-14T09:02:12.138 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-14T09:02:12.138 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-14T09:02:12.138 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-14T09:02:12.139 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-14T09:02:12.139 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-14T09:02:12.139 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-14T09:02:12.139 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-14T09:02:12.139 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-14T09:02:12.139 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-14T09:02:12.140 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-14T09:02:12.140 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-14T09:02:12.140 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-14T09:02:12.140 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-14T09:02:12.140 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-14T09:02:12.140 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-14T09:02:12.141 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-14T09:02:12.141 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-14T09:02:12.141 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-14T09:02:12.141 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-14T09:02:12.141 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-14T09:02:12.142 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-14T09:02:12.142 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-14T09:02:12.142 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-14T09:02:12.142 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-14T09:02:12.142 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-14T09:02:12.143 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-14T09:02:12.143 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-14T09:02:12.143 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-14T09:02:12.143 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-14T09:02:12.143 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-14T09:02:12.143 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-14T09:02:12.144 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-14T09:02:12.144 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-14T09:02:12.144 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-14T09:02:12.144 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-14T09:02:12.144 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-14T09:02:12.144 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-14T09:02:12.145 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-14T09:02:12.145 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-14T09:02:12.145 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/ 2023-10-14T09:02:12.145 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-14T09:02:12.145 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-14T09:02:12.145 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-14T09:02:12.146 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/ 2023-10-14T09:02:12.146 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 176441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-14T09:02:12.146 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-14T09:02:12.146 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-scsiback.ko 2023-10-14T09:02:12.146 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/ 2023-10-14T09:02:12.147 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-14T09:02:12.147 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ 2023-10-14T09:02:12.147 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/ 2023-10-14T09:02:12.147 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 166425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-14T09:02:12.147 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/ 2023-10-14T09:02:12.148 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/adfs.ko 2023-10-14T09:02:12.148 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/ 2023-10-14T09:02:12.148 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 163593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-14T09:02:12.148 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/ 2023-10-14T09:02:12.148 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 932817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/kafs.ko 2023-10-14T09:02:12.149 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/ 2023-10-14T09:02:12.149 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/autofs4.ko 2023-10-14T09:02:12.149 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/ 2023-10-14T09:02:12.149 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-14T09:02:12.149 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/ 2023-10-14T09:02:12.149 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/bfs.ko 2023-10-14T09:02:12.150 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-14T09:02:12.150 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/ 2023-10-14T09:02:12.150 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 3402585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-14T09:02:12.150 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/ 2023-10-14T09:02:12.150 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 306073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-14T09:02:12.151 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ 2023-10-14T09:02:12.151 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1323873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-14T09:02:12.151 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/ 2023-10-14T09:02:12.151 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-14T09:02:12.151 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/ 2023-10-14T09:02:12.151 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/configfs.ko 2023-10-14T09:02:12.152 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/ 2023-10-14T09:02:12.152 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-14T09:02:12.152 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/ 2023-10-14T09:02:12.152 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 642577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-14T09:02:12.152 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/ 2023-10-14T09:02:12.152 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/efs.ko 2023-10-14T09:02:12.153 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/ 2023-10-14T09:02:12.153 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1505025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-14T09:02:12.153 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/ 2023-10-14T09:02:12.153 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-14T09:02:12.153 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/ 2023-10-14T09:02:12.153 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/freevxfs.ko 2023-10-14T09:02:12.154 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/ 2023-10-14T09:02:12.154 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 226481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-14T09:02:12.154 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/ 2023-10-14T09:02:12.154 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-14T09:02:12.154 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/ 2023-10-14T09:02:12.155 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1231529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-14T09:02:12.155 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/ 2023-10-14T09:02:12.155 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 141209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-14T09:02:12.155 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/ 2023-10-14T09:02:12.155 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 222817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-14T09:02:12.156 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/ 2023-10-14T09:02:12.156 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 192329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/hpfs.ko 2023-10-14T09:02:12.156 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/ 2023-10-14T09:02:12.156 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-14T09:02:12.156 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/ 2023-10-14T09:02:12.156 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 419497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-14T09:02:12.157 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/ 2023-10-14T09:02:12.157 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 280313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-14T09:02:12.157 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/ 2023-10-14T09:02:12.157 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-14T09:02:12.157 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/ 2023-10-14T09:02:12.157 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-14T09:02:12.158 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/ 2023-10-14T09:02:12.158 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/ 2023-10-14T09:02:12.158 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-14T09:02:12.158 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/ 2023-10-14T09:02:12.159 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-14T09:02:12.159 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/ 2023-10-14T09:02:12.159 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 117513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-14T09:02:12.159 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1055649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-14T09:02:12.159 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv2.ko 2023-10-14T09:02:12.159 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 120177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-14T09:02:12.160 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2041689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-14T09:02:12.160 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/ 2023-10-14T09:02:12.160 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-14T09:02:12.160 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-14T09:02:12.160 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/ 2023-10-14T09:02:12.161 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1516809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-14T09:02:12.161 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/ 2023-10-14T09:02:12.161 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 592833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-14T09:02:12.161 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/ 2023-10-14T09:02:12.161 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-14T09:02:12.161 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-14T09:02:12.162 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-14T09:02:12.162 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-14T09:02:12.162 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-14T09:02:12.162 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-14T09:02:12.162 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-14T09:02:12.163 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-14T09:02:12.163 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-14T09:02:12.163 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-14T09:02:12.163 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-14T09:02:12.163 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ascii.ko 2023-10-14T09:02:12.164 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-14T09:02:12.164 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-14T09:02:12.164 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-14T09:02:12.164 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-14T09:02:12.164 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-14T09:02:12.164 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-14T09:02:12.165 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-14T09:02:12.165 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-14T09:02:12.165 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-14T09:02:12.165 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-14T09:02:12.165 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-14T09:02:12.166 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-14T09:02:12.166 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-14T09:02:12.166 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-14T09:02:12.166 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-14T09:02:12.166 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-14T09:02:12.167 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-14T09:02:12.167 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-14T09:02:12.167 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-14T09:02:12.167 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 142673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-14T09:02:12.167 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 165745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-14T09:02:12.167 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 118121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-14T09:02:12.168 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-14T09:02:12.168 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-14T09:02:12.168 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-14T09:02:12.168 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-14T09:02:12.168 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-14T09:02:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-14T09:02:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-14T09:02:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-14T09:02:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-14T09:02:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-14T09:02:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-14T09:02:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-14T09:02:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-14T09:02:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-14T09:02:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-14T09:02:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-14T09:02:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-14T09:02:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ 2023-10-14T09:02:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 219417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ntfs.ko 2023-10-14T09:02:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ 2023-10-14T09:02:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ 2023-10-14T09:02:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 244409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-14T09:02:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ 2023-10-14T09:02:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 440737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-14T09:02:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ 2023-10-14T09:02:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-14T09:02:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2592433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-14T09:02:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-14T09:02:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-14T09:02:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-14T09:02:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/ 2023-10-14T09:02:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/omfs.ko 2023-10-14T09:02:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/ 2023-10-14T09:02:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 352153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-14T09:02:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ 2023-10-14T09:02:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-14T09:02:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/ 2023-10-14T09:02:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/qnx4.ko 2023-10-14T09:02:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/ 2023-10-14T09:02:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/qnx6.ko 2023-10-14T09:02:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/ 2023-10-14T09:02:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_tree.ko 2023-10-14T09:02:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v1.ko 2023-10-14T09:02:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v2.ko 2023-10-14T09:02:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/ 2023-10-14T09:02:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 532673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-14T09:02:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/ 2023-10-14T09:02:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-14T09:02:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/ 2023-10-14T09:02:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/ 2023-10-14T09:02:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2668121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-14T09:02:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/ 2023-10-14T09:02:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-14T09:02:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-14T09:02:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/ 2023-10-14T09:02:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 134641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-14T09:02:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/ 2023-10-14T09:02:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-14T09:02:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/ 2023-10-14T09:02:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 247737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-14T09:02:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ 2023-10-14T09:02:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 162497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-14T09:02:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/ 2023-10-14T09:02:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4010729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-14T09:02:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/ 2023-10-14T09:02:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/ 2023-10-14T09:02:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/locktorture.ko 2023-10-14T09:02:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/ 2023-10-14T09:02:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/test_udelay.ko 2023-10-14T09:02:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-14T09:02:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ 2023-10-14T09:02:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-14T09:02:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc7.ko 2023-10-14T09:02:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-14T09:02:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/ 2023-10-14T09:02:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-14T09:02:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-14T09:02:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/interval_tree_test.ko 2023-10-14T09:02:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-14T09:02:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-14T09:02:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/ 2023-10-14T09:02:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-14T09:02:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-14T09:02:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/ 2023-10-14T09:02:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-14T09:02:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/memory-notifier-error-inject.ko 2023-10-14T09:02:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/notifier-error-inject.ko 2023-10-14T09:02:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/percpu_test.ko 2023-10-14T09:02:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/pm-notifier-error-inject.ko 2023-10-14T09:02:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/ 2023-10-14T09:02:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 143433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-14T09:02:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/rbtree_test.ko 2023-10-14T09:02:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/ 2023-10-14T09:02:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-14T09:02:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-kstrtox.ko 2023-10-14T09:02:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-string_helpers.ko 2023-10-14T09:02:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4760425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_bpf.ko 2023-10-14T09:02:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_firmware.ko 2023-10-14T09:02:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_module.ko 2023-10-14T09:02:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_user_copy.ko 2023-10-14T09:02:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-14T09:02:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-14T09:02:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-14T09:02:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/ 2023-10-14T09:02:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/xz_dec_test.ko 2023-10-14T09:02:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/ 2023-10-14T09:02:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-14T09:02:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ 2023-10-14T09:02:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/ 2023-10-14T09:02:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-14T09:02:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-14T09:02:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-14T09:02:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-14T09:02:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-14T09:02:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-14T09:02:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-14T09:02:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-14T09:02:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/ 2023-10-14T09:02:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-14T09:02:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-14T09:02:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-14T09:02:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-14T09:02:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-14T09:02:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/ 2023-10-14T09:02:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-14T09:02:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/ 2023-10-14T09:02:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 198337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-14T09:02:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-14T09:02:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-14T09:02:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-14T09:02:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/ 2023-10-14T09:02:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 649297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-14T09:02:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/ 2023-10-14T09:02:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-14T09:02:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 777689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-14T09:02:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ 2023-10-14T09:02:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-14T09:02:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-14T09:02:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-14T09:02:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-14T09:02:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-14T09:02:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-14T09:02:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-14T09:02:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-14T09:02:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-14T09:02:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-14T09:02:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-14T09:02:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-14T09:02:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-14T09:02:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-14T09:02:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-14T09:02:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-14T09:02:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-14T09:02:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-14T09:02:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-14T09:02:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-14T09:02:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-14T09:02:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-14T09:02:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-14T09:02:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/ 2023-10-14T09:02:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1047017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-14T09:02:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/ 2023-10-14T09:02:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-14T09:02:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/ 2023-10-14T09:02:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 194209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-14T09:02:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-14T09:02:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-14T09:02:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-14T09:02:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/ 2023-10-14T09:02:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 390473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-14T09:02:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-14T09:02:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-14T09:02:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-14T09:02:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-14T09:02:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/ 2023-10-14T09:02:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/hsr.ko 2023-10-14T09:02:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ 2023-10-14T09:02:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ 2023-10-14T09:02:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-14T09:02:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 254625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-14T09:02:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-14T09:02:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ 2023-10-14T09:02:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-14T09:02:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-14T09:02:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-14T09:02:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-14T09:02:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-14T09:02:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-14T09:02:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-14T09:02:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-14T09:02:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-14T09:02:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-14T09:02:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ 2023-10-14T09:02:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-14T09:02:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-14T09:02:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-14T09:02:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-14T09:02:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-14T09:02:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-14T09:02:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-14T09:02:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-14T09:02:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-14T09:02:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-14T09:02:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-14T09:02:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-14T09:02:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-14T09:02:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-14T09:02:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-14T09:02:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-14T09:02:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-14T09:02:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-14T09:02:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-14T09:02:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-14T09:02:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-14T09:02:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-14T09:02:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-14T09:02:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-14T09:02:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-14T09:02:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-14T09:02:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-14T09:02:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-14T09:02:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-14T09:02:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-14T09:02:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-14T09:02:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-14T09:02:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-14T09:02:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-14T09:02:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-14T09:02:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-14T09:02:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-14T09:02:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-14T09:02:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-14T09:02:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-14T09:02:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-14T09:02:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-14T09:02:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ 2023-10-14T09:02:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-14T09:02:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-14T09:02:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-14T09:02:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_gre.ko 2023-10-14T09:02:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-14T09:02:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-14T09:02:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-14T09:02:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-14T09:02:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/mip6.ko 2023-10-14T09:02:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ 2023-10-14T09:02:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-14T09:02:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-14T09:02:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-14T09:02:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-14T09:02:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-14T09:02:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-14T09:02:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-14T09:02:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-14T09:02:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-14T09:02:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-14T09:02:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-14T09:02:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-14T09:02:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-14T09:02:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-14T09:02:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-14T09:02:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-14T09:02:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-14T09:02:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-14T09:02:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-14T09:02:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-14T09:02:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-14T09:02:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-14T09:02:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-14T09:02:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-14T09:02:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-14T09:02:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-14T09:02:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-14T09:02:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-14T09:02:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/ 2023-10-14T09:02:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-14T09:02:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/ 2023-10-14T09:02:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-14T09:02:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-14T09:02:12.220 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-14T09:02:12.220 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-14T09:02:12.220 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-14T09:02:12.220 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-14T09:02:12.220 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-14T09:02:12.220 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/ 2023-10-14T09:02:12.221 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/lapb.ko 2023-10-14T09:02:12.221 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/ 2023-10-14T09:02:12.221 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-14T09:02:12.221 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 267777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc2.ko 2023-10-14T09:02:12.221 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/ 2023-10-14T09:02:12.222 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 290417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-14T09:02:12.222 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/ 2023-10-14T09:02:12.222 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-14T09:02:12.222 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ 2023-10-14T09:02:12.222 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ 2023-10-14T09:02:12.222 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-14T09:02:12.223 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-14T09:02:12.223 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-14T09:02:12.223 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-14T09:02:12.223 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-14T09:02:12.223 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-14T09:02:12.224 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-14T09:02:12.224 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-14T09:02:12.224 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 112849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-14T09:02:12.224 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-14T09:02:12.224 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-14T09:02:12.224 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-14T09:02:12.225 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 112585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-14T09:02:12.225 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 111585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-14T09:02:12.225 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 114465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-14T09:02:12.225 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-14T09:02:12.225 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ 2023-10-14T09:02:12.225 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 411729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-14T09:02:12.226 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-14T09:02:12.226 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-14T09:02:12.226 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-14T09:02:12.226 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-14T09:02:12.226 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-14T09:02:12.227 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-14T09:02:12.227 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-14T09:02:12.227 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-14T09:02:12.227 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-14T09:02:12.227 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-14T09:02:12.227 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-14T09:02:12.228 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-14T09:02:12.228 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-14T09:02:12.228 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-14T09:02:12.228 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 408257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-14T09:02:12.228 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-14T09:02:12.229 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-14T09:02:12.229 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-14T09:02:12.229 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 118145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-14T09:02:12.229 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-14T09:02:12.229 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-14T09:02:12.229 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-14T09:02:12.230 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-14T09:02:12.230 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-14T09:02:12.230 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-14T09:02:12.230 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-14T09:02:12.230 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-14T09:02:12.231 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-14T09:02:12.231 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-14T09:02:12.231 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-14T09:02:12.231 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-14T09:02:12.231 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 95417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-14T09:02:12.231 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-14T09:02:12.232 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-14T09:02:12.232 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-14T09:02:12.232 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-14T09:02:12.232 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-14T09:02:12.232 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-14T09:02:12.232 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 615313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-14T09:02:12.233 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-14T09:02:12.233 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-14T09:02:12.233 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-14T09:02:12.233 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-14T09:02:12.233 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-14T09:02:12.234 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-14T09:02:12.234 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-14T09:02:12.234 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-14T09:02:12.234 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-14T09:02:12.234 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-14T09:02:12.235 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-14T09:02:12.235 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-14T09:02:12.235 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-14T09:02:12.235 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-14T09:02:12.235 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-14T09:02:12.235 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-14T09:02:12.236 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-14T09:02:12.236 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-14T09:02:12.236 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_osf.ko 2023-10-14T09:02:12.236 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-14T09:02:12.236 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-14T09:02:12.236 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-14T09:02:12.237 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-14T09:02:12.237 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-14T09:02:12.237 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_synproxy.ko 2023-10-14T09:02:12.237 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tproxy.ko 2023-10-14T09:02:12.237 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/x_tables.ko 2023-10-14T09:02:12.237 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-14T09:02:12.238 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-14T09:02:12.238 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-14T09:02:12.238 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-14T09:02:12.238 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-14T09:02:12.238 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-14T09:02:12.239 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-14T09:02:12.239 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-14T09:02:12.239 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-14T09:02:12.239 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-14T09:02:12.239 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-14T09:02:12.240 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-14T09:02:12.240 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-14T09:02:12.240 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-14T09:02:12.240 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-14T09:02:12.240 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-14T09:02:12.240 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-14T09:02:12.241 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-14T09:02:12.241 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-14T09:02:12.241 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-14T09:02:12.241 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-14T09:02:12.241 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-14T09:02:12.241 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-14T09:02:12.242 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-14T09:02:12.242 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-14T09:02:12.242 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-14T09:02:12.242 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-14T09:02:12.242 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-14T09:02:12.243 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-14T09:02:12.243 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-14T09:02:12.243 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-14T09:02:12.243 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-14T09:02:12.243 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-14T09:02:12.243 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-14T09:02:12.244 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-14T09:02:12.244 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-14T09:02:12.244 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-14T09:02:12.244 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-14T09:02:12.244 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-14T09:02:12.244 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-14T09:02:12.245 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-14T09:02:12.245 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-14T09:02:12.245 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-14T09:02:12.245 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-14T09:02:12.245 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-14T09:02:12.246 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-14T09:02:12.246 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-14T09:02:12.246 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-14T09:02:12.246 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-14T09:02:12.246 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-14T09:02:12.246 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-14T09:02:12.247 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-14T09:02:12.247 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-14T09:02:12.247 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-14T09:02:12.247 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-14T09:02:12.247 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-14T09:02:12.248 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-14T09:02:12.248 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-14T09:02:12.248 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-14T09:02:12.248 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-14T09:02:12.248 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-14T09:02:12.248 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-14T09:02:12.249 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-14T09:02:12.249 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-14T09:02:12.249 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-14T09:02:12.249 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-14T09:02:12.249 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-14T09:02:12.250 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-14T09:02:12.250 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-14T09:02:12.250 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-14T09:02:12.250 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-14T09:02:12.250 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-14T09:02:12.251 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/ 2023-10-14T09:02:12.251 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-14T09:02:12.253 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/ 2023-10-14T09:02:12.253 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-14T09:02:12.254 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/ 2023-10-14T09:02:12.254 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 380033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-14T09:02:12.254 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-14T09:02:12.254 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-14T09:02:12.255 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-14T09:02:12.255 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/ 2023-10-14T09:02:12.255 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-14T09:02:12.255 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/ 2023-10-14T09:02:12.255 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 110201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/phonet.ko 2023-10-14T09:02:12.256 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/pn_pep.ko 2023-10-14T09:02:12.256 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/ 2023-10-14T09:02:12.256 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 251481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-14T09:02:12.256 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 164937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-14T09:02:12.256 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-14T09:02:12.256 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/ 2023-10-14T09:02:12.257 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 819657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/rxrpc.ko 2023-10-14T09:02:12.257 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/ 2023-10-14T09:02:12.257 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-14T09:02:12.257 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-14T09:02:12.257 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-14T09:02:12.258 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-14T09:02:12.258 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-14T09:02:12.258 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-14T09:02:12.258 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-14T09:02:12.258 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-14T09:02:12.259 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-14T09:02:12.259 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-14T09:02:12.259 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-14T09:02:12.259 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-14T09:02:12.259 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_cgroup.ko 2023-10-14T09:02:12.260 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-14T09:02:12.260 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-14T09:02:12.260 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-14T09:02:12.260 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-14T09:02:12.261 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-14T09:02:12.261 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-14T09:02:12.261 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-14T09:02:12.261 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-14T09:02:12.261 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-14T09:02:12.262 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-14T09:02:12.262 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-14T09:02:12.262 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-14T09:02:12.262 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-14T09:02:12.262 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-14T09:02:12.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq_codel.ko 2023-10-14T09:02:12.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-14T09:02:12.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-14T09:02:12.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-14T09:02:12.263 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-14T09:02:12.264 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-14T09:02:12.264 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-14T09:02:12.264 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-14T09:02:12.264 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-14T09:02:12.264 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-14T09:02:12.265 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-14T09:02:12.265 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-14T09:02:12.265 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-14T09:02:12.265 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-14T09:02:12.265 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-14T09:02:12.266 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-14T09:02:12.266 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-14T09:02:12.266 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-14T09:02:12.266 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-14T09:02:12.266 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/ 2023-10-14T09:02:12.267 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 929745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-14T09:02:12.267 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-14T09:02:12.267 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/ 2023-10-14T09:02:12.267 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/ 2023-10-14T09:02:12.267 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 336529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-14T09:02:12.268 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-14T09:02:12.268 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1520161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-14T09:02:12.268 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/ 2023-10-14T09:02:12.268 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 707721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-14T09:02:12.268 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/ 2023-10-14T09:02:12.269 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-14T09:02:12.269 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 862641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-14T09:02:12.269 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/ 2023-10-14T09:02:12.269 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-14T09:02:12.269 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/ 2023-10-14T09:02:12.269 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-14T09:02:12.270 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-14T09:02:12.270 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 96193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-14T09:02:12.270 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-14T09:02:12.270 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-14T09:02:12.270 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/ 2023-10-14T09:02:12.271 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/x25.ko 2023-10-14T09:02:12.271 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/ 2023-10-14T09:02:12.271 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_algo.ko 2023-10-14T09:02:12.271 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-14T09:02:12.271 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_user.ko 2023-10-14T09:02:12.272 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/ 2023-10-14T09:02:12.272 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/ 2023-10-14T09:02:12.272 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-14T09:02:12.272 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 639863 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-14T09:02:12.272 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 623919 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-14T09:02:12.273 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7663 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-14T09:02:12.273 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23428 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-14T09:02:12.273 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9821 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-14T09:02:12.273 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70004 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-14T09:02:12.273 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 146313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-14T09:02:12.273 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 232548 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-14T09:02:12.274 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 210 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-14T09:02:12.274 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72606 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-14T09:02:12.274 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 879 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-14T09:02:12.274 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 254438 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-14T09:02:12.274 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 309363 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-14T09:02:12.275 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/ 2023-10-14T09:02:12.275 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/ 2023-10-14T09:02:12.275 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/doc/ 2023-10-14T09:02:12.275 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/ 2023-10-14T09:02:12.275 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 175 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/changelog.Debian.gz 2023-10-14T09:02:12.276 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 691 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/copyright 2023-10-14T09:02:12.276 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-14T09:02:12.277 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g47672119149b 2023-10-14T09:02:12.277 DEBUG:teuthology.orchestra.run.smithi078:> egrep '(submenu|menuentry.*6.6.0-rc5-g47672119149b).*{' /boot/grub/grub.cfg 2023-10-14T09:02:12.284 INFO:teuthology.orchestra.run.smithi078.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T09:02:12.284 INFO:teuthology.orchestra.run.smithi078.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T09:02:12.284 INFO:teuthology.orchestra.run.smithi078.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T09:02:12.285 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-14T09:02:12.285 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g47672119149b 2023-10-14T09:02:12.286 DEBUG:teuthology.orchestra.run.smithi078:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-14T09:02:12.331 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi078.front.sepia.ceph.com to complete... 2023-10-14T09:02:12.713 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2023-10-14T09:02:12.714 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-14T09:02:12.741 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2023-10-14T09:02:12.915 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T09:02:12.921 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T09:02:13.149 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-14T09:02:13.155 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-14T09:02:13.198 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-14T09:02:13.204 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-14T09:02:13.333 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-14T09:02:13.333 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-14T09:02:13.333 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-14T09:02:13.358 INFO:teuthology.orchestra.run.smithi078.stderr:done 2023-10-14T09:02:20.898 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub' 2023-10-14T09:02:20.912 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-14T09:02:20.946 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2023-10-14T09:02:21.228 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T09:02:21.250 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T09:02:21.503 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-14T09:02:21.513 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-14T09:02:21.574 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-14T09:02:21.579 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-14T09:02:21.727 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-14T09:02:21.728 INFO:teuthology.orchestra.run.smithi157.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-14T09:02:21.728 INFO:teuthology.orchestra.run.smithi157.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-14T09:02:21.761 INFO:teuthology.orchestra.run.smithi157.stderr:done 2023-10-14T09:02:21.927 DEBUG:teuthology.orchestra.run.smithi157:> dpkg-deb -c /tmp/linux-image.deb 2023-10-14T09:02:21.935 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./ 2023-10-14T09:02:21.935 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./boot/ 2023-10-14T09:02:21.935 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 4415097 2023-10-10 19:56 ./boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T09:02:21.946 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 169298 2023-10-10 19:56 ./boot/config-6.6.0-rc5-g47672119149b 2023-10-14T09:02:21.947 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11352928 2023-10-10 19:56 ./boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T09:02:21.966 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/ 2023-10-14T09:02:21.967 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/ 2023-10-14T09:02:21.967 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/postinst.d/ 2023-10-14T09:02:21.967 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/postrm.d/ 2023-10-14T09:02:21.967 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/preinst.d/ 2023-10-14T09:02:21.967 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./etc/kernel/prerm.d/ 2023-10-14T09:02:21.968 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/ 2023-10-14T09:02:21.968 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/ 2023-10-14T09:02:21.968 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/ 2023-10-14T09:02:21.968 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/ 2023-10-14T09:02:21.968 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/ 2023-10-14T09:02:21.969 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/ 2023-10-14T09:02:21.969 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ 2023-10-14T09:02:21.969 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 490233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-14T09:02:21.972 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-14T09:02:21.972 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-14T09:02:21.972 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-14T09:02:21.973 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 93113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-14T09:02:21.973 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 106729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-14T09:02:21.973 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 152241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-14T09:02:21.973 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-14T09:02:21.973 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-14T09:02:21.974 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 83889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-14T09:02:21.974 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-14T09:02:21.974 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-14T09:02:21.974 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-14T09:02:21.974 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-14T09:02:21.975 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-14T09:02:21.975 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-14T09:02:21.975 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 58585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-14T09:02:21.975 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-14T09:02:21.975 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-14T09:02:21.976 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-14T09:02:21.976 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/ 2023-10-14T09:02:21.976 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/ 2023-10-14T09:02:21.976 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-14T09:02:21.976 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-14T09:02:21.977 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpuid.ko 2023-10-14T09:02:21.977 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/msr.ko 2023-10-14T09:02:21.977 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/ 2023-10-14T09:02:21.977 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 353761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-14T09:02:21.977 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 881713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-14T09:02:21.978 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 2276817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-14T09:02:22.017 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ 2023-10-14T09:02:22.017 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 53761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/af_alg.ko 2023-10-14T09:02:22.017 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_hash.ko 2023-10-14T09:02:22.017 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_skcipher.ko 2023-10-14T09:02:22.018 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-14T09:02:22.018 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-14T09:02:22.018 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-14T09:02:22.018 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/ 2023-10-14T09:02:22.019 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-14T09:02:22.019 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/ 2023-10-14T09:02:22.019 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-14T09:02:22.019 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-14T09:02:22.019 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-14T09:02:22.020 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-14T09:02:22.020 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-14T09:02:22.020 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-14T09:02:22.020 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-14T09:02:22.020 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-14T09:02:22.021 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-14T09:02:22.021 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-14T09:02:22.021 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-14T09:02:22.021 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-14T09:02:22.021 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-14T09:02:22.022 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-14T09:02:22.022 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-14T09:02:22.022 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-14T09:02:22.022 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-14T09:02:22.022 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-14T09:02:22.023 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cryptd.ko 2023-10-14T09:02:22.023 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-14T09:02:22.023 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_simd.ko 2023-10-14T09:02:22.023 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-14T09:02:22.023 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-14T09:02:22.024 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-14T09:02:22.024 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-14T09:02:22.024 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-14T09:02:22.024 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-14T09:02:22.024 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-14T09:02:22.025 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-14T09:02:22.025 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lrw.ko 2023-10-14T09:02:22.025 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-14T09:02:22.025 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-14T09:02:22.025 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-14T09:02:22.026 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-14T09:02:22.026 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-14T09:02:22.026 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-14T09:02:22.026 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-14T09:02:22.026 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-14T09:02:22.027 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-14T09:02:22.027 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 149193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-14T09:02:22.027 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-14T09:02:22.027 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-14T09:02:22.027 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-14T09:02:22.028 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-14T09:02:22.028 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-14T09:02:22.028 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-14T09:02:22.028 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-14T09:02:22.028 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xts.ko 2023-10-14T09:02:22.028 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-14T09:02:22.029 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ 2023-10-14T09:02:22.029 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ 2023-10-14T09:02:22.029 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-14T09:02:22.029 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-14T09:02:22.029 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-14T09:02:22.030 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/ 2023-10-14T09:02:22.030 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/einj.ko 2023-10-14T09:02:22.030 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-14T09:02:22.030 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-14T09:02:22.030 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-14T09:02:22.031 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-14T09:02:22.031 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 103025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-14T09:02:22.031 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ 2023-10-14T09:02:22.031 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-14T09:02:22.031 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 88865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci.ko 2023-10-14T09:02:22.032 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-14T09:02:22.032 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 88289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci.ko 2023-10-14T09:02:22.032 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-14T09:02:22.032 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-14T09:02:22.032 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-14T09:02:22.033 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-14T09:02:22.033 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-14T09:02:22.033 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-14T09:02:22.033 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-14T09:02:22.033 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-14T09:02:22.034 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-14T09:02:22.034 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-14T09:02:22.034 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-14T09:02:22.034 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-14T09:02:22.034 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-14T09:02:22.035 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-14T09:02:22.035 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-14T09:02:22.035 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-14T09:02:22.035 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-14T09:02:22.035 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-14T09:02:22.035 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_legacy.ko 2023-10-14T09:02:22.036 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-14T09:02:22.036 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-14T09:02:22.036 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-14T09:02:22.036 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-14T09:02:22.036 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-14T09:02:22.037 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-14T09:02:22.037 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-14T09:02:22.037 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-14T09:02:22.037 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-14T09:02:22.037 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-14T09:02:22.038 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-14T09:02:22.038 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-14T09:02:22.038 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-14T09:02:22.038 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_radisys.ko 2023-10-14T09:02:22.038 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-14T09:02:22.039 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rz1000.ko 2023-10-14T09:02:22.039 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-14T09:02:22.039 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-14T09:02:22.039 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-14T09:02:22.039 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-14T09:02:22.040 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-14T09:02:22.040 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-14T09:02:22.040 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-14T09:02:22.040 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-14T09:02:22.040 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 83345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-14T09:02:22.041 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 70393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-14T09:02:22.041 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-14T09:02:22.041 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-14T09:02:22.041 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-14T09:02:22.041 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-14T09:02:22.041 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-14T09:02:22.042 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-14T09:02:22.042 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-14T09:02:22.042 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-14T09:02:22.042 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-14T09:02:22.042 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-14T09:02:22.043 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ 2023-10-14T09:02:22.043 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-14T09:02:22.043 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/ 2023-10-14T09:02:22.043 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 124473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-14T09:02:22.043 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/ 2023-10-14T09:02:22.044 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/ 2023-10-14T09:02:22.044 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 113665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-14T09:02:22.044 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/ 2023-10-14T09:02:22.044 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 965585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-14T09:02:22.044 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 173225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-14T09:02:22.045 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/ 2023-10-14T09:02:22.045 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 94297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-14T09:02:22.045 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 115793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-14T09:02:22.045 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/ 2023-10-14T09:02:22.045 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 110449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-14T09:02:22.046 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 98193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-14T09:02:22.046 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 263769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-14T09:02:22.046 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/ 2023-10-14T09:02:22.046 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 98145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-14T09:02:22.046 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/ 2023-10-14T09:02:22.046 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 60217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-14T09:02:22.047 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ 2023-10-14T09:02:22.047 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/applicom.ko 2023-10-14T09:02:22.047 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-14T09:02:22.047 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/ 2023-10-14T09:02:22.047 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-14T09:02:22.048 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-14T09:02:22.048 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-14T09:02:22.048 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-14T09:02:22.048 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-14T09:02:22.048 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ 2023-10-14T09:02:22.049 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-14T09:02:22.049 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 148601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-14T09:02:22.049 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-14T09:02:22.049 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 139313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-14T09:02:22.049 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 70921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-14T09:02:22.049 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 53513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-14T09:02:22.050 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-14T09:02:22.050 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/ 2023-10-14T09:02:22.050 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 84097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-14T09:02:22.050 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/nvram.ko 2023-10-14T09:02:22.050 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-14T09:02:22.051 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-14T09:02:22.051 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/ 2023-10-14T09:02:22.051 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-14T09:02:22.051 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-14T09:02:22.051 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-14T09:02:22.052 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-14T09:02:22.052 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-14T09:02:22.052 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-14T09:02:22.052 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-14T09:02:22.052 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/ 2023-10-14T09:02:22.053 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-14T09:02:22.053 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-14T09:02:22.053 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-14T09:02:22.053 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/ 2023-10-14T09:02:22.053 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-palmas.ko 2023-10-14T09:02:22.054 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-si5351.ko 2023-10-14T09:02:22.054 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-twl6040.ko 2023-10-14T09:02:22.054 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-wm831x.ko 2023-10-14T09:02:22.054 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/ 2023-10-14T09:02:22.054 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-14T09:02:22.055 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-14T09:02:22.055 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-14T09:02:22.055 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ 2023-10-14T09:02:22.055 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ 2023-10-14T09:02:22.055 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 70801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-14T09:02:22.055 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 243025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-14T09:02:22.056 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/ 2023-10-14T09:02:22.056 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/ 2023-10-14T09:02:22.056 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-14T09:02:22.056 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 438761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-14T09:02:22.056 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-14T09:02:22.057 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-14T09:02:22.057 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-14T09:02:22.057 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-14T09:02:22.057 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/ 2023-10-14T09:02:22.057 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 68857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-14T09:02:22.058 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/ 2023-10-14T09:02:22.058 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-14T09:02:22.058 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ 2023-10-14T09:02:22.058 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/ 2023-10-14T09:02:22.058 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-14T09:02:22.059 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ 2023-10-14T09:02:22.059 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 122569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-14T09:02:22.059 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ 2023-10-14T09:02:22.059 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 79953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-14T09:02:22.059 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-14T09:02:22.060 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 63617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-14T09:02:22.060 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-14T09:02:22.060 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-14T09:02:22.060 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-14T09:02:22.060 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-14T09:02:22.061 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-14T09:02:22.061 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 52041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-14T09:02:22.061 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-14T09:02:22.061 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-14T09:02:22.061 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 56825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-14T09:02:22.062 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-14T09:02:22.062 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/ 2023-10-14T09:02:22.062 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-14T09:02:22.062 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-14T09:02:22.062 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-14T09:02:22.063 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-14T09:02:22.063 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-14T09:02:22.063 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-14T09:02:22.063 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-14T09:02:22.063 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/ 2023-10-14T09:02:22.063 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-14T09:02:22.064 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/ 2023-10-14T09:02:22.064 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-14T09:02:22.064 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-14T09:02:22.064 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/ 2023-10-14T09:02:22.064 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-14T09:02:22.065 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-14T09:02:22.065 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-14T09:02:22.065 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-14T09:02:22.065 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-14T09:02:22.065 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-14T09:02:22.066 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 77849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-14T09:02:22.066 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-generic.ko 2023-10-14T09:02:22.066 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-14T09:02:22.066 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-14T09:02:22.066 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-14T09:02:22.066 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-14T09:02:22.067 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-14T09:02:22.067 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-14T09:02:22.067 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-14T09:02:22.067 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-14T09:02:22.067 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-14T09:02:22.068 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-14T09:02:22.068 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-14T09:02:22.068 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch.ko 2023-10-14T09:02:22.068 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-14T09:02:22.068 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-14T09:02:22.069 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-14T09:02:22.069 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-14T09:02:22.069 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-14T09:02:22.069 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-14T09:02:22.069 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-14T09:02:22.069 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-14T09:02:22.070 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-14T09:02:22.070 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/ 2023-10-14T09:02:22.070 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-a4tech.ko 2023-10-14T09:02:22.070 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-apple.ko 2023-10-14T09:02:22.070 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-14T09:02:22.071 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-14T09:02:22.071 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-14T09:02:22.071 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-belkin.ko 2023-10-14T09:02:22.071 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cherry.ko 2023-10-14T09:02:22.071 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-chicony.ko 2023-10-14T09:02:22.072 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 60649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cp2112.ko 2023-10-14T09:02:22.072 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cypress.ko 2023-10-14T09:02:22.072 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-14T09:02:22.072 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-14T09:02:22.072 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-14T09:02:22.073 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-14T09:02:22.073 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ezkey.ko 2023-10-14T09:02:22.073 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-14T09:02:22.073 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-generic.ko 2023-10-14T09:02:22.073 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-14T09:02:22.074 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-14T09:02:22.074 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-14T09:02:22.074 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-14T09:02:22.074 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-14T09:02:22.074 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-14T09:02:22.075 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-14T09:02:22.075 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kensington.ko 2023-10-14T09:02:22.075 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-14T09:02:22.075 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-14T09:02:22.075 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-14T09:02:22.075 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-14T09:02:22.076 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-14T09:02:22.076 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-14T09:02:22.076 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 58185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-14T09:02:22.076 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 101369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-14T09:02:22.076 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 80993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech.ko 2023-10-14T09:02:22.077 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-14T09:02:22.077 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-microsoft.ko 2023-10-14T09:02:22.077 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-monterey.ko 2023-10-14T09:02:22.077 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-14T09:02:22.077 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ntrig.ko 2023-10-14T09:02:22.078 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-14T09:02:22.078 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-14T09:02:22.078 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-14T09:02:22.078 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 72937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-14T09:02:22.078 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-14T09:02:22.079 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-14T09:02:22.079 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-14T09:02:22.079 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-14T09:02:22.079 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-14T09:02:22.079 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-14T09:02:22.080 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-14T09:02:22.080 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-14T09:02:22.080 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-14T09:02:22.080 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-14T09:02:22.080 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-14T09:02:22.080 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-14T09:02:22.081 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-14T09:02:22.081 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-14T09:02:22.081 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-14T09:02:22.081 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-14T09:02:22.081 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-14T09:02:22.082 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-14T09:02:22.082 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-14T09:02:22.082 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-14T09:02:22.082 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-14T09:02:22.082 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-14T09:02:22.083 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-14T09:02:22.083 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-14T09:02:22.083 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-14T09:02:22.083 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-14T09:02:22.083 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-14T09:02:22.084 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-14T09:02:22.084 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-14T09:02:22.084 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 71073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-14T09:02:22.084 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-14T09:02:22.084 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 143473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-14T09:02:22.085 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-14T09:02:22.085 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-14T09:02:22.085 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-14T09:02:22.085 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 267825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid.ko 2023-10-14T09:02:22.085 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-14T09:02:22.086 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/ 2023-10-14T09:02:22.086 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 125721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-14T09:02:22.086 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-14T09:02:22.086 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-14T09:02:22.086 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 217873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-14T09:02:22.087 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/ 2023-10-14T09:02:22.087 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 64201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-14T09:02:22.087 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 89625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-14T09:02:22.087 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 305465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-14T09:02:22.087 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ 2023-10-14T09:02:22.087 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 66521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-14T09:02:22.088 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 61393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-14T09:02:22.088 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-14T09:02:22.088 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-14T09:02:22.088 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-14T09:02:22.088 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-14T09:02:22.089 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-14T09:02:22.089 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 97977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-14T09:02:22.089 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-14T09:02:22.089 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 45553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-14T09:02:22.089 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-14T09:02:22.090 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-14T09:02:22.090 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-14T09:02:22.090 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-14T09:02:22.090 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 74433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-14T09:02:22.090 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-14T09:02:22.091 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-14T09:02:22.091 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-14T09:02:22.091 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-14T09:02:22.091 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 55265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-14T09:02:22.091 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-14T09:02:22.091 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 58617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-14T09:02:22.092 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-14T09:02:22.092 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-14T09:02:22.092 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-14T09:02:22.092 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-14T09:02:22.092 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-14T09:02:22.093 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-14T09:02:22.093 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 99601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-14T09:02:22.093 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-14T09:02:22.093 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-14T09:02:22.093 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-14T09:02:22.094 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc2103.ko 2023-10-14T09:02:22.094 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-14T09:02:22.094 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 66985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-14T09:02:22.094 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 94457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-14T09:02:22.094 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-14T09:02:22.095 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-14T09:02:22.095 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 55449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-14T09:02:22.095 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-14T09:02:22.095 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-14T09:02:22.095 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 46801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-14T09:02:22.095 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 45529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-14T09:02:22.096 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hih6130.ko 2023-10-14T09:02:22.096 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-14T09:02:22.096 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-14T09:02:22.096 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-14T09:02:22.096 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-14T09:02:22.097 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-14T09:02:22.097 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-14T09:02:22.097 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-14T09:02:22.097 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 130449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-14T09:02:22.098 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/jc42.ko 2023-10-14T09:02:22.098 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-14T09:02:22.098 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-14T09:02:22.098 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-14T09:02:22.098 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 48601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-14T09:02:22.099 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-14T09:02:22.099 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-14T09:02:22.099 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-14T09:02:22.099 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-14T09:02:22.099 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-14T09:02:22.099 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-14T09:02:22.100 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 72833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-14T09:02:22.100 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 46153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-14T09:02:22.100 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-14T09:02:22.100 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-14T09:02:22.100 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 108841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-14T09:02:22.101 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-14T09:02:22.101 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-14T09:02:22.101 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-14T09:02:22.101 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-14T09:02:22.101 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-14T09:02:22.101 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-14T09:02:22.102 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-14T09:02:22.102 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-14T09:02:22.102 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-14T09:02:22.102 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-14T09:02:22.102 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-14T09:02:22.103 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-14T09:02:22.103 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-14T09:02:22.103 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-14T09:02:22.103 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-14T09:02:22.103 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-14T09:02:22.103 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-14T09:02:22.104 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-14T09:02:22.104 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-14T09:02:22.104 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-14T09:02:22.104 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-14T09:02:22.104 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 119817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-14T09:02:22.105 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 60705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-14T09:02:22.105 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 59737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-14T09:02:22.105 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 82337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-14T09:02:22.105 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 54433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-14T09:02:22.105 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-14T09:02:22.105 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ 2023-10-14T09:02:22.106 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-14T09:02:22.106 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-14T09:02:22.106 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-14T09:02:22.106 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-14T09:02:22.107 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-14T09:02:22.107 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-14T09:02:22.107 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-14T09:02:22.107 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 82577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-14T09:02:22.107 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-14T09:02:22.107 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-14T09:02:22.108 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-14T09:02:22.108 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-14T09:02:22.108 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-14T09:02:22.108 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-14T09:02:22.108 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-14T09:02:22.109 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-14T09:02:22.109 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-14T09:02:22.109 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-14T09:02:22.109 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-14T09:02:22.109 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-14T09:02:22.109 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-14T09:02:22.110 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-14T09:02:22.110 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-14T09:02:22.110 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-14T09:02:22.110 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-14T09:02:22.110 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-14T09:02:22.111 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-14T09:02:22.111 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-14T09:02:22.111 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-14T09:02:22.111 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-14T09:02:22.111 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 52457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-14T09:02:22.112 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-14T09:02:22.112 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 57513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-14T09:02:22.112 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-14T09:02:22.112 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 71345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-14T09:02:22.112 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 63289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-14T09:02:22.113 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 71321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-14T09:02:22.113 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 101473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-14T09:02:22.113 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 119505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-14T09:02:22.113 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-14T09:02:22.113 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-14T09:02:22.114 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-14T09:02:22.114 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-14T09:02:22.114 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/ 2023-10-14T09:02:22.114 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/ 2023-10-14T09:02:22.114 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-14T09:02:22.115 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-14T09:02:22.115 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/ 2023-10-14T09:02:22.115 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-14T09:02:22.115 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-14T09:02:22.115 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-14T09:02:22.115 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-14T09:02:22.116 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-14T09:02:22.116 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-14T09:02:22.116 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-14T09:02:22.116 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 6929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-14T09:02:22.116 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-14T09:02:22.117 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-14T09:02:22.117 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-14T09:02:22.117 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-14T09:02:22.117 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-14T09:02:22.117 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-14T09:02:22.117 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-14T09:02:22.118 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-14T09:02:22.118 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-14T09:02:22.118 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-14T09:02:22.118 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-14T09:02:22.118 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-14T09:02:22.119 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-14T09:02:22.119 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-14T09:02:22.119 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-14T09:02:22.119 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-14T09:02:22.119 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-14T09:02:22.120 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-14T09:02:22.120 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-14T09:02:22.120 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-14T09:02:22.120 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-14T09:02:22.120 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-14T09:02:22.120 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-14T09:02:22.121 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-14T09:02:22.121 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-14T09:02:22.121 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-14T09:02:22.121 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-14T09:02:22.121 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-14T09:02:22.121 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-14T09:02:22.122 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-14T09:02:22.122 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-14T09:02:22.122 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-14T09:02:22.122 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/ 2023-10-14T09:02:22.122 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-14T09:02:22.123 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-14T09:02:22.123 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-14T09:02:22.123 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ 2023-10-14T09:02:22.123 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ 2023-10-14T09:02:22.123 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 273609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-14T09:02:22.124 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 879969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-14T09:02:22.124 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 69337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-14T09:02:22.124 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 324217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-14T09:02:22.124 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 97985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-14T09:02:22.124 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 282273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-14T09:02:22.124 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 66201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-14T09:02:22.125 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ 2023-10-14T09:02:22.125 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-14T09:02:22.125 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 493073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-14T09:02:22.125 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-14T09:02:22.125 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 419737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-14T09:02:22.126 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-14T09:02:22.126 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 739025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-14T09:02:22.255 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ 2023-10-14T09:02:22.255 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 296625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-14T09:02:22.255 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-14T09:02:22.255 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 153697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-14T09:02:22.255 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/ 2023-10-14T09:02:22.256 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 168969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-14T09:02:22.256 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ 2023-10-14T09:02:22.256 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-14T09:02:22.256 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 263081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-14T09:02:22.256 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ 2023-10-14T09:02:22.257 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 100241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-14T09:02:22.257 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ 2023-10-14T09:02:22.257 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 111425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-14T09:02:22.257 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ 2023-10-14T09:02:22.257 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 128753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-14T09:02:22.258 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-14T09:02:22.258 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 129529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-14T09:02:22.258 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ 2023-10-14T09:02:22.258 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/evbug.ko 2023-10-14T09:02:22.258 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ff-memless.ko 2023-10-14T09:02:22.259 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/ 2023-10-14T09:02:22.259 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-14T09:02:22.259 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-14T09:02:22.259 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-14T09:02:22.259 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-14T09:02:22.260 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/ 2023-10-14T09:02:22.260 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-14T09:02:22.260 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-14T09:02:22.260 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-14T09:02:22.260 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-14T09:02:22.261 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-14T09:02:22.261 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-14T09:02:22.261 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-14T09:02:22.261 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-14T09:02:22.261 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-14T09:02:22.262 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-14T09:02:22.262 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-14T09:02:22.262 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-14T09:02:22.262 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-14T09:02:22.262 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-14T09:02:22.263 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-14T09:02:22.263 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-14T09:02:22.263 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-14T09:02:22.263 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-14T09:02:22.263 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-14T09:02:22.264 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-14T09:02:22.264 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-14T09:02:22.264 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-14T09:02:22.264 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-14T09:02:22.264 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-14T09:02:22.265 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/matrix-keymap.ko 2023-10-14T09:02:22.265 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/ 2023-10-14T09:02:22.265 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-14T09:02:22.265 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-14T09:02:22.265 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 123681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-14T09:02:22.266 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 89449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-14T09:02:22.266 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-14T09:02:22.266 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 335977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/psmouse.ko 2023-10-14T09:02:22.266 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-14T09:02:22.266 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-14T09:02:22.267 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-14T09:02:22.267 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-14T09:02:22.267 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/ 2023-10-14T09:02:22.267 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 109873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-14T09:02:22.267 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ 2023-10-14T09:02:22.268 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-14T09:02:22.268 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-14T09:02:22.268 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ct82c710.ko 2023-10-14T09:02:22.268 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-14T09:02:22.268 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/parkbd.ko 2023-10-14T09:02:22.269 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/pcips2.ko 2023-10-14T09:02:22.269 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ps2mult.ko 2023-10-14T09:02:22.269 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-14T09:02:22.269 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serport.ko 2023-10-14T09:02:22.270 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-14T09:02:22.270 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/ 2023-10-14T09:02:22.270 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/ 2023-10-14T09:02:22.270 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-14T09:02:22.270 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/ 2023-10-14T09:02:22.271 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-14T09:02:22.271 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-adp5520.ko 2023-10-14T09:02:22.271 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 59753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-bd2802.ko 2023-10-14T09:02:22.271 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-14T09:02:22.271 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da903x.ko 2023-10-14T09:02:22.272 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da9052.ko 2023-10-14T09:02:22.272 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-gpio.ko 2023-10-14T09:02:22.272 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-14T09:02:22.272 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3533.ko 2023-10-14T09:02:22.272 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm355x.ko 2023-10-14T09:02:22.272 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3642.ko 2023-10-14T09:02:22.273 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-14T09:02:22.273 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp8788.ko 2023-10-14T09:02:22.273 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-max8997.ko 2023-10-14T09:02:22.273 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-mc13783.ko 2023-10-14T09:02:22.273 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-14T09:02:22.274 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca9532.ko 2023-10-14T09:02:22.274 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca955x.ko 2023-10-14T09:02:22.274 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca963x.ko 2023-10-14T09:02:22.274 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-14T09:02:22.274 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-tca6507.ko 2023-10-14T09:02:22.275 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-14T09:02:22.275 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm8350.ko 2023-10-14T09:02:22.275 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ 2023-10-14T09:02:22.275 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-14T09:02:22.275 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-14T09:02:22.275 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-14T09:02:22.276 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-14T09:02:22.276 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-14T09:02:22.276 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-14T09:02:22.276 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-14T09:02:22.276 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-14T09:02:22.277 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/ 2023-10-14T09:02:22.277 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/ 2023-10-14T09:02:22.277 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 654969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-14T09:02:22.277 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-14T09:02:22.277 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 89601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bufio.ko 2023-10-14T09:02:22.277 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-14T09:02:22.278 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 156009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-14T09:02:22.278 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 106897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-14T09:02:22.278 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-14T09:02:22.278 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 53857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-era.ko 2023-10-14T09:02:22.278 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-14T09:02:22.279 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-14T09:02:22.279 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log.ko 2023-10-14T09:02:22.279 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-mirror.ko 2023-10-14T09:02:22.279 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 78033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-14T09:02:22.279 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-14T09:02:22.280 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 70825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-14T09:02:22.280 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-region-hash.ko 2023-10-14T09:02:22.280 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-14T09:02:22.280 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-14T09:02:22.280 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-snapshot.ko 2023-10-14T09:02:22.281 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-14T09:02:22.281 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 181865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-14T09:02:22.281 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-14T09:02:22.281 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-zero.ko 2023-10-14T09:02:22.281 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-14T09:02:22.282 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-14T09:02:22.282 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-14T09:02:22.282 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/ 2023-10-14T09:02:22.282 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 199937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-14T09:02:22.282 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-14T09:02:22.283 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 113073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-14T09:02:22.283 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 158681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-14T09:02:22.283 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 395721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-14T09:02:22.283 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/ 2023-10-14T09:02:22.283 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/ 2023-10-14T09:02:22.284 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 178137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-14T09:02:22.284 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 63385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-14T09:02:22.284 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-14T09:02:22.284 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-14T09:02:22.284 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 123321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-14T09:02:22.285 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 79041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-14T09:02:22.285 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 53081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-14T09:02:22.285 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ 2023-10-14T09:02:22.285 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm800.ko 2023-10-14T09:02:22.285 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm805.ko 2023-10-14T09:02:22.286 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm80x.ko 2023-10-14T09:02:22.286 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-14T09:02:22.286 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 123721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona.ko 2023-10-14T09:02:22.286 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/bcm590xx.ko 2023-10-14T09:02:22.286 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-14T09:02:22.287 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/dln2.ko 2023-10-14T09:02:22.287 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-14T09:02:22.287 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 53585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/kempld-core.ko 2023-10-14T09:02:22.287 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-core.ko 2023-10-14T09:02:22.287 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-14T09:02:22.288 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lp3943.ko 2023-10-14T09:02:22.288 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 54569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-14T09:02:22.288 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-14T09:02:22.288 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/max8907.ko 2023-10-14T09:02:22.288 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-14T09:02:22.289 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-14T09:02:22.289 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/menf21bmc.ko 2023-10-14T09:02:22.289 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-14T09:02:22.289 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-14T09:02:22.289 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633.ko 2023-10-14T09:02:22.289 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-14T09:02:22.290 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/retu-mfd.ko 2023-10-14T09:02:22.290 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 80425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/si476x-core.ko 2023-10-14T09:02:22.290 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 48457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-14T09:02:22.290 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-14T09:02:22.291 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps65010.ko 2023-10-14T09:02:22.291 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps6507x.ko 2023-10-14T09:02:22.291 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-14T09:02:22.291 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-14T09:02:22.291 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-14T09:02:22.291 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wm8994.ko 2023-10-14T09:02:22.292 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ 2023-10-14T09:02:22.292 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-14T09:02:22.292 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 48489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-14T09:02:22.292 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/ 2023-10-14T09:02:22.292 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 46585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-14T09:02:22.293 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-14T09:02:22.293 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-14T09:02:22.293 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 45593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-14T09:02:22.293 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/ 2023-10-14T09:02:22.293 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-14T09:02:22.293 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/core.ko 2023-10-14T09:02:22.294 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/ 2023-10-14T09:02:22.294 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-14T09:02:22.294 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ds1682.ko 2023-10-14T09:02:22.294 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/dummy-irq.ko 2023-10-14T09:02:22.294 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/ 2023-10-14T09:02:22.295 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/echo.ko 2023-10-14T09:02:22.295 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/ 2023-10-14T09:02:22.295 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-14T09:02:22.295 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-14T09:02:22.295 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-14T09:02:22.296 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-14T09:02:22.296 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-14T09:02:22.296 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/ 2023-10-14T09:02:22.296 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 152201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-14T09:02:22.296 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hmc6352.ko 2023-10-14T09:02:22.297 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-14T09:02:22.297 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ 2023-10-14T09:02:22.297 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 72129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-14T09:02:22.297 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ics932s401.ko 2023-10-14T09:02:22.297 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-14T09:02:22.297 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-14T09:02:22.298 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/ 2023-10-14T09:02:22.298 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-14T09:02:22.298 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-14T09:02:22.298 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/ 2023-10-14T09:02:22.298 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 125209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-14T09:02:22.299 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 56521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-14T09:02:22.299 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 310113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-14T09:02:22.299 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/phantom.ko 2023-10-14T09:02:22.299 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/ 2023-10-14T09:02:22.299 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 74265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-14T09:02:22.300 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-14T09:02:22.300 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-14T09:02:22.300 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-14T09:02:22.300 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 48697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-14T09:02:22.300 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/ 2023-10-14T09:02:22.301 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 183609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-14T09:02:22.301 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ 2023-10-14T09:02:22.301 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/ 2023-10-14T09:02:22.301 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 490129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-14T09:02:22.301 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/ 2023-10-14T09:02:22.302 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/ 2023-10-14T09:02:22.302 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 106033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-14T09:02:22.302 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-14T09:02:22.302 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-14T09:02:22.302 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-14T09:02:22.303 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 453737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-14T09:02:22.303 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-14T09:02:22.303 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-14T09:02:22.303 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ 2023-10-14T09:02:22.303 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/ 2023-10-14T09:02:22.303 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 45785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-14T09:02:22.304 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-14T09:02:22.304 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 130553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-14T09:02:22.304 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 68849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-14T09:02:22.304 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ 2023-10-14T09:02:22.304 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-14T09:02:22.305 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 59689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-14T09:02:22.305 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-14T09:02:22.305 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 99113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-14T09:02:22.305 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/ 2023-10-14T09:02:22.305 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 54521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-14T09:02:22.306 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/ 2023-10-14T09:02:22.306 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 69201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-14T09:02:22.306 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/ 2023-10-14T09:02:22.306 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 59585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-14T09:02:22.306 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/ 2023-10-14T09:02:22.307 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-14T09:02:22.307 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/ 2023-10-14T09:02:22.307 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 54609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-14T09:02:22.307 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-14T09:02:22.307 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 87297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-14T09:02:22.308 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/ 2023-10-14T09:02:22.308 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-14T09:02:22.308 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 97337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-14T09:02:22.308 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-14T09:02:22.308 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 104673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-14T09:02:22.308 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-14T09:02:22.309 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 90257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-14T09:02:22.309 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-14T09:02:22.309 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 81569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-14T09:02:22.309 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 69729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-14T09:02:22.309 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/ 2023-10-14T09:02:22.310 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 78401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-14T09:02:22.310 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 176761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-14T09:02:22.310 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-14T09:02:22.310 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1421497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-14T09:02:22.310 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 128569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-14T09:02:22.311 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-14T09:02:22.311 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 132089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-14T09:02:22.311 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 312081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-14T09:02:22.311 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/ 2023-10-14T09:02:22.311 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-14T09:02:22.311 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 323513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-14T09:02:22.312 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/ 2023-10-14T09:02:22.312 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-14T09:02:22.312 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 193497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-14T09:02:22.312 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-14T09:02:22.312 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 347417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-14T09:02:22.313 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-14T09:02:22.313 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1044433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-14T09:02:22.313 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-14T09:02:22.313 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 166193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-14T09:02:22.313 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-14T09:02:22.314 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-14T09:02:22.314 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/ 2023-10-14T09:02:22.314 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-14T09:02:22.314 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 204345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-14T09:02:22.314 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/ 2023-10-14T09:02:22.315 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-14T09:02:22.315 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 69449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-14T09:02:22.315 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-14T09:02:22.315 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 141225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-14T09:02:22.315 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-14T09:02:22.315 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-14T09:02:22.316 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-14T09:02:22.316 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/ 2023-10-14T09:02:22.316 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 60873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-14T09:02:22.316 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 62833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-14T09:02:22.316 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 45721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-14T09:02:22.317 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-14T09:02:22.317 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/ 2023-10-14T09:02:22.317 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-14T09:02:22.317 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 281137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-14T09:02:22.317 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-14T09:02:22.318 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-14T09:02:22.318 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-14T09:02:22.318 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 45345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-14T09:02:22.318 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ 2023-10-14T09:02:22.318 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 90465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-14T09:02:22.319 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-14T09:02:22.319 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 295577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-14T09:02:22.319 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-14T09:02:22.319 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 584497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-14T09:02:22.319 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-14T09:02:22.319 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 246209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-14T09:02:22.320 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-14T09:02:22.320 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 925697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-14T09:02:22.320 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-14T09:02:22.320 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 302849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-14T09:02:22.320 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-14T09:02:22.321 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 514681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-14T09:02:22.321 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-14T09:02:22.321 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 93593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-14T09:02:22.321 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-14T09:02:22.321 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 734305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-14T09:02:22.321 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-14T09:02:22.322 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 151769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-14T09:02:22.322 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 86921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-14T09:02:22.322 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/ 2023-10-14T09:02:22.322 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-14T09:02:22.322 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 102289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-14T09:02:22.323 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 122649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-14T09:02:22.323 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/ 2023-10-14T09:02:22.323 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-14T09:02:22.323 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 727601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-14T09:02:22.323 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 278937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-14T09:02:22.324 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-14T09:02:22.324 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-14T09:02:22.324 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1113993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-14T09:02:22.324 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ 2023-10-14T09:02:22.324 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 53105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-14T09:02:22.324 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-14T09:02:22.325 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-14T09:02:22.325 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 95665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-14T09:02:22.325 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/ 2023-10-14T09:02:22.325 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-14T09:02:22.325 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 108649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-14T09:02:22.326 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ 2023-10-14T09:02:22.326 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 73441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-14T09:02:22.326 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-14T09:02:22.326 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/ 2023-10-14T09:02:22.327 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 150905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-14T09:02:22.327 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/ 2023-10-14T09:02:22.327 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 136721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-14T09:02:22.327 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/ 2023-10-14T09:02:22.327 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-14T09:02:22.327 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 43145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-14T09:02:22.328 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/ 2023-10-14T09:02:22.328 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-14T09:02:22.328 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 227897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-14T09:02:22.328 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 87081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-14T09:02:22.328 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-14T09:02:22.329 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 672049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-14T09:02:22.329 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/ 2023-10-14T09:02:22.329 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 43017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-14T09:02:22.329 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/ 2023-10-14T09:02:22.329 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 67385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-14T09:02:22.329 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 83985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-14T09:02:22.330 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-14T09:02:22.330 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 189801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-14T09:02:22.330 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/ 2023-10-14T09:02:22.330 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-14T09:02:22.330 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 104241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-14T09:02:22.331 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/ 2023-10-14T09:02:22.331 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1053921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-14T09:02:22.331 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/ 2023-10-14T09:02:22.331 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-14T09:02:22.331 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/ 2023-10-14T09:02:22.332 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 54817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-14T09:02:22.332 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 63337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-14T09:02:22.332 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/ 2023-10-14T09:02:22.332 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 61601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-14T09:02:22.332 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 67193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-14T09:02:22.333 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 73409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-14T09:02:22.333 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 68177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-14T09:02:22.333 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/ 2023-10-14T09:02:22.333 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-14T09:02:22.333 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-14T09:02:22.333 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-14T09:02:22.334 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-14T09:02:22.334 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 486961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-14T09:02:22.334 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/ 2023-10-14T09:02:22.334 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 103337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-14T09:02:22.335 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 166161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-14T09:02:22.335 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 66329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-14T09:02:22.335 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 78801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-14T09:02:22.335 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/ 2023-10-14T09:02:22.335 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-14T09:02:22.336 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/ 2023-10-14T09:02:22.336 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 86529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-14T09:02:22.336 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/ 2023-10-14T09:02:22.336 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 80273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-14T09:02:22.336 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 83633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-14T09:02:22.336 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/ 2023-10-14T09:02:22.337 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 46241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-14T09:02:22.337 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-14T09:02:22.337 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/ 2023-10-14T09:02:22.337 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 60057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-14T09:02:22.337 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/ 2023-10-14T09:02:22.338 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/defxx.ko 2023-10-14T09:02:22.338 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/ 2023-10-14T09:02:22.338 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 216985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-14T09:02:22.338 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 77345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-14T09:02:22.338 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/ 2023-10-14T09:02:22.339 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 235521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-14T09:02:22.339 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/ 2023-10-14T09:02:22.339 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-14T09:02:22.339 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-14T09:02:22.339 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ 2023-10-14T09:02:22.340 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 83769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-14T09:02:22.340 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 62209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-14T09:02:22.340 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-14T09:02:22.340 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/ 2023-10-14T09:02:22.340 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-14T09:02:22.341 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-14T09:02:22.341 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-14T09:02:22.341 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-14T09:02:22.341 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-14T09:02:22.341 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-14T09:02:22.341 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 43953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-14T09:02:22.342 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-14T09:02:22.342 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/ 2023-10-14T09:02:22.342 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-14T09:02:22.342 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-14T09:02:22.342 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ 2023-10-14T09:02:22.343 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-14T09:02:22.343 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-14T09:02:22.343 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-14T09:02:22.343 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-14T09:02:22.343 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-14T09:02:22.344 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-14T09:02:22.344 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-14T09:02:22.344 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-14T09:02:22.344 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-14T09:02:22.344 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-14T09:02:22.345 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 82049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-14T09:02:22.345 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 76177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-14T09:02:22.345 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-14T09:02:22.345 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 97857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-14T09:02:22.345 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-14T09:02:22.346 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-14T09:02:22.346 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-14T09:02:22.346 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-14T09:02:22.346 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-14T09:02:22.346 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/ 2023-10-14T09:02:22.347 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 43569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/plip.ko 2023-10-14T09:02:22.347 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ 2023-10-14T09:02:22.347 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-14T09:02:22.347 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-14T09:02:22.347 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-14T09:02:22.348 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-14T09:02:22.348 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-14T09:02:22.348 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-14T09:02:22.348 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-14T09:02:22.348 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-14T09:02:22.348 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sb1000.ko 2023-10-14T09:02:22.349 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/ 2023-10-14T09:02:22.349 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-14T09:02:22.349 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-14T09:02:22.349 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 64385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-14T09:02:22.349 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/ 2023-10-14T09:02:22.350 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 106169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-14T09:02:22.350 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-14T09:02:22.350 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-14T09:02:22.350 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-14T09:02:22.350 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-14T09:02:22.351 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-14T09:02:22.351 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 87017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-14T09:02:22.351 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/ 2023-10-14T09:02:22.351 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 144297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-14T09:02:22.351 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/ 2023-10-14T09:02:22.352 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 297329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-14T09:02:22.352 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/ 2023-10-14T09:02:22.352 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 144649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-14T09:02:22.352 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ 2023-10-14T09:02:22.352 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-14T09:02:22.353 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/ 2023-10-14T09:02:22.353 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/ 2023-10-14T09:02:22.353 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 264937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-14T09:02:22.353 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 102209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-14T09:02:22.353 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/ 2023-10-14T09:02:22.354 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 133841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-14T09:02:22.354 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-14T09:02:22.354 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 84465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-14T09:02:22.354 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-14T09:02:22.354 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/ 2023-10-14T09:02:22.354 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/ 2023-10-14T09:02:22.355 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-14T09:02:22.355 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-14T09:02:22.355 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-14T09:02:22.355 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pci-stub.ko 2023-10-14T09:02:22.355 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 46529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-14T09:02:22.356 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/ 2023-10-14T09:02:22.356 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-14T09:02:22.356 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 145809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-14T09:02:22.356 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 62137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-14T09:02:22.356 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-14T09:02:22.356 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-14T09:02:22.357 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 112889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-14T09:02:22.357 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/ 2023-10-14T09:02:22.357 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/ 2023-10-14T09:02:22.357 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-14T09:02:22.357 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/ 2023-10-14T09:02:22.358 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-14T09:02:22.358 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/ 2023-10-14T09:02:22.358 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/ 2023-10-14T09:02:22.358 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 70153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-14T09:02:22.358 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/ 2023-10-14T09:02:22.359 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/ 2023-10-14T09:02:22.359 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-14T09:02:22.359 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-14T09:02:22.359 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-14T09:02:22.359 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-14T09:02:22.359 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-14T09:02:22.360 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-14T09:02:22.360 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-14T09:02:22.360 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ 2023-10-14T09:02:22.360 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 67097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-14T09:02:22.360 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-14T09:02:22.361 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-14T09:02:22.361 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 59665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-14T09:02:22.361 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-14T09:02:22.361 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 127569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-14T09:02:22.361 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-14T09:02:22.362 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-14T09:02:22.362 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-14T09:02:22.362 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-14T09:02:22.362 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-14T09:02:22.362 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-14T09:02:22.363 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-14T09:02:22.363 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/ 2023-10-14T09:02:22.363 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-14T09:02:22.363 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-14T09:02:22.363 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 43497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-14T09:02:22.364 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-14T09:02:22.364 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-14T09:02:22.364 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-14T09:02:22.364 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-14T09:02:22.364 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-14T09:02:22.365 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-14T09:02:22.365 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-14T09:02:22.365 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-14T09:02:22.365 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-14T09:02:22.365 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 57569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-14T09:02:22.365 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/ 2023-10-14T09:02:22.366 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ 2023-10-14T09:02:22.366 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-14T09:02:22.366 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-14T09:02:22.366 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 55057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-14T09:02:22.366 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 54081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-14T09:02:22.367 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-14T09:02:22.367 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-14T09:02:22.367 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-14T09:02:22.367 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-14T09:02:22.367 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-14T09:02:22.368 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-14T09:02:22.368 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-14T09:02:22.368 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-14T09:02:22.368 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-14T09:02:22.368 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-14T09:02:22.369 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-14T09:02:22.369 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-14T09:02:22.369 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-14T09:02:22.369 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-14T09:02:22.369 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-14T09:02:22.370 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8925_power.ko 2023-10-14T09:02:22.370 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-14T09:02:22.370 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-14T09:02:22.370 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/test_power.ko 2023-10-14T09:02:22.370 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-14T09:02:22.371 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-14T09:02:22.371 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-14T09:02:22.371 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-14T09:02:22.371 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/ 2023-10-14T09:02:22.371 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-14T09:02:22.372 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-14T09:02:22.372 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/ 2023-10-14T09:02:22.372 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/ 2023-10-14T09:02:22.372 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-14T09:02:22.372 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-14T09:02:22.373 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-14T09:02:22.373 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-14T09:02:22.373 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ 2023-10-14T09:02:22.373 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 66385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-14T09:02:22.373 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-14T09:02:22.374 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/ 2023-10-14T09:02:22.374 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-14T09:02:22.374 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-14T09:02:22.374 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-14T09:02:22.374 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-14T09:02:22.375 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-14T09:02:22.375 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-14T09:02:22.375 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-14T09:02:22.375 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 68577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-14T09:02:22.375 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-14T09:02:22.375 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-14T09:02:22.376 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-14T09:02:22.376 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-14T09:02:22.376 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-14T09:02:22.376 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-14T09:02:22.376 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-14T09:02:22.376 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-14T09:02:22.377 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-14T09:02:22.377 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-14T09:02:22.377 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-14T09:02:22.377 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-14T09:02:22.377 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-14T09:02:22.378 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-14T09:02:22.378 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-14T09:02:22.378 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-14T09:02:22.378 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-14T09:02:22.378 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-14T09:02:22.379 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-14T09:02:22.379 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-14T09:02:22.379 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-14T09:02:22.379 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-14T09:02:22.379 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-14T09:02:22.379 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-14T09:02:22.380 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 46633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-14T09:02:22.380 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-14T09:02:22.380 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-14T09:02:22.380 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-14T09:02:22.381 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-14T09:02:22.381 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-14T09:02:22.381 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-14T09:02:22.381 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-14T09:02:22.381 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-14T09:02:22.381 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-14T09:02:22.382 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-14T09:02:22.382 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-14T09:02:22.382 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-14T09:02:22.382 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-14T09:02:22.383 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-14T09:02:22.383 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-14T09:02:22.383 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-14T09:02:22.383 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-14T09:02:22.383 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-14T09:02:22.383 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ 2023-10-14T09:02:22.384 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 77617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-14T09:02:22.384 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 57665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-14T09:02:22.384 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 55169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-14T09:02:22.384 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 135185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-14T09:02:22.384 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-14T09:02:22.385 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/ 2023-10-14T09:02:22.385 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 272305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-14T09:02:22.385 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 100617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-14T09:02:22.385 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/ 2023-10-14T09:02:22.385 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 356265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-14T09:02:22.386 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 295801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-14T09:02:22.386 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/ 2023-10-14T09:02:22.386 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 189185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-14T09:02:22.386 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-14T09:02:22.386 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/ 2023-10-14T09:02:22.387 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 106881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-14T09:02:22.387 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-14T09:02:22.387 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/ 2023-10-14T09:02:22.387 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 246985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-14T09:02:22.387 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/ 2023-10-14T09:02:22.388 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1171945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-14T09:02:22.388 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/ 2023-10-14T09:02:22.388 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 237273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-14T09:02:22.388 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/ 2023-10-14T09:02:22.388 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 115369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-14T09:02:22.389 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-14T09:02:22.389 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/ 2023-10-14T09:02:22.389 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 308921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-14T09:02:22.389 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/ 2023-10-14T09:02:22.389 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-14T09:02:22.390 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 76145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-14T09:02:22.390 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-14T09:02:22.390 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 101449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-14T09:02:22.390 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 146689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-14T09:02:22.391 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 75553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-14T09:02:22.391 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-14T09:02:22.391 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/ 2023-10-14T09:02:22.391 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 212425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-14T09:02:22.391 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 60505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-14T09:02:22.391 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/ 2023-10-14T09:02:22.392 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 78209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-14T09:02:22.392 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 158505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-14T09:02:22.392 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fdomain.ko 2023-10-14T09:02:22.392 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/ 2023-10-14T09:02:22.392 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 263489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-14T09:02:22.393 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 201817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-14T09:02:22.393 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-14T09:02:22.393 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-14T09:02:22.393 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/imm.ko 2023-10-14T09:02:22.393 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-14T09:02:22.394 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 266537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-14T09:02:22.394 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 101881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-14T09:02:22.394 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/ 2023-10-14T09:02:22.394 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 317153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-14T09:02:22.394 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-14T09:02:22.395 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 52961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-14T09:02:22.395 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/ 2023-10-14T09:02:22.395 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 314865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-14T09:02:22.395 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 145585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-14T09:02:22.395 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 53521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-14T09:02:22.395 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/ 2023-10-14T09:02:22.396 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 216665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-14T09:02:22.396 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/ 2023-10-14T09:02:22.396 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 2197249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-14T09:02:22.396 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/ 2023-10-14T09:02:22.396 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 73569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-14T09:02:22.397 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-14T09:02:22.397 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 310617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-14T09:02:22.397 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 84721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-14T09:02:22.397 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/ 2023-10-14T09:02:22.397 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 659777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-14T09:02:22.398 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/ 2023-10-14T09:02:22.398 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 119561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-14T09:02:22.398 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 78129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-14T09:02:22.398 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/ 2023-10-14T09:02:22.398 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 81625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-14T09:02:22.399 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-14T09:02:22.399 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-14T09:02:22.399 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-14T09:02:22.399 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/ 2023-10-14T09:02:22.399 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 364105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-14T09:02:22.400 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 123617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-14T09:02:22.400 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ppa.ko 2023-10-14T09:02:22.400 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 55361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-14T09:02:22.400 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/ 2023-10-14T09:02:22.400 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1876625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-14T09:02:22.401 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 85289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-14T09:02:22.401 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/ 2023-10-14T09:02:22.401 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 559033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-14T09:02:22.401 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-14T09:02:22.401 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-14T09:02:22.402 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 238825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-14T09:02:22.402 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 173937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-14T09:02:22.402 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 279313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-14T09:02:22.402 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 97729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-14T09:02:22.402 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 73881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-14T09:02:22.402 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-14T09:02:22.403 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-14T09:02:22.403 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 115889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-14T09:02:22.403 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 46825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-14T09:02:22.403 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-14T09:02:22.403 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 162121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-14T09:02:22.404 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-14T09:02:22.404 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-14T09:02:22.404 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-14T09:02:22.404 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-14T09:02:22.404 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ 2023-10-14T09:02:22.405 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 129441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-14T09:02:22.405 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/ 2023-10-14T09:02:22.405 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/ 2023-10-14T09:02:22.405 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 736601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-14T09:02:22.405 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/ 2023-10-14T09:02:22.406 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-14T09:02:22.406 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-14T09:02:22.406 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 43025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-14T09:02:22.406 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 930321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-14T09:02:22.406 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-14T09:02:22.407 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 122521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-14T09:02:22.407 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/ 2023-10-14T09:02:22.407 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 75593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-14T09:02:22.407 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/ 2023-10-14T09:02:22.407 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/ 2023-10-14T09:02:22.407 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-14T09:02:22.408 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-14T09:02:22.408 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-14T09:02:22.408 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-14T09:02:22.408 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-14T09:02:22.408 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-14T09:02:22.409 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-14T09:02:22.409 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-14T09:02:22.409 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-14T09:02:22.409 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-14T09:02:22.409 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-14T09:02:22.410 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-14T09:02:22.410 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-14T09:02:22.410 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-14T09:02:22.410 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-14T09:02:22.410 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-14T09:02:22.411 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-14T09:02:22.411 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ 2023-10-14T09:02:22.411 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ 2023-10-14T09:02:22.411 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 78425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-14T09:02:22.411 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 57865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/moxa.ko 2023-10-14T09:02:22.412 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 50953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/mxser.ko 2023-10-14T09:02:22.412 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 108601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-14T09:02:22.412 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-14T09:02:22.412 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-14T09:02:22.412 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/ 2023-10-14T09:02:22.413 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/ 2023-10-14T09:02:22.413 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-14T09:02:22.413 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 59497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-14T09:02:22.413 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-14T09:02:22.413 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-14T09:02:22.414 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-14T09:02:22.414 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 72425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-14T09:02:22.414 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/ 2023-10-14T09:02:22.414 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 103073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-14T09:02:22.414 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/rp2.ko 2023-10-14T09:02:22.415 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 52817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-14T09:02:22.415 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/ 2023-10-14T09:02:22.415 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ 2023-10-14T09:02:22.415 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 531265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-14T09:02:22.415 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ 2023-10-14T09:02:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-14T09:02:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-14T09:02:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/ 2023-10-14T09:02:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-14T09:02:22.416 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-14T09:02:22.417 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-14T09:02:22.417 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-14T09:02:22.417 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_mf624.ko 2023-10-14T09:02:22.417 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_netx.ko 2023-10-14T09:02:22.417 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-14T09:02:22.417 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-14T09:02:22.418 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-14T09:02:22.418 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/ 2023-10-14T09:02:22.418 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/ 2023-10-14T09:02:22.418 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 73297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-14T09:02:22.418 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ 2023-10-14T09:02:22.419 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 144377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-14T09:02:22.419 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-14T09:02:22.419 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-14T09:02:22.419 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-14T09:02:22.419 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/ 2023-10-14T09:02:22.420 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 87089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-14T09:02:22.420 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-14T09:02:22.420 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-14T09:02:22.420 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 89857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-14T09:02:22.420 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ 2023-10-14T09:02:22.420 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ulpi.ko 2023-10-14T09:02:22.421 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/ 2023-10-14T09:02:22.421 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-14T09:02:22.421 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/ 2023-10-14T09:02:22.421 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-14T09:02:22.421 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-14T09:02:22.422 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 444553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-14T09:02:22.422 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/ 2023-10-14T09:02:22.422 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/ 2023-10-14T09:02:22.422 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 60177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-14T09:02:22.422 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-14T09:02:22.423 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-14T09:02:22.423 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-14T09:02:22.423 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-14T09:02:22.423 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-14T09:02:22.423 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 92489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-14T09:02:22.424 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-14T09:02:22.424 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 122081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-14T09:02:22.424 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 57617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-14T09:02:22.424 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-14T09:02:22.424 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-14T09:02:22.425 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-14T09:02:22.425 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 85609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-14T09:02:22.425 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-14T09:02:22.425 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 58113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-14T09:02:22.425 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 67337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-14T09:02:22.426 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/ 2023-10-14T09:02:22.426 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-14T09:02:22.426 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-14T09:02:22.426 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-14T09:02:22.426 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-14T09:02:22.427 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-14T09:02:22.427 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-14T09:02:22.427 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-14T09:02:22.427 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-14T09:02:22.427 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-14T09:02:22.427 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-14T09:02:22.428 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-14T09:02:22.428 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-14T09:02:22.428 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 62185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-14T09:02:22.428 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-14T09:02:22.428 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 161225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-14T09:02:22.429 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/ 2023-10-14T09:02:22.429 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-14T09:02:22.429 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-14T09:02:22.429 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 157681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-14T09:02:22.429 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-14T09:02:22.430 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 52721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-14T09:02:22.430 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 69705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-14T09:02:22.430 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 56033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-14T09:02:22.430 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 76057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-14T09:02:22.430 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 75073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-14T09:02:22.431 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 73169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-14T09:02:22.431 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 65809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-14T09:02:22.431 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 66097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-14T09:02:22.431 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 81505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-14T09:02:22.431 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 156073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-14T09:02:22.432 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ 2023-10-14T09:02:22.432 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-14T09:02:22.432 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 80113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-14T09:02:22.432 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 87353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-14T09:02:22.432 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-14T09:02:22.433 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-14T09:02:22.433 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-14T09:02:22.433 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-14T09:02:22.433 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-14T09:02:22.433 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/ 2023-10-14T09:02:22.434 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-14T09:02:22.434 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-14T09:02:22.434 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ 2023-10-14T09:02:22.434 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-14T09:02:22.434 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-14T09:02:22.435 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-14T09:02:22.435 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cytherm.ko 2023-10-14T09:02:22.435 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ehset.ko 2023-10-14T09:02:22.435 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-14T09:02:22.435 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-14T09:02:22.436 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-14T09:02:22.436 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-14T09:02:22.436 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-14T09:02:22.436 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-14T09:02:22.436 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-14T09:02:22.437 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-14T09:02:22.437 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/lvstest.ko 2023-10-14T09:02:22.437 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-14T09:02:22.437 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 64841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-14T09:02:22.437 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-14T09:02:22.437 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-14T09:02:22.438 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-14T09:02:22.438 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-14T09:02:22.438 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 70873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbtest.ko 2023-10-14T09:02:22.438 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-14T09:02:22.438 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-14T09:02:22.439 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/ 2023-10-14T09:02:22.439 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 72953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/usbmon.ko 2023-10-14T09:02:22.439 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/ 2023-10-14T09:02:22.439 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 301545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-14T09:02:22.439 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/ 2023-10-14T09:02:22.440 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-14T09:02:22.440 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-14T09:02:22.440 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-14T09:02:22.440 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-14T09:02:22.440 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ 2023-10-14T09:02:22.441 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-14T09:02:22.441 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-14T09:02:22.441 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-14T09:02:22.441 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-14T09:02:22.441 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 70257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-14T09:02:22.441 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-14T09:02:22.442 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 58217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-14T09:02:22.442 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-14T09:02:22.442 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-14T09:02:22.442 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/f81232.ko 2023-10-14T09:02:22.442 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 175137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-14T09:02:22.443 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 53113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-14T09:02:22.443 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 137081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-14T09:02:22.443 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 124833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-14T09:02:22.443 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 67769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-14T09:02:22.443 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-14T09:02:22.444 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-14T09:02:22.444 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 58233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-14T09:02:22.444 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 107521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-14T09:02:22.444 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-14T09:02:22.444 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-14T09:02:22.445 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-14T09:02:22.445 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-14T09:02:22.445 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-14T09:02:22.445 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 66449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-14T09:02:22.445 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 78217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-14T09:02:22.446 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 56337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mxuport.ko 2023-10-14T09:02:22.446 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-14T09:02:22.446 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-14T09:02:22.446 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-14T09:02:22.446 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 190633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-14T09:02:22.447 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-14T09:02:22.447 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 54353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-14T09:02:22.447 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-14T09:02:22.447 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-14T09:02:22.447 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-14T09:02:22.447 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-14T09:02:22.448 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 51625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-14T09:02:22.448 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-14T09:02:22.448 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-14T09:02:22.448 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-14T09:02:22.448 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-14T09:02:22.449 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-14T09:02:22.449 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-14T09:02:22.449 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-14T09:02:22.449 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 125609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usbserial.ko 2023-10-14T09:02:22.449 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-14T09:02:22.449 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-14T09:02:22.450 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-14T09:02:22.450 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-14T09:02:22.450 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ 2023-10-14T09:02:22.450 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 52913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-14T09:02:22.450 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-14T09:02:22.451 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-14T09:02:22.451 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-14T09:02:22.451 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-14T09:02:22.451 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-14T09:02:22.451 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-14T09:02:22.452 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-14T09:02:22.452 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-14T09:02:22.452 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-14T09:02:22.452 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-14T09:02:22.452 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-14T09:02:22.452 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-14T09:02:22.453 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-14T09:02:22.453 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 179969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-14T09:02:22.453 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/ 2023-10-14T09:02:22.453 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 67481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-14T09:02:22.453 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 72177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-14T09:02:22.454 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 107001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-14T09:02:22.454 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/ 2023-10-14T09:02:22.454 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/ 2023-10-14T09:02:22.454 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 154297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-14T09:02:22.454 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-14T09:02:22.455 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 108737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-14T09:02:22.455 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 77609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-14T09:02:22.455 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/ 2023-10-14T09:02:22.455 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 113873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-14T09:02:22.455 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-14T09:02:22.456 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 58089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-14T09:02:22.456 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 89249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-14T09:02:22.456 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/ 2023-10-14T09:02:22.456 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/ 2023-10-14T09:02:22.456 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-14T09:02:22.456 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-14T09:02:22.457 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-14T09:02:22.457 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-14T09:02:22.457 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-14T09:02:22.457 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-14T09:02:22.457 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-14T09:02:22.458 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/bd6107.ko 2023-10-14T09:02:22.458 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-14T09:02:22.458 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-14T09:02:22.458 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-14T09:02:22.458 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-14T09:02:22.459 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-14T09:02:22.459 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-14T09:02:22.459 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-14T09:02:22.459 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-14T09:02:22.459 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-14T09:02:22.460 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-14T09:02:22.460 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-14T09:02:22.460 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-14T09:02:22.460 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-14T09:02:22.460 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/ 2023-10-14T09:02:22.461 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ 2023-10-14T09:02:22.461 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-14T09:02:22.461 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-14T09:02:22.461 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-14T09:02:22.461 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-14T09:02:22.461 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/ 2023-10-14T09:02:22.462 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-14T09:02:22.462 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-14T09:02:22.462 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-14T09:02:22.462 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-14T09:02:22.462 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-14T09:02:22.463 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-14T09:02:22.463 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-14T09:02:22.463 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-14T09:02:22.463 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-14T09:02:22.463 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-14T09:02:22.464 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 56425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-14T09:02:22.464 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 102673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-14T09:02:22.464 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ 2023-10-14T09:02:22.464 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-14T09:02:22.464 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-14T09:02:22.465 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-14T09:02:22.465 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-14T09:02:22.465 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-14T09:02:22.465 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-14T09:02:22.465 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-14T09:02:22.466 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-14T09:02:22.466 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-14T09:02:22.466 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-14T09:02:22.466 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-14T09:02:22.466 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-14T09:02:22.467 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-14T09:02:22.467 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-14T09:02:22.467 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-14T09:02:22.467 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-14T09:02:22.467 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-14T09:02:22.467 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-14T09:02:22.468 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-14T09:02:22.468 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-14T09:02:22.468 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-14T09:02:22.468 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-14T09:02:22.468 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-14T09:02:22.468 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-14T09:02:22.469 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-14T09:02:22.469 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-14T09:02:22.469 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22265 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-14T09:02:22.469 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-14T09:02:22.469 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-14T09:02:22.470 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-14T09:02:22.470 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-14T09:02:22.470 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-14T09:02:22.470 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-14T09:02:22.470 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-14T09:02:22.471 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-14T09:02:22.471 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-14T09:02:22.471 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-14T09:02:22.471 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-14T09:02:22.471 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-14T09:02:22.471 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-14T09:02:22.472 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-14T09:02:22.472 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-14T09:02:22.472 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-14T09:02:22.472 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-14T09:02:22.472 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-14T09:02:22.473 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-14T09:02:22.473 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-14T09:02:22.473 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-14T09:02:22.473 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/ 2023-10-14T09:02:22.473 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-14T09:02:22.474 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-14T09:02:22.474 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-14T09:02:22.474 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/ 2023-10-14T09:02:22.474 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 176441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-14T09:02:22.474 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-14T09:02:22.475 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 71249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-scsiback.ko 2023-10-14T09:02:22.475 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/ 2023-10-14T09:02:22.475 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-14T09:02:22.475 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ 2023-10-14T09:02:22.475 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/ 2023-10-14T09:02:22.476 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 166425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-14T09:02:22.476 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/ 2023-10-14T09:02:22.476 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 61073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/adfs.ko 2023-10-14T09:02:22.476 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/ 2023-10-14T09:02:22.476 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 163593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-14T09:02:22.476 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/ 2023-10-14T09:02:22.477 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 932817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/kafs.ko 2023-10-14T09:02:22.477 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/ 2023-10-14T09:02:22.477 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 101057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/autofs4.ko 2023-10-14T09:02:22.477 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/ 2023-10-14T09:02:22.477 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 64545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-14T09:02:22.478 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/ 2023-10-14T09:02:22.478 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/bfs.ko 2023-10-14T09:02:22.478 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-14T09:02:22.478 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/ 2023-10-14T09:02:22.478 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 3402585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-14T09:02:22.479 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/ 2023-10-14T09:02:22.479 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 306073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-14T09:02:22.479 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ 2023-10-14T09:02:22.479 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1323873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-14T09:02:22.479 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/ 2023-10-14T09:02:22.480 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 100801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-14T09:02:22.480 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/ 2023-10-14T09:02:22.480 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 108393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/configfs.ko 2023-10-14T09:02:22.480 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/ 2023-10-14T09:02:22.480 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 29625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-14T09:02:22.480 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/ 2023-10-14T09:02:22.481 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 642577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-14T09:02:22.481 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/ 2023-10-14T09:02:22.481 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/efs.ko 2023-10-14T09:02:22.481 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/ 2023-10-14T09:02:22.481 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1505025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-14T09:02:22.482 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/ 2023-10-14T09:02:22.482 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-14T09:02:22.482 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/ 2023-10-14T09:02:22.482 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/freevxfs.ko 2023-10-14T09:02:22.482 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/ 2023-10-14T09:02:22.483 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 226481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-14T09:02:22.483 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/ 2023-10-14T09:02:22.483 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-14T09:02:22.483 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/ 2023-10-14T09:02:22.483 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1231529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-14T09:02:22.484 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/ 2023-10-14T09:02:22.484 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 141209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-14T09:02:22.484 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/ 2023-10-14T09:02:22.484 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 222817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-14T09:02:22.484 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/ 2023-10-14T09:02:22.484 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 192329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/hpfs.ko 2023-10-14T09:02:22.485 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/ 2023-10-14T09:02:22.485 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 74065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-14T09:02:22.485 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/ 2023-10-14T09:02:22.485 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 419497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-14T09:02:22.485 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/ 2023-10-14T09:02:22.486 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 280313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-14T09:02:22.486 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/ 2023-10-14T09:02:22.486 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 89193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-14T09:02:22.486 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/ 2023-10-14T09:02:22.487 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 124649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-14T09:02:22.487 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/ 2023-10-14T09:02:22.487 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/ 2023-10-14T09:02:22.487 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 81449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-14T09:02:22.487 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/ 2023-10-14T09:02:22.487 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 59449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-14T09:02:22.488 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/ 2023-10-14T09:02:22.488 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 117513 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-14T09:02:22.488 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1055649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-14T09:02:22.488 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 66441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv2.ko 2023-10-14T09:02:22.488 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 120177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-14T09:02:22.489 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 2041689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-14T09:02:22.489 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/ 2023-10-14T09:02:22.489 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-14T09:02:22.489 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-14T09:02:22.489 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/ 2023-10-14T09:02:22.489 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1516809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-14T09:02:22.490 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/ 2023-10-14T09:02:22.490 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 592833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-14T09:02:22.490 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/ 2023-10-14T09:02:22.490 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-14T09:02:22.490 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-14T09:02:22.491 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-14T09:02:22.491 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-14T09:02:22.491 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-14T09:02:22.491 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-14T09:02:22.491 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-14T09:02:22.492 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-14T09:02:22.492 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-14T09:02:22.492 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-14T09:02:22.492 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-14T09:02:22.492 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ascii.ko 2023-10-14T09:02:22.493 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-14T09:02:22.493 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-14T09:02:22.493 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-14T09:02:22.493 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-14T09:02:22.493 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-14T09:02:22.494 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-14T09:02:22.494 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-14T09:02:22.494 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-14T09:02:22.494 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-14T09:02:22.494 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-14T09:02:22.495 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-14T09:02:22.495 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-14T09:02:22.495 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-14T09:02:22.495 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-14T09:02:22.495 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-14T09:02:22.495 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-14T09:02:22.496 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-14T09:02:22.496 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-14T09:02:22.496 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 94137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-14T09:02:22.496 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 142673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-14T09:02:22.496 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 165745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-14T09:02:22.497 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 118121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-14T09:02:22.497 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-14T09:02:22.497 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-14T09:02:22.497 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-14T09:02:22.497 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-14T09:02:22.497 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-14T09:02:22.498 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-14T09:02:22.498 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-14T09:02:22.498 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-14T09:02:22.498 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-14T09:02:22.498 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-14T09:02:22.499 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-14T09:02:22.499 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-14T09:02:22.499 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-14T09:02:22.499 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-14T09:02:22.499 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-14T09:02:22.500 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-14T09:02:22.500 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-14T09:02:22.500 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ 2023-10-14T09:02:22.500 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 219417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ntfs.ko 2023-10-14T09:02:22.500 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ 2023-10-14T09:02:22.501 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ 2023-10-14T09:02:22.501 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 244409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-14T09:02:22.501 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ 2023-10-14T09:02:22.501 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 440737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-14T09:02:22.501 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ 2023-10-14T09:02:22.501 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 54049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-14T09:02:22.502 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 2592433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-14T09:02:22.502 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-14T09:02:22.502 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-14T09:02:22.502 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-14T09:02:22.502 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/ 2023-10-14T09:02:22.503 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 53433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/omfs.ko 2023-10-14T09:02:22.503 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/ 2023-10-14T09:02:22.503 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 352153 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-14T09:02:22.503 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ 2023-10-14T09:02:22.503 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 54809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-14T09:02:22.504 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/ 2023-10-14T09:02:22.504 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/qnx4.ko 2023-10-14T09:02:22.504 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/ 2023-10-14T09:02:22.504 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 46689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/qnx6.ko 2023-10-14T09:02:22.504 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/ 2023-10-14T09:02:22.505 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_tree.ko 2023-10-14T09:02:22.505 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v1.ko 2023-10-14T09:02:22.505 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v2.ko 2023-10-14T09:02:22.505 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/ 2023-10-14T09:02:22.505 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 532673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-14T09:02:22.506 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/ 2023-10-14T09:02:22.506 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-14T09:02:22.506 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/ 2023-10-14T09:02:22.506 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/ 2023-10-14T09:02:22.506 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 2668121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-14T09:02:22.507 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/ 2023-10-14T09:02:22.507 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-14T09:02:22.507 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-14T09:02:22.507 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/ 2023-10-14T09:02:22.507 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 134641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-14T09:02:22.507 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/ 2023-10-14T09:02:22.508 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 90721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-14T09:02:22.508 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/ 2023-10-14T09:02:22.508 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 247737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-14T09:02:22.508 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ 2023-10-14T09:02:22.508 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 162497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-14T09:02:22.509 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/ 2023-10-14T09:02:22.509 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 4010729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-14T09:02:22.509 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/ 2023-10-14T09:02:22.509 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/ 2023-10-14T09:02:22.509 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 75489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/locktorture.ko 2023-10-14T09:02:22.510 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/ 2023-10-14T09:02:22.510 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/test_udelay.ko 2023-10-14T09:02:22.510 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 60553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-14T09:02:22.510 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ 2023-10-14T09:02:22.510 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 6833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-14T09:02:22.511 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 6529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc7.ko 2023-10-14T09:02:22.511 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-14T09:02:22.511 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/ 2023-10-14T09:02:22.511 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-14T09:02:22.511 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-14T09:02:22.511 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/interval_tree_test.ko 2023-10-14T09:02:22.512 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-14T09:02:22.512 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-14T09:02:22.512 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/ 2023-10-14T09:02:22.512 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-14T09:02:22.513 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-14T09:02:22.513 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/ 2023-10-14T09:02:22.513 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 6617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-14T09:02:22.513 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/memory-notifier-error-inject.ko 2023-10-14T09:02:22.513 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/notifier-error-inject.ko 2023-10-14T09:02:22.513 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/percpu_test.ko 2023-10-14T09:02:22.514 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/pm-notifier-error-inject.ko 2023-10-14T09:02:22.514 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/ 2023-10-14T09:02:22.514 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 143433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-14T09:02:22.514 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/rbtree_test.ko 2023-10-14T09:02:22.515 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/ 2023-10-14T09:02:22.515 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-14T09:02:22.515 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-kstrtox.ko 2023-10-14T09:02:22.515 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-string_helpers.ko 2023-10-14T09:02:22.515 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 4760425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_bpf.ko 2023-10-14T09:02:22.516 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_firmware.ko 2023-10-14T09:02:22.516 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 6369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_module.ko 2023-10-14T09:02:22.516 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_user_copy.ko 2023-10-14T09:02:22.516 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-14T09:02:22.516 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-14T09:02:22.516 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-14T09:02:22.517 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/ 2023-10-14T09:02:22.517 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/xz_dec_test.ko 2023-10-14T09:02:22.517 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/ 2023-10-14T09:02:22.517 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-14T09:02:22.517 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ 2023-10-14T09:02:22.518 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/ 2023-10-14T09:02:22.518 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 55737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-14T09:02:22.518 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-14T09:02:22.518 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-14T09:02:22.518 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-14T09:02:22.518 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 6985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-14T09:02:22.519 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-14T09:02:22.519 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-14T09:02:22.519 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-14T09:02:22.519 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/ 2023-10-14T09:02:22.519 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-14T09:02:22.520 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-14T09:02:22.520 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-14T09:02:22.520 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-14T09:02:22.520 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-14T09:02:22.520 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/ 2023-10-14T09:02:22.520 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 81737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-14T09:02:22.521 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/ 2023-10-14T09:02:22.521 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 198337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-14T09:02:22.521 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-14T09:02:22.521 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26345 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-14T09:02:22.521 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-14T09:02:22.521 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/ 2023-10-14T09:02:22.522 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 649297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-14T09:02:22.522 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/ 2023-10-14T09:02:22.522 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 63809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-14T09:02:22.522 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 777689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-14T09:02:22.522 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ 2023-10-14T09:02:22.523 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-14T09:02:22.523 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-14T09:02:22.523 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-14T09:02:22.523 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-14T09:02:22.523 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-14T09:02:22.524 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-14T09:02:22.524 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-14T09:02:22.524 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-14T09:02:22.524 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-14T09:02:22.524 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-14T09:02:22.524 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-14T09:02:22.525 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8385 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-14T09:02:22.525 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-14T09:02:22.525 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-14T09:02:22.525 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-14T09:02:22.525 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-14T09:02:22.526 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-14T09:02:22.526 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-14T09:02:22.526 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-14T09:02:22.526 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-14T09:02:22.526 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 55929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-14T09:02:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-14T09:02:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-14T09:02:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/ 2023-10-14T09:02:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1047017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-14T09:02:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/ 2023-10-14T09:02:22.527 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 125697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-14T09:02:22.528 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/ 2023-10-14T09:02:22.528 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 194209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-14T09:02:22.528 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-14T09:02:22.528 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 57881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-14T09:02:22.528 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 60337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-14T09:02:22.529 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/ 2023-10-14T09:02:22.529 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 390473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-14T09:02:22.529 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-14T09:02:22.529 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-14T09:02:22.529 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-14T09:02:22.530 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-14T09:02:22.530 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/ 2023-10-14T09:02:22.530 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 99729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/hsr.ko 2023-10-14T09:02:22.530 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ 2023-10-14T09:02:22.530 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ 2023-10-14T09:02:22.530 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 45233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-14T09:02:22.531 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 254625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-14T09:02:22.531 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-14T09:02:22.531 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ 2023-10-14T09:02:22.531 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-14T09:02:22.531 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-14T09:02:22.531 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 48401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-14T09:02:22.532 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-14T09:02:22.532 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 48657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-14T09:02:22.532 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 60633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-14T09:02:22.532 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 61225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-14T09:02:22.532 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-14T09:02:22.533 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-14T09:02:22.533 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-14T09:02:22.533 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ 2023-10-14T09:02:22.533 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-14T09:02:22.533 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-14T09:02:22.533 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-14T09:02:22.534 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-14T09:02:22.534 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-14T09:02:22.534 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-14T09:02:22.534 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-14T09:02:22.534 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-14T09:02:22.535 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-14T09:02:22.535 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-14T09:02:22.535 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-14T09:02:22.535 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-14T09:02:22.535 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-14T09:02:22.536 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-14T09:02:22.536 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-14T09:02:22.536 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-14T09:02:22.536 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-14T09:02:22.536 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18225 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-14T09:02:22.537 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-14T09:02:22.537 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-14T09:02:22.537 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-14T09:02:22.537 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-14T09:02:22.537 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-14T09:02:22.538 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-14T09:02:22.538 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-14T09:02:22.538 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-14T09:02:22.538 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-14T09:02:22.538 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-14T09:02:22.539 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-14T09:02:22.539 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-14T09:02:22.539 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-14T09:02:22.539 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-14T09:02:22.539 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-14T09:02:22.539 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-14T09:02:22.540 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-14T09:02:22.540 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-14T09:02:22.540 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-14T09:02:22.540 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-14T09:02:22.540 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-14T09:02:22.540 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-14T09:02:22.541 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 41665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-14T09:02:22.541 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-14T09:02:22.541 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ 2023-10-14T09:02:22.541 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-14T09:02:22.541 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-14T09:02:22.542 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-14T09:02:22.542 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 80897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_gre.ko 2023-10-14T09:02:22.542 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 93577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-14T09:02:22.542 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-14T09:02:22.542 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 53273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-14T09:02:22.543 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-14T09:02:22.543 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19017 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/mip6.ko 2023-10-14T09:02:22.543 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ 2023-10-14T09:02:22.543 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-14T09:02:22.543 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-14T09:02:22.543 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-14T09:02:22.544 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-14T09:02:22.544 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-14T09:02:22.544 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-14T09:02:22.544 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-14T09:02:22.544 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-14T09:02:22.545 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-14T09:02:22.545 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-14T09:02:22.545 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-14T09:02:22.545 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-14T09:02:22.545 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-14T09:02:22.546 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-14T09:02:22.546 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-14T09:02:22.546 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-14T09:02:22.546 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-14T09:02:22.546 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-14T09:02:22.547 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-14T09:02:22.547 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-14T09:02:22.547 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-14T09:02:22.547 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-14T09:02:22.547 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-14T09:02:22.548 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-14T09:02:22.548 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-14T09:02:22.548 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 74073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-14T09:02:22.548 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-14T09:02:22.548 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-14T09:02:22.549 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/ 2023-10-14T09:02:22.549 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 82833 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-14T09:02:22.549 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/ 2023-10-14T09:02:22.549 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 125281 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-14T09:02:22.549 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-14T09:02:22.549 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 25953 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-14T09:02:22.550 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-14T09:02:22.550 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36713 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-14T09:02:22.550 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-14T09:02:22.550 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 53241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-14T09:02:22.550 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/ 2023-10-14T09:02:22.551 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 47977 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/lapb.ko 2023-10-14T09:02:22.551 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/ 2023-10-14T09:02:22.551 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-14T09:02:22.551 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 267777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc2.ko 2023-10-14T09:02:22.551 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/ 2023-10-14T09:02:22.552 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 290417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-14T09:02:22.552 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/ 2023-10-14T09:02:22.552 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-14T09:02:22.552 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ 2023-10-14T09:02:22.552 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ 2023-10-14T09:02:22.552 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 119585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-14T09:02:22.553 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-14T09:02:22.553 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26913 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-14T09:02:22.553 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-14T09:02:22.553 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 100297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-14T09:02:22.553 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 101441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-14T09:02:22.554 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 102817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-14T09:02:22.554 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 103481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-14T09:02:22.554 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 112849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-14T09:02:22.554 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 60329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-14T09:02:22.555 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-14T09:02:22.555 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 113129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-14T09:02:22.555 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 112585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-14T09:02:22.555 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 111585 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-14T09:02:22.555 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 114465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-14T09:02:22.556 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-14T09:02:22.556 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ 2023-10-14T09:02:22.556 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 411729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-14T09:02:22.556 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-14T09:02:22.556 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-14T09:02:22.556 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-14T09:02:22.557 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-14T09:02:22.557 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-14T09:02:22.557 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-14T09:02:22.557 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-14T09:02:22.557 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10681 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-14T09:02:22.558 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-14T09:02:22.558 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-14T09:02:22.558 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-14T09:02:22.558 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-14T09:02:22.558 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10993 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-14T09:02:22.559 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-14T09:02:22.559 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 408257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-14T09:02:22.559 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-14T09:02:22.559 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-14T09:02:22.559 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33761 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-14T09:02:22.559 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 118145 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-14T09:02:22.560 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-14T09:02:22.560 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-14T09:02:22.560 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 107297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-14T09:02:22.560 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-14T09:02:22.560 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-14T09:02:22.561 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 66641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-14T09:02:22.561 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-14T09:02:22.561 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-14T09:02:22.561 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10113 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-14T09:02:22.561 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 89473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-14T09:02:22.562 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-14T09:02:22.562 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 37129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-14T09:02:22.562 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 95417 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-14T09:02:22.562 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-14T09:02:22.562 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-14T09:02:22.562 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-14T09:02:22.563 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28929 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-14T09:02:22.563 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-14T09:02:22.563 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 44065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-14T09:02:22.563 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 615313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-14T09:02:22.563 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 42561 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-14T09:02:22.564 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-14T09:02:22.564 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30569 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-14T09:02:22.564 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 39785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-14T09:02:22.564 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-14T09:02:22.564 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-14T09:02:22.565 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-14T09:02:22.565 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-14T09:02:22.565 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 40721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-14T09:02:22.565 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-14T09:02:22.565 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-14T09:02:22.566 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-14T09:02:22.566 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-14T09:02:22.566 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-14T09:02:22.566 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-14T09:02:22.566 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-14T09:02:22.567 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14329 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-14T09:02:22.567 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13673 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-14T09:02:22.567 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_osf.ko 2023-10-14T09:02:22.567 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-14T09:02:22.567 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-14T09:02:22.568 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-14T09:02:22.568 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-14T09:02:22.568 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-14T09:02:22.568 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20369 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_synproxy.ko 2023-10-14T09:02:22.568 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tproxy.ko 2023-10-14T09:02:22.568 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 89313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/x_tables.ko 2023-10-14T09:02:22.569 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-14T09:02:22.569 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-14T09:02:22.569 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-14T09:02:22.569 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-14T09:02:22.569 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 18169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-14T09:02:22.570 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-14T09:02:22.570 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-14T09:02:22.570 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-14T09:02:22.570 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-14T09:02:22.570 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-14T09:02:22.571 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-14T09:02:22.571 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-14T09:02:22.571 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-14T09:02:22.571 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-14T09:02:22.571 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-14T09:02:22.572 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-14T09:02:22.572 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-14T09:02:22.572 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-14T09:02:22.572 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-14T09:02:22.572 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-14T09:02:22.572 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-14T09:02:22.573 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-14T09:02:22.573 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-14T09:02:22.573 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-14T09:02:22.573 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-14T09:02:22.573 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-14T09:02:22.573 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11209 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-14T09:02:22.574 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-14T09:02:22.574 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10465 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-14T09:02:22.574 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-14T09:02:22.574 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-14T09:02:22.574 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-14T09:02:22.574 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-14T09:02:22.575 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-14T09:02:22.575 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-14T09:02:22.575 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-14T09:02:22.575 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8801 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-14T09:02:22.575 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-14T09:02:22.576 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-14T09:02:22.576 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 43289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-14T09:02:22.576 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-14T09:02:22.576 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-14T09:02:22.576 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-14T09:02:22.577 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-14T09:02:22.577 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11785 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-14T09:02:22.577 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-14T09:02:22.577 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8001 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-14T09:02:22.577 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-14T09:02:22.578 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7545 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-14T09:02:22.578 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-14T09:02:22.578 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11825 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-14T09:02:22.578 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-14T09:02:22.578 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-14T09:02:22.579 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-14T09:02:22.579 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-14T09:02:22.579 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-14T09:02:22.579 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-14T09:02:22.579 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-14T09:02:22.579 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-14T09:02:22.580 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-14T09:02:22.580 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-14T09:02:22.580 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-14T09:02:22.580 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-14T09:02:22.580 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-14T09:02:22.581 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 16089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-14T09:02:22.581 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-14T09:02:22.581 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-14T09:02:22.581 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-14T09:02:22.581 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 8553 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-14T09:02:22.581 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15777 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-14T09:02:22.582 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11129 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-14T09:02:22.582 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-14T09:02:22.582 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/ 2023-10-14T09:02:22.582 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13969 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-14T09:02:22.582 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/ 2023-10-14T09:02:22.583 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 12425 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-14T09:02:22.583 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/ 2023-10-14T09:02:22.583 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 380033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-14T09:02:22.583 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10321 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-14T09:02:22.583 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-14T09:02:22.584 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 11793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-14T09:02:22.584 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/ 2023-10-14T09:02:22.584 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-14T09:02:22.584 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/ 2023-10-14T09:02:22.584 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 110201 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/phonet.ko 2023-10-14T09:02:22.585 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 54697 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/pn_pep.ko 2023-10-14T09:02:22.585 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/ 2023-10-14T09:02:22.585 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 251481 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-14T09:02:22.585 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 164937 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-14T09:02:22.585 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 67377 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-14T09:02:22.586 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/ 2023-10-14T09:02:22.586 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 819657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/rxrpc.ko 2023-10-14T09:02:22.586 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/ 2023-10-14T09:02:22.586 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32241 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-14T09:02:22.586 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23577 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-14T09:02:22.587 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26873 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-14T09:02:22.587 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34097 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-14T09:02:22.587 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-14T09:02:22.587 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 43449 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-14T09:02:22.587 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-14T09:02:22.588 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-14T09:02:22.588 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35297 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-14T09:02:22.588 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-14T09:02:22.588 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26169 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-14T09:02:22.588 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33961 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-14T09:02:22.588 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19233 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_cgroup.ko 2023-10-14T09:02:22.589 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31401 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-14T09:02:22.589 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31769 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-14T09:02:22.589 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 38489 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-14T09:02:22.589 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 61409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-14T09:02:22.589 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7441 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-14T09:02:22.590 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 13409 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-14T09:02:22.590 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33289 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-14T09:02:22.590 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-14T09:02:22.590 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-14T09:02:22.590 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7249 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-14T09:02:22.591 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 21649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-14T09:02:22.591 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-14T09:02:22.591 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 34633 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-14T09:02:22.591 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 33609 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-14T09:02:22.591 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31617 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq_codel.ko 2023-10-14T09:02:22.591 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 35433 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-14T09:02:22.592 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 49601 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-14T09:02:22.592 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22089 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-14T09:02:22.592 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 66393 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-14T09:02:22.592 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26073 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-14T09:02:22.592 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 30273 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-14T09:02:22.593 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-14T09:02:22.593 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26065 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-14T09:02:22.593 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 36137 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-14T09:02:22.593 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 27497 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-14T09:02:22.593 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-14T09:02:22.594 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-14T09:02:22.594 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 48793 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-14T09:02:22.594 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 32905 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-14T09:02:22.594 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 26881 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-14T09:02:22.594 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 31353 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-14T09:02:22.595 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28897 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-14T09:02:22.595 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 28105 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-14T09:02:22.595 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/ 2023-10-14T09:02:22.595 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 929745 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-14T09:02:22.595 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 19033 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-14T09:02:22.595 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/ 2023-10-14T09:02:22.596 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/ 2023-10-14T09:02:22.596 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 336529 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-14T09:02:22.596 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 54737 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-14T09:02:22.596 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 1520161 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-14T09:02:22.596 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/ 2023-10-14T09:02:22.597 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 707721 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-14T09:02:22.597 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/ 2023-10-14T09:02:22.597 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10025 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-14T09:02:22.597 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 862641 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-14T09:02:22.597 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/ 2023-10-14T09:02:22.598 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15729 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-14T09:02:22.598 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/ 2023-10-14T09:02:22.598 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 85337 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-14T09:02:22.598 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 68049 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-14T09:02:22.598 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 96193 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-14T09:02:22.599 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 10705 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-14T09:02:22.599 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 17521 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-14T09:02:22.599 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/ 2023-10-14T09:02:22.599 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 125177 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/x25.ko 2023-10-14T09:02:22.599 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/ 2023-10-14T09:02:22.600 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 22657 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_algo.ko 2023-10-14T09:02:22.600 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 20649 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-14T09:02:22.600 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 102257 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_user.ko 2023-10-14T09:02:22.600 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/ 2023-10-14T09:02:22.600 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/ 2023-10-14T09:02:22.601 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 15537 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-14T09:02:22.601 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 639863 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-14T09:02:22.601 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 623919 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-14T09:02:22.601 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 7663 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-14T09:02:22.601 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 23428 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-14T09:02:22.601 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 9821 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-14T09:02:22.602 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 70004 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-14T09:02:22.602 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 146313 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-14T09:02:22.602 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 232548 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-14T09:02:22.602 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 210 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-14T09:02:22.602 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 72606 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-14T09:02:22.603 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 879 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-14T09:02:22.603 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 254438 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-14T09:02:22.603 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 309363 2023-10-10 19:56 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-14T09:02:22.603 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/ 2023-10-14T09:02:22.603 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/ 2023-10-14T09:02:22.604 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/doc/ 2023-10-14T09:02:22.604 INFO:teuthology.orchestra.run.smithi157.stdout:drwxr-xr-x root/root 0 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/ 2023-10-14T09:02:22.604 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 175 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/changelog.Debian.gz 2023-10-14T09:02:22.604 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r-- root/root 691 2023-10-10 19:56 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/copyright 2023-10-14T09:02:22.605 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-14T09:02:22.605 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g47672119149b 2023-10-14T09:02:22.606 DEBUG:teuthology.orchestra.run.smithi157:> egrep '(submenu|menuentry.*6.6.0-rc5-g47672119149b).*{' /boot/grub/grub.cfg 2023-10-14T09:02:22.612 INFO:teuthology.orchestra.run.smithi157.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T09:02:22.613 INFO:teuthology.orchestra.run.smithi157.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T09:02:22.613 INFO:teuthology.orchestra.run.smithi157.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-10-14T09:02:22.613 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-14T09:02:22.614 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g47672119149b 2023-10-14T09:02:22.614 DEBUG:teuthology.orchestra.run.smithi157:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-14T09:02:22.655 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi157.front.sepia.ceph.com to complete... 2023-10-14T09:02:23.074 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub' 2023-10-14T09:02:23.075 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-14T09:02:23.105 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2023-10-14T09:02:23.315 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T09:02:23.321 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-14T09:02:23.557 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-14T09:02:23.561 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-14T09:02:23.599 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-14T09:02:23.604 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-14T09:02:23.737 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-14T09:02:23.738 INFO:teuthology.orchestra.run.smithi157.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-14T09:02:23.738 INFO:teuthology.orchestra.run.smithi157.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-14T09:02:23.754 INFO:teuthology.orchestra.run.smithi157.stderr:done 2023-10-14T09:02:44.484 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-14T09:02:44.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-10-14T09:02:44.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:02:54.900 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-14T09:02:54.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-14T09:02:54.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:03:29.402 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-14T09:03:38.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-14T09:03:38.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:03:41.466 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-14T09:03:44.490 DEBUG:teuthology.orchestra.remote:timed out 2023-10-14T09:03:53.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-14T09:03:53.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:03:53.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-10-14T09:03:53.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:03:53.495 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-10-14T09:04:05.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-10-14T09:04:05.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:04:05.705 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-10-14T09:04:06.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-10-14T09:04:06.410 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-rc5-g47672119149b"... 2023-10-14T09:04:06.410 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-10-14T09:04:06.460 INFO:teuthology.orchestra.run.smithi078.stdout:6.6.0-rc5-g47672119149b 2023-10-14T09:04:06.460 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-14T09:04:06.460 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T09:04:06.460 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-14T09:04:07.462 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-14T09:04:07.462 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-14T09:04:07.548 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2023-10-14T09:04:07.603 DEBUG:teuthology.parallel:result is None 2023-10-14T09:04:53.479 DEBUG:teuthology.orchestra.remote:timed out 2023-10-14T09:05:08.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-14T09:05:08.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:05:08.617 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-10-14T09:05:09.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-14T09:05:09.286 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-rc5-g47672119149b"... 2023-10-14T09:05:09.286 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2023-10-14T09:05:09.335 INFO:teuthology.orchestra.run.smithi157.stdout:6.6.0-rc5-g47672119149b 2023-10-14T09:05:09.335 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-14T09:05:09.335 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T09:05:09.336 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-14T09:05:10.336 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-14T09:05:10.337 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-14T09:05:10.415 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2023-10-14T09:05:10.462 DEBUG:teuthology.parallel:result is None 2023-10-14T09:05:10.463 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T09:05:10.470 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T09:05:10.470 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T09:05:10.474 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T09:05:10.483 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T09:05:10.490 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T09:05:10.534 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T09:05:10.535 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T09:05:10.539 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T09:05:10.563 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T09:05:10.570 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T09:05:10.571 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T09:05:10.602 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T09:05:10.626 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T09:05:10.629 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T09:05:10.641 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T09:05:10.643 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T09:05:10.645 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T09:05:10.653 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T09:05:10.653 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T09:05:10.691 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T09:05:10.713 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T09:05:10.723 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T09:05:10.723 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T09:05:10.758 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T09:05:10.768 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T09:05:10.816 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T09:05:10.872 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:05:10.872 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T09:05:10.945 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T09:05:10.955 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T09:05:11.004 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:05:11.004 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T09:05:11.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2023-10-14T09:05:11.086 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2023-10-14T09:05:11.213 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T09:05:11.222 INFO:teuthology.task.internal:Starting timer... 2023-10-14T09:05:11.223 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T09:05:11.276 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T09:05:11.297 DEBUG:teuthology.task.selinux:Excluding smithi078: OS 'ubuntu' does not support SELinux 2023-10-14T09:05:11.297 DEBUG:teuthology.task.selinux:Excluding smithi157: OS 'ubuntu' does not support SELinux 2023-10-14T09:05:11.298 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T09:05:11.298 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-14T09:05:11.298 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T09:05:11.299 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T09:05:11.308 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-14T09:05:11.308 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T09:05:11.324 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T09:05:11.326 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T09:13:40.922 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2023-10-14T09:13:40.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-10-14T09:13:40.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:13:41.004 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-10-14T09:13:41.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-10-14T09:13:41.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-14T09:13:41.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T09:13:41.219 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-10-14T09:13:41.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-14T09:13:41.330 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T09:13:41.350 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T09:13:41.351 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T09:13:41.352 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:13:41.360 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T09:13:41.361 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:13:41.396 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-14T09:13:41.396 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: Command line: ntpd -gq 2023-10-14T09:13:41.396 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: ---------------------------------------------------- 2023-10-14T09:13:41.396 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: ntp-4 is maintained by Network Time Foundation, 2023-10-14T09:13:41.397 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-14T09:13:41.397 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: corporation. Support and training for ntp-4 are 2023-10-14T09:13:41.397 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: available at https://www.nwtime.org/support 2023-10-14T09:13:41.397 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: ---------------------------------------------------- 2023-10-14T09:13:41.398 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: proto: precision = 0.043 usec (-24) 2023-10-14T09:13:41.398 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: basedate set to 2022-02-04 2023-10-14T09:13:41.398 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: gps base set to 2022-02-06 (week 2196) 2023-10-14T09:13:41.399 INFO:teuthology.orchestra.run.smithi078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-14T09:13:41.399 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-14T09:13:41.400 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: restrict ::: KOD does nothing without LIMITED. 2023-10-14T09:13:41.400 INFO:teuthology.orchestra.run.smithi078.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-14T09:13:41.401 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: Listen and drop on 0 v6wildcard [::]:123 2023-10-14T09:13:41.401 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-14T09:13:41.401 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: Listen normally on 2 lo 127.0.0.1:123 2023-10-14T09:13:41.402 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: Listen normally on 3 enp3s0f1 172.21.15.78:123 2023-10-14T09:13:41.402 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: Listen normally on 4 lo [::1]:123 2023-10-14T09:13:41.402 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d4dd%5]:123 2023-10-14T09:13:41.403 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:41 ntpd[27993]: Listening on routing socket on fd #22 for interface updates 2023-10-14T09:13:41.412 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-14T09:13:41.413 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: Command line: ntpd -gq 2023-10-14T09:13:41.413 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: ---------------------------------------------------- 2023-10-14T09:13:41.413 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: ntp-4 is maintained by Network Time Foundation, 2023-10-14T09:13:41.413 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-14T09:13:41.413 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: corporation. Support and training for ntp-4 are 2023-10-14T09:13:41.414 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: available at https://www.nwtime.org/support 2023-10-14T09:13:41.414 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: ---------------------------------------------------- 2023-10-14T09:13:41.415 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: proto: precision = 0.041 usec (-24) 2023-10-14T09:13:41.415 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: basedate set to 2022-02-04 2023-10-14T09:13:41.415 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: gps base set to 2022-02-06 (week 2196) 2023-10-14T09:13:41.415 INFO:teuthology.orchestra.run.smithi157.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-14T09:13:41.416 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-14T09:13:41.416 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: restrict ::: KOD does nothing without LIMITED. 2023-10-14T09:13:41.417 INFO:teuthology.orchestra.run.smithi157.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-14T09:13:41.417 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: Listen and drop on 0 v6wildcard [::]:123 2023-10-14T09:13:41.418 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-14T09:13:41.418 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: Listen normally on 2 lo 127.0.0.1:123 2023-10-14T09:13:41.418 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: Listen normally on 3 enp3s0f1 172.21.15.157:123 2023-10-14T09:13:41.418 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: Listen normally on 4 lo [::1]:123 2023-10-14T09:13:41.419 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea1%5]:123 2023-10-14T09:13:41.419 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:41 ntpd[27983]: Listening on routing socket on fd #22 for interface updates 2023-10-14T09:13:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:42 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:42 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:42 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:42 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:42.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:42 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:42.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:42 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:42.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:42 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:42.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:42 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:43.396 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:43 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:43.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:43 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:43.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:43 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:43.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:43 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:43.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:43 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:43.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:43 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:43.399 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:43 ntpd[27993]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:43.399 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:43 ntpd[27993]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:44.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:44.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:44.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:44.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:44.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:44.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:44.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:44.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:44.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:44.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:44.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:44.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:44 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:45.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:45.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:45.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:45.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:45.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:45.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:45.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:45.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:45.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:45.399 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:45.399 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:45.399 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:45 ntpd[27993]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:45.413 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:45 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:45.413 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:45 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:45.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:45 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:45.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:45 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:45.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:45 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:45.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:45 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:46 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:46.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:46 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:46 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:46 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:46 ntpd[27993]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:46.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:46 ntpd[27993]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:46.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:46.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:46.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:46.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:46.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:46.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:46.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:46.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:46.417 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:46 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:47.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:47.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:47.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:47.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:47.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:47.399 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:47.399 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:47.399 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:47 ntpd[27993]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:47.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:47 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:47.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:47 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:47.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:47 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:47.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:47 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:47.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:47 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:47.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:47 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:48.396 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:48 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:48.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:48 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:48.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:48 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:48.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:48 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:48.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:48 ntpd[27993]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:48.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:48 ntpd[27993]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:48.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:48.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:48.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:48.414 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:48.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:48.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:48.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:48.415 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:48.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:48.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:48.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:48.416 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:48.417 INFO:teuthology.orchestra.run.smithi157.stdout:14 Oct 09:13:48 ntpd[27983]: ntpd: time slew -0.003378 s 2023-10-14T09:13:48.417 INFO:teuthology.orchestra.run.smithi157.stdout:ntpd: time slew -0.003378s 2023-10-14T09:13:48.417 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-14T09:13:48.417 INFO:teuthology.orchestra.run.smithi157.stderr:14 Oct 09:13:48 ntpd[27983]: can't open /var/log/ntpstats/loopstats.20231014: Permission denied 2023-10-14T09:13:48.518 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2023-10-14T09:13:48.518 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2023-10-14T09:13:48.519 INFO:teuthology.orchestra.run.smithi157.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T09:13:48.519 INFO:teuthology.orchestra.run.smithi157.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T09:13:48.519 INFO:teuthology.orchestra.run.smithi157.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T09:13:48.519 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T09:13:49.396 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:49 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:49 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:49 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:49 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:49 ntpd[27993]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-14T09:13:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:49 ntpd[27993]: can't open /var/log/ntpstats/rawstats.20231014: Permission denied 2023-10-14T09:13:49.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:49 ntpd[27993]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-14T09:13:49.398 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:49 ntpd[27993]: can't open /var/log/ntpstats/peerstats.20231014: Permission denied 2023-10-14T09:13:49.398 INFO:teuthology.orchestra.run.smithi078.stdout:14 Oct 09:13:49 ntpd[27993]: ntpd: time slew -0.000428 s 2023-10-14T09:13:49.398 INFO:teuthology.orchestra.run.smithi078.stdout:ntpd: time slew -0.000428s 2023-10-14T09:13:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:49 ntpd[27993]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-14T09:13:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:14 Oct 09:13:49 ntpd[27993]: can't open /var/log/ntpstats/loopstats.20231014: Permission denied 2023-10-14T09:13:49.484 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2023-10-14T09:13:49.484 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2023-10-14T09:13:49.484 INFO:teuthology.orchestra.run.smithi078.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T09:13:49.485 INFO:teuthology.orchestra.run.smithi078.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T09:13:49.485 INFO:teuthology.orchestra.run.smithi078.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T09:13:49.485 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T09:13:49.486 INFO:teuthology.run_tasks:Running task install... 2023-10-14T09:13:49.496 DEBUG:teuthology.task.install:project ceph 2023-10-14T09:13:49.496 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-14T09:13:49.497 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-14T09:13:49.497 INFO:teuthology.task.install:Using flavor: default 2023-10-14T09:13:49.503 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T09:13:49.504 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-14T09:13:49.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-key list | grep Ceph 2023-10-14T09:13:49.505 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-key list | grep Ceph 2023-10-14T09:13:49.613 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-14T09:13:49.636 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-14T09:13:49.667 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-14T09:13:49.667 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph.com (release key) 2023-10-14T09:13:49.668 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-14T09:13:49.668 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-14T09:13:49.669 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T09:13:49.688 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-14T09:13:49.689 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph.com (release key) 2023-10-14T09:13:49.690 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-14T09:13:49.691 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-14T09:13:49.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T09:13:49.819 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default/ 2023-10-14T09:13:49.820 INFO:teuthology.task.install.deb:Package version is 18.0.0-6730-g4ba8a190-1jammy 2023-10-14T09:13:49.901 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default/ 2023-10-14T09:13:49.901 INFO:teuthology.task.install.deb:Package version is 18.0.0-6730-g4ba8a190-1jammy 2023-10-14T09:13:49.999 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:13:50.000 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-14T09:13:50.020 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2023-10-14T09:13:50.072 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:13:50.073 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-14T09:13:50.093 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2023-10-14T09:13:50.207 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-14T09:13:50.214 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-14T09:13:50.218 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-14T09:13:50.230 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-14T09:13:50.257 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy InRelease 2023-10-14T09:13:50.279 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-14T09:13:50.279 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-14T09:13:50.283 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-14T09:13:50.300 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-14T09:13:50.301 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-14T09:13:50.322 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2023-10-14T09:13:50.356 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-14T09:13:50.388 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy InRelease 2023-10-14T09:13:50.395 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-14T09:13:50.425 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-14T09:13:50.462 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-14T09:13:50.498 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2023-10-14T09:13:50.546 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-10-14T09:13:50.811 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 28.6 kB in 1s (50.2 kB/s) 2023-10-14T09:13:50.906 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 139 kB in 1s (235 kB/s) 2023-10-14T09:13:51.708 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2023-10-14T09:13:51.725 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6730-g4ba8a190-1jammy cephadm=18.0.0-6730-g4ba8a190-1jammy ceph-mds=18.0.0-6730-g4ba8a190-1jammy ceph-mgr=18.0.0-6730-g4ba8a190-1jammy ceph-common=18.0.0-6730-g4ba8a190-1jammy ceph-fuse=18.0.0-6730-g4ba8a190-1jammy ceph-test=18.0.0-6730-g4ba8a190-1jammy ceph-volume=18.0.0-6730-g4ba8a190-1jammy radosgw=18.0.0-6730-g4ba8a190-1jammy python3-rados=18.0.0-6730-g4ba8a190-1jammy python3-rgw=18.0.0-6730-g4ba8a190-1jammy python3-cephfs=18.0.0-6730-g4ba8a190-1jammy python3-rbd=18.0.0-6730-g4ba8a190-1jammy libcephfs2=18.0.0-6730-g4ba8a190-1jammy libcephfs-dev=18.0.0-6730-g4ba8a190-1jammy librados2=18.0.0-6730-g4ba8a190-1jammy librbd1=18.0.0-6730-g4ba8a190-1jammy rbd-fuse=18.0.0-6730-g4ba8a190-1jammy python3-cephfs=18.0.0-6730-g4ba8a190-1jammy cephfs-shell=18.0.0-6730-g4ba8a190-1jammy cephfs-top=18.0.0-6730-g4ba8a190-1jammy cephfs-mirror=18.0.0-6730-g4ba8a190-1jammy 2023-10-14T09:13:51.800 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2023-10-14T09:13:51.817 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-10-14T09:13:51.834 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6730-g4ba8a190-1jammy cephadm=18.0.0-6730-g4ba8a190-1jammy ceph-mds=18.0.0-6730-g4ba8a190-1jammy ceph-mgr=18.0.0-6730-g4ba8a190-1jammy ceph-common=18.0.0-6730-g4ba8a190-1jammy ceph-fuse=18.0.0-6730-g4ba8a190-1jammy ceph-test=18.0.0-6730-g4ba8a190-1jammy ceph-volume=18.0.0-6730-g4ba8a190-1jammy radosgw=18.0.0-6730-g4ba8a190-1jammy python3-rados=18.0.0-6730-g4ba8a190-1jammy python3-rgw=18.0.0-6730-g4ba8a190-1jammy python3-cephfs=18.0.0-6730-g4ba8a190-1jammy python3-rbd=18.0.0-6730-g4ba8a190-1jammy libcephfs2=18.0.0-6730-g4ba8a190-1jammy libcephfs-dev=18.0.0-6730-g4ba8a190-1jammy librados2=18.0.0-6730-g4ba8a190-1jammy librbd1=18.0.0-6730-g4ba8a190-1jammy rbd-fuse=18.0.0-6730-g4ba8a190-1jammy python3-cephfs=18.0.0-6730-g4ba8a190-1jammy cephfs-shell=18.0.0-6730-g4ba8a190-1jammy cephfs-top=18.0.0-6730-g4ba8a190-1jammy cephfs-mirror=18.0.0-6730-g4ba8a190-1jammy 2023-10-14T09:13:51.908 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-10-14T09:13:51.964 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2023-10-14T09:13:51.965 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2023-10-14T09:13:52.071 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-10-14T09:13:52.071 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-10-14T09:13:52.112 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2023-10-14T09:13:52.112 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-14T09:13:52.112 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-14T09:13:52.112 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-14T09:13:52.113 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-14T09:13:52.114 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-14T09:13:52.114 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-14T09:13:52.115 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2023-10-14T09:13:52.115 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-14T09:13:52.115 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-14T09:13:52.115 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-14T09:13:52.115 INFO:teuthology.orchestra.run.smithi157.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-14T09:13:52.116 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-14T09:13:52.116 INFO:teuthology.orchestra.run.smithi157.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-14T09:13:52.116 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-14T09:13:52.116 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-14T09:13:52.116 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-14T09:13:52.117 INFO:teuthology.orchestra.run.smithi157.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-14T09:13:52.117 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-14T09:13:52.117 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-14T09:13:52.117 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-14T09:13:52.117 INFO:teuthology.orchestra.run.smithi157.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-14T09:13:52.117 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-14T09:13:52.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-14T09:13:52.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-14T09:13:52.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-14T09:13:52.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-14T09:13:52.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-14T09:13:52.119 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-14T09:13:52.119 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-14T09:13:52.119 INFO:teuthology.orchestra.run.smithi157.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-14T09:13:52.119 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2023-10-14T09:13:52.120 INFO:teuthology.orchestra.run.smithi157.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-14T09:13:52.120 INFO:teuthology.orchestra.run.smithi157.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-14T09:13:52.120 INFO:teuthology.orchestra.run.smithi157.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-14T09:13:52.120 INFO:teuthology.orchestra.run.smithi157.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-14T09:13:52.120 INFO:teuthology.orchestra.run.smithi157.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-14T09:13:52.121 INFO:teuthology.orchestra.run.smithi157.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-14T09:13:52.121 INFO:teuthology.orchestra.run.smithi157.stdout: python3-watchdog 2023-10-14T09:13:52.121 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2023-10-14T09:13:52.121 INFO:teuthology.orchestra.run.smithi157.stdout: btrfs-tools 2023-10-14T09:13:52.219 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-10-14T09:13:52.219 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-14T09:13:52.219 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-14T09:13:52.220 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-14T09:13:52.222 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-14T09:13:52.222 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-14T09:13:52.222 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-14T09:13:52.223 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-10-14T09:13:52.223 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-14T09:13:52.223 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-14T09:13:52.223 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-14T09:13:52.223 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-14T09:13:52.224 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-14T09:13:52.224 INFO:teuthology.orchestra.run.smithi078.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-14T09:13:52.224 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-14T09:13:52.224 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-14T09:13:52.224 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-14T09:13:52.225 INFO:teuthology.orchestra.run.smithi078.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-14T09:13:52.225 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-14T09:13:52.225 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-14T09:13:52.225 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-14T09:13:52.225 INFO:teuthology.orchestra.run.smithi078.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-14T09:13:52.225 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-14T09:13:52.226 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-14T09:13:52.226 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-14T09:13:52.226 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-14T09:13:52.226 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-14T09:13:52.226 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-14T09:13:52.227 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-14T09:13:52.227 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-14T09:13:52.227 INFO:teuthology.orchestra.run.smithi078.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-14T09:13:52.227 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-10-14T09:13:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-14T09:13:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-14T09:13:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-14T09:13:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-14T09:13:52.228 INFO:teuthology.orchestra.run.smithi078.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-14T09:13:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-14T09:13:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: python3-watchdog 2023-10-14T09:13:52.229 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2023-10-14T09:13:52.229 INFO:teuthology.orchestra.run.smithi078.stdout: btrfs-tools 2023-10-14T09:13:52.256 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2023-10-14T09:13:52.257 INFO:teuthology.orchestra.run.smithi157.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-14T09:13:52.257 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-14T09:13:52.257 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-14T09:13:52.257 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-14T09:13:52.257 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-14T09:13:52.258 INFO:teuthology.orchestra.run.smithi157.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-14T09:13:52.258 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-14T09:13:52.259 INFO:teuthology.orchestra.run.smithi157.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-14T09:13:52.259 INFO:teuthology.orchestra.run.smithi157.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-14T09:13:52.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-14T09:13:52.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-14T09:13:52.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-14T09:13:52.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-14T09:13:52.260 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-14T09:13:52.261 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-14T09:13:52.261 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-14T09:13:52.261 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-14T09:13:52.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-14T09:13:52.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-14T09:13:52.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-14T09:13:52.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-14T09:13:52.262 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-14T09:13:52.263 INFO:teuthology.orchestra.run.smithi157.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-14T09:13:52.263 INFO:teuthology.orchestra.run.smithi157.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-14T09:13:52.263 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-14T09:13:52.263 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-14T09:13:52.263 INFO:teuthology.orchestra.run.smithi157.stdout: socat xmlstarlet 2023-10-14T09:13:52.326 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 115 newly installed, 0 to remove and 259 not upgraded. 2023-10-14T09:13:52.327 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 184 MB of archives. 2023-10-14T09:13:52.327 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 826 MB of additional disk space will be used. 2023-10-14T09:13:52.327 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-14T09:13:52.350 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-14T09:13:52.356 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-14T09:13:52.363 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-10-14T09:13:52.363 INFO:teuthology.orchestra.run.smithi078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-14T09:13:52.363 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-14T09:13:52.363 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-14T09:13:52.363 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-14T09:13:52.364 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-14T09:13:52.364 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-14T09:13:52.364 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-14T09:13:52.366 INFO:teuthology.orchestra.run.smithi078.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-14T09:13:52.366 INFO:teuthology.orchestra.run.smithi078.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-14T09:13:52.366 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-14T09:13:52.366 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-14T09:13:52.366 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-14T09:13:52.367 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-14T09:13:52.367 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-14T09:13:52.367 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-14T09:13:52.367 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-14T09:13:52.367 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-14T09:13:52.368 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-14T09:13:52.368 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-14T09:13:52.368 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-14T09:13:52.368 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-14T09:13:52.368 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-14T09:13:52.369 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-14T09:13:52.369 INFO:teuthology.orchestra.run.smithi078.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-14T09:13:52.369 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-14T09:13:52.369 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-14T09:13:52.369 INFO:teuthology.orchestra.run.smithi078.stdout: socat xmlstarlet 2023-10-14T09:13:52.406 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6730-g4ba8a190-1jammy [3,449 kB] 2023-10-14T09:13:52.412 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-14T09:13:52.418 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-14T09:13:52.430 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 115 newly installed, 0 to remove and 259 not upgraded. 2023-10-14T09:13:52.430 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 184 MB of archives. 2023-10-14T09:13:52.430 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 826 MB of additional disk space will be used. 2023-10-14T09:13:52.430 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-14T09:13:52.439 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-14T09:13:52.442 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-14T09:13:52.447 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-14T09:13:52.453 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-14T09:13:52.457 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-14T09:13:52.496 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-14T09:13:52.498 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-14T09:13:52.500 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-14T09:13:52.505 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-14T09:13:52.508 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-14T09:13:52.508 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-14T09:13:52.509 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-14T09:13:52.515 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-14T09:13:52.515 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-14T09:13:52.516 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6730-g4ba8a190-1jammy [3,449 kB] 2023-10-14T09:13:52.516 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-14T09:13:52.517 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-14T09:13:52.519 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-14T09:13:52.525 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-14T09:13:52.528 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-14T09:13:52.537 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-14T09:13:52.537 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-14T09:13:52.538 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-14T09:13:52.538 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-14T09:13:52.539 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-14T09:13:52.539 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-14T09:13:52.541 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-14T09:13:52.541 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-14T09:13:52.542 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-14T09:13:52.542 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-14T09:13:52.559 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-14T09:13:52.560 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-14T09:13:52.560 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-14T09:13:52.576 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-14T09:13:52.579 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-14T09:13:52.579 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-14T09:13:52.580 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-14T09:13:52.580 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-14T09:13:52.584 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-14T09:13:52.585 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-14T09:13:52.585 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-14T09:13:52.586 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-14T09:13:52.586 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-14T09:13:52.588 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-14T09:13:52.589 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-14T09:13:52.595 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-14T09:13:52.595 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-14T09:13:52.596 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-14T09:13:52.597 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-14T09:13:52.597 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-14T09:13:52.598 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-14T09:13:52.600 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-14T09:13:52.600 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-14T09:13:52.612 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-14T09:13:52.612 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-14T09:13:52.613 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-14T09:13:52.613 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-14T09:13:52.618 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-14T09:13:52.619 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-14T09:13:52.621 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-14T09:13:52.621 INFO:teuthology.orchestra.run.smithi157.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-14T09:13:52.624 INFO:teuthology.orchestra.run.smithi157.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-14T09:13:52.626 INFO:teuthology.orchestra.run.smithi157.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6730-g4ba8a190-1jammy [3,130 kB] 2023-10-14T09:13:52.628 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-14T09:13:52.630 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-14T09:13:52.631 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-14T09:13:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-14T09:13:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-14T09:13:52.633 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-14T09:13:52.645 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-14T09:13:52.645 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-14T09:13:52.646 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-14T09:13:52.647 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-14T09:13:52.662 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-14T09:13:52.666 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-14T09:13:52.666 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-14T09:13:52.667 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-14T09:13:52.667 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-14T09:13:52.668 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-14T09:13:52.671 INFO:teuthology.orchestra.run.smithi157.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-14T09:13:52.672 INFO:teuthology.orchestra.run.smithi157.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-14T09:13:52.673 INFO:teuthology.orchestra.run.smithi157.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-14T09:13:52.674 INFO:teuthology.orchestra.run.smithi157.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-14T09:13:52.675 INFO:teuthology.orchestra.run.smithi157.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-14T09:13:52.675 INFO:teuthology.orchestra.run.smithi157.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-14T09:13:52.679 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-14T09:13:52.679 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-14T09:13:52.681 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-14T09:13:52.681 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-14T09:13:52.695 INFO:teuthology.orchestra.run.smithi157.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-14T09:13:52.696 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-14T09:13:52.697 INFO:teuthology.orchestra.run.smithi078.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-14T09:13:52.697 INFO:teuthology.orchestra.run.smithi157.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-14T09:13:52.697 INFO:teuthology.orchestra.run.smithi157.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-14T09:13:52.699 INFO:teuthology.orchestra.run.smithi078.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-14T09:13:52.714 INFO:teuthology.orchestra.run.smithi157.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-14T09:13:52.720 INFO:teuthology.orchestra.run.smithi157.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-14T09:13:52.720 INFO:teuthology.orchestra.run.smithi157.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-14T09:13:52.721 INFO:teuthology.orchestra.run.smithi157.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-14T09:13:52.721 INFO:teuthology.orchestra.run.smithi157.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-14T09:13:52.722 INFO:teuthology.orchestra.run.smithi157.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-14T09:13:52.722 INFO:teuthology.orchestra.run.smithi157.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-14T09:13:52.723 INFO:teuthology.orchestra.run.smithi157.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-14T09:13:52.726 INFO:teuthology.orchestra.run.smithi157.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6730-g4ba8a190-1jammy [688 kB] 2023-10-14T09:13:52.726 INFO:teuthology.orchestra.run.smithi157.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-14T09:13:52.743 INFO:teuthology.orchestra.run.smithi078.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-14T09:13:52.744 INFO:teuthology.orchestra.run.smithi078.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-14T09:13:52.744 INFO:teuthology.orchestra.run.smithi157.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-14T09:13:52.745 INFO:teuthology.orchestra.run.smithi078.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-14T09:13:52.746 INFO:teuthology.orchestra.run.smithi157.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-14T09:13:52.747 INFO:teuthology.orchestra.run.smithi157.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-14T09:13:52.747 INFO:teuthology.orchestra.run.smithi078.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-14T09:13:52.747 INFO:teuthology.orchestra.run.smithi078.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-14T09:13:52.748 INFO:teuthology.orchestra.run.smithi078.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-14T09:13:52.750 INFO:teuthology.orchestra.run.smithi157.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-14T09:13:52.751 INFO:teuthology.orchestra.run.smithi157.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6730-g4ba8a190-1jammy [356 kB] 2023-10-14T09:13:52.753 INFO:teuthology.orchestra.run.smithi157.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-14T09:13:52.753 INFO:teuthology.orchestra.run.smithi157.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-14T09:13:52.758 INFO:teuthology.orchestra.run.smithi157.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-14T09:13:52.763 INFO:teuthology.orchestra.run.smithi157.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6730-g4ba8a190-1jammy [32.8 kB] 2023-10-14T09:13:52.763 INFO:teuthology.orchestra.run.smithi157.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6730-g4ba8a190-1jammy [180 kB] 2023-10-14T09:13:52.764 INFO:teuthology.orchestra.run.smithi157.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-14T09:13:52.764 INFO:teuthology.orchestra.run.smithi157.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-14T09:13:52.765 INFO:teuthology.orchestra.run.smithi157.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-14T09:13:52.766 INFO:teuthology.orchestra.run.smithi078.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-14T09:13:52.768 INFO:teuthology.orchestra.run.smithi078.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-14T09:13:52.769 INFO:teuthology.orchestra.run.smithi078.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-14T09:13:52.769 INFO:teuthology.orchestra.run.smithi157.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6730-g4ba8a190-1jammy [62.4 kB] 2023-10-14T09:13:52.772 INFO:teuthology.orchestra.run.smithi157.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6730-g4ba8a190-1jammy [329 kB] 2023-10-14T09:13:52.783 INFO:teuthology.orchestra.run.smithi157.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-14T09:13:52.785 INFO:teuthology.orchestra.run.smithi078.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-14T09:13:52.786 INFO:teuthology.orchestra.run.smithi078.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-14T09:13:52.786 INFO:teuthology.orchestra.run.smithi157.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-14T09:13:52.786 INFO:teuthology.orchestra.run.smithi157.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6730-g4ba8a190-1jammy [6,222 kB] 2023-10-14T09:13:52.787 INFO:teuthology.orchestra.run.smithi157.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-14T09:13:52.788 INFO:teuthology.orchestra.run.smithi078.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-14T09:13:52.788 INFO:teuthology.orchestra.run.smithi078.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-14T09:13:52.788 INFO:teuthology.orchestra.run.smithi078.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-14T09:13:52.789 INFO:teuthology.orchestra.run.smithi078.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-14T09:13:52.793 INFO:teuthology.orchestra.run.smithi157.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-14T09:13:52.794 INFO:teuthology.orchestra.run.smithi157.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-14T09:13:52.794 INFO:teuthology.orchestra.run.smithi157.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-14T09:13:52.796 INFO:teuthology.orchestra.run.smithi157.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-14T09:13:52.797 INFO:teuthology.orchestra.run.smithi078.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-14T09:13:52.797 INFO:teuthology.orchestra.run.smithi078.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-14T09:13:52.801 INFO:teuthology.orchestra.run.smithi078.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-14T09:13:52.803 INFO:teuthology.orchestra.run.smithi157.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-14T09:13:52.814 INFO:teuthology.orchestra.run.smithi078.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-14T09:13:52.815 INFO:teuthology.orchestra.run.smithi078.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-14T09:13:52.816 INFO:teuthology.orchestra.run.smithi078.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-14T09:13:52.820 INFO:teuthology.orchestra.run.smithi078.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-14T09:13:52.822 INFO:teuthology.orchestra.run.smithi078.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-14T09:13:52.823 INFO:teuthology.orchestra.run.smithi078.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-14T09:13:52.827 INFO:teuthology.orchestra.run.smithi078.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-14T09:13:52.831 INFO:teuthology.orchestra.run.smithi078.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-14T09:13:52.831 INFO:teuthology.orchestra.run.smithi078.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-14T09:13:52.832 INFO:teuthology.orchestra.run.smithi078.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-14T09:13:52.848 INFO:teuthology.orchestra.run.smithi078.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-14T09:13:52.849 INFO:teuthology.orchestra.run.smithi078.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-14T09:13:52.850 INFO:teuthology.orchestra.run.smithi078.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-14T09:13:52.857 INFO:teuthology.orchestra.run.smithi078.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-14T09:13:52.857 INFO:teuthology.orchestra.run.smithi078.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-14T09:13:52.858 INFO:teuthology.orchestra.run.smithi078.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-14T09:13:52.860 INFO:teuthology.orchestra.run.smithi078.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-14T09:13:52.864 INFO:teuthology.orchestra.run.smithi078.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-14T09:13:53.006 INFO:teuthology.orchestra.run.smithi157.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6730-g4ba8a190-1jammy [112 kB] 2023-10-14T09:13:53.008 INFO:teuthology.orchestra.run.smithi157.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6730-g4ba8a190-1jammy [439 kB] 2023-10-14T09:13:53.023 INFO:teuthology.orchestra.run.smithi157.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6730-g4ba8a190-1jammy [22.6 MB] 2023-10-14T09:13:53.834 INFO:teuthology.orchestra.run.smithi157.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6730-g4ba8a190-1jammy [6,851 kB] 2023-10-14T09:13:54.038 INFO:teuthology.orchestra.run.smithi078.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6730-g4ba8a190-1jammy [3,130 kB] 2023-10-14T09:13:54.074 INFO:teuthology.orchestra.run.smithi157.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6730-g4ba8a190-1jammy [238 kB] 2023-10-14T09:13:54.079 INFO:teuthology.orchestra.run.smithi157.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6730-g4ba8a190-1jammy [128 kB] 2023-10-14T09:13:54.083 INFO:teuthology.orchestra.run.smithi157.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6730-g4ba8a190-1jammy [1,496 kB] 2023-10-14T09:13:54.142 INFO:teuthology.orchestra.run.smithi157.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6730-g4ba8a190-1jammy [9,861 kB] 2023-10-14T09:13:54.501 INFO:teuthology.orchestra.run.smithi157.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6730-g4ba8a190-1jammy [31.7 MB] 2023-10-14T09:13:55.080 INFO:teuthology.orchestra.run.smithi078.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6730-g4ba8a190-1jammy [688 kB] 2023-10-14T09:13:55.303 INFO:teuthology.orchestra.run.smithi078.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6730-g4ba8a190-1jammy [356 kB] 2023-10-14T09:13:55.417 INFO:teuthology.orchestra.run.smithi078.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6730-g4ba8a190-1jammy [32.8 kB] 2023-10-14T09:13:55.418 INFO:teuthology.orchestra.run.smithi078.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6730-g4ba8a190-1jammy [180 kB] 2023-10-14T09:13:55.476 INFO:teuthology.orchestra.run.smithi078.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6730-g4ba8a190-1jammy [62.4 kB] 2023-10-14T09:13:55.530 INFO:teuthology.orchestra.run.smithi078.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6730-g4ba8a190-1jammy [329 kB] 2023-10-14T09:13:55.645 INFO:teuthology.orchestra.run.smithi078.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6730-g4ba8a190-1jammy [6,222 kB] 2023-10-14T09:13:55.663 INFO:teuthology.orchestra.run.smithi157.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6730-g4ba8a190-1jammy [14.0 kB] 2023-10-14T09:13:55.664 INFO:teuthology.orchestra.run.smithi157.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6730-g4ba8a190-1jammy [839 kB] 2023-10-14T09:13:55.680 INFO:teuthology.orchestra.run.smithi157.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6730-g4ba8a190-1jammy [2,146 kB] 2023-10-14T09:13:55.757 INFO:teuthology.orchestra.run.smithi157.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6730-g4ba8a190-1jammy [283 kB] 2023-10-14T09:13:55.771 INFO:teuthology.orchestra.run.smithi157.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6730-g4ba8a190-1jammy [138 kB] 2023-10-14T09:13:55.776 INFO:teuthology.orchestra.run.smithi157.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6730-g4ba8a190-1jammy [1,906 kB] 2023-10-14T09:13:55.844 INFO:teuthology.orchestra.run.smithi157.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6730-g4ba8a190-1jammy [8,625 kB] 2023-10-14T09:13:56.159 INFO:teuthology.orchestra.run.smithi157.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6730-g4ba8a190-1jammy [14.2 kB] 2023-10-14T09:13:56.159 INFO:teuthology.orchestra.run.smithi157.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6730-g4ba8a190-1jammy [47.8 MB] 2023-10-14T09:13:57.889 INFO:teuthology.orchestra.run.smithi157.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6730-g4ba8a190-1jammy [120 kB] 2023-10-14T09:13:57.889 INFO:teuthology.orchestra.run.smithi157.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6730-g4ba8a190-1jammy [227 kB] 2023-10-14T09:13:57.892 INFO:teuthology.orchestra.run.smithi157.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6730-g4ba8a190-1jammy [33.9 kB] 2023-10-14T09:13:57.892 INFO:teuthology.orchestra.run.smithi157.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6730-g4ba8a190-1jammy [23.4 kB] 2023-10-14T09:13:57.893 INFO:teuthology.orchestra.run.smithi157.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6730-g4ba8a190-1jammy [38.3 kB] 2023-10-14T09:13:57.893 INFO:teuthology.orchestra.run.smithi157.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6730-g4ba8a190-1jammy [12.3 MB] 2023-10-14T09:13:57.943 INFO:teuthology.orchestra.run.smithi078.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6730-g4ba8a190-1jammy [112 kB] 2023-10-14T09:13:58.008 INFO:teuthology.orchestra.run.smithi078.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6730-g4ba8a190-1jammy [439 kB] 2023-10-14T09:13:58.156 INFO:teuthology.orchestra.run.smithi078.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6730-g4ba8a190-1jammy [22.6 MB] 2023-10-14T09:13:58.329 INFO:teuthology.orchestra.run.smithi157.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6730-g4ba8a190-1jammy [91.6 kB] 2023-10-14T09:13:58.908 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 184 MB in 6s (30.4 MB/s) 2023-10-14T09:13:59.049 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-14T09:13:59.116 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-10-14T09:13:59.119 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-14T09:13:59.190 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-14T09:13:59.501 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-14T09:13:59.514 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-14T09:13:59.551 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-14T09:13:59.837 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cmd2. 2023-10-14T09:13:59.851 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-14T09:13:59.929 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-14T09:14:00.239 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-14T09:14:00.253 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-14T09:14:00.332 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-14T09:14:00.449 INFO:teuthology.orchestra.run.smithi078.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6730-g4ba8a190-1jammy [6,851 kB] 2023-10-14T09:14:00.635 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-14T09:14:00.648 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-14T09:14:00.693 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-14T09:14:00.988 INFO:teuthology.orchestra.run.smithi078.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6730-g4ba8a190-1jammy [238 kB] 2023-10-14T09:14:01.006 INFO:teuthology.orchestra.run.smithi078.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6730-g4ba8a190-1jammy [128 kB] 2023-10-14T09:14:01.016 INFO:teuthology.orchestra.run.smithi078.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6730-g4ba8a190-1jammy [1,496 kB] 2023-10-14T09:14:01.055 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-14T09:14:01.069 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-14T09:14:01.113 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-14T09:14:01.132 INFO:teuthology.orchestra.run.smithi078.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6730-g4ba8a190-1jammy [9,861 kB] 2023-10-14T09:14:01.459 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-14T09:14:01.473 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-14T09:14:01.508 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-14T09:14:01.849 INFO:teuthology.orchestra.run.smithi078.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6730-g4ba8a190-1jammy [31.7 MB] 2023-10-14T09:14:01.920 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-14T09:14:01.935 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T09:14:01.986 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:14:02.398 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-14T09:14:02.412 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T09:14:02.456 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:14:02.785 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-14T09:14:02.799 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T09:14:02.834 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:14:03.162 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-14T09:14:03.177 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-14T09:14:03.254 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-14T09:14:03.548 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librados2. 2023-10-14T09:14:03.563 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../011-librados2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:03.607 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librados2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:03.846 INFO:teuthology.orchestra.run.smithi078.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6730-g4ba8a190-1jammy [14.0 kB] 2023-10-14T09:14:03.846 INFO:teuthology.orchestra.run.smithi078.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6730-g4ba8a190-1jammy [839 kB] 2023-10-14T09:14:03.888 INFO:teuthology.orchestra.run.smithi078.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6730-g4ba8a190-1jammy [2,146 kB] 2023-10-14T09:14:04.002 INFO:teuthology.orchestra.run.smithi078.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6730-g4ba8a190-1jammy [283 kB] 2023-10-14T09:14:04.021 INFO:teuthology.orchestra.run.smithi078.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6730-g4ba8a190-1jammy [138 kB] 2023-10-14T09:14:04.026 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librbd1. 2023-10-14T09:14:04.032 INFO:teuthology.orchestra.run.smithi078.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6730-g4ba8a190-1jammy [1,906 kB] 2023-10-14T09:14:04.041 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../012-librbd1_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:04.084 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librbd1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:04.142 INFO:teuthology.orchestra.run.smithi078.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6730-g4ba8a190-1jammy [8,625 kB] 2023-10-14T09:14:04.614 INFO:teuthology.orchestra.run.smithi078.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6730-g4ba8a190-1jammy [14.2 kB] 2023-10-14T09:14:04.614 INFO:teuthology.orchestra.run.smithi078.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6730-g4ba8a190-1jammy [47.8 MB] 2023-10-14T09:14:04.729 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs2. 2023-10-14T09:14:04.743 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:04.779 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:05.006 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rados. 2023-10-14T09:14:05.020 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:05.056 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rados (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:05.376 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-14T09:14:05.390 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:05.434 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-argparse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:05.720 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cephfs. 2023-10-14T09:14:05.734 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:05.778 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cephfs (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:06.064 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-14T09:14:06.079 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:06.114 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:06.409 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-prettytable. 2023-10-14T09:14:06.424 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-14T09:14:06.459 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-14T09:14:06.745 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rbd. 2023-10-14T09:14:06.760 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:06.803 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rbd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:06.889 INFO:teuthology.orchestra.run.smithi078.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6730-g4ba8a190-1jammy [120 kB] 2023-10-14T09:14:06.890 INFO:teuthology.orchestra.run.smithi078.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6730-g4ba8a190-1jammy [227 kB] 2023-10-14T09:14:06.891 INFO:teuthology.orchestra.run.smithi078.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6730-g4ba8a190-1jammy [33.9 kB] 2023-10-14T09:14:06.892 INFO:teuthology.orchestra.run.smithi078.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6730-g4ba8a190-1jammy [23.4 kB] 2023-10-14T09:14:06.892 INFO:teuthology.orchestra.run.smithi078.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6730-g4ba8a190-1jammy [38.3 kB] 2023-10-14T09:14:06.893 INFO:teuthology.orchestra.run.smithi078.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6730-g4ba8a190-1jammy [12.3 MB] 2023-10-14T09:14:07.148 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-14T09:14:07.162 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-14T09:14:07.206 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-14T09:14:07.369 INFO:teuthology.orchestra.run.smithi078.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6730-g4ba8a190-1jammy [91.6 kB] 2023-10-14T09:14:07.526 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librgw2. 2023-10-14T09:14:07.540 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../021-librgw2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:07.575 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librgw2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:07.953 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 184 MB in 15s (12.3 MB/s) 2023-10-14T09:14:08.011 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rgw. 2023-10-14T09:14:08.025 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:08.069 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:08.099 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-14T09:14:08.167 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-10-14T09:14:08.171 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-14T09:14:08.214 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-14T09:14:08.406 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-14T09:14:08.420 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-14T09:14:08.464 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-14T09:14:08.536 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-14T09:14:08.549 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-14T09:14:08.592 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-14T09:14:08.800 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libradosstriper1. 2023-10-14T09:14:08.815 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:08.859 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libradosstriper1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:08.902 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cmd2. 2023-10-14T09:14:08.916 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-14T09:14:08.952 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-14T09:14:09.212 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-common. 2023-10-14T09:14:09.226 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:09.247 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-14T09:14:09.261 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-14T09:14:09.270 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:09.356 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-14T09:14:09.867 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-14T09:14:09.881 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-14T09:14:09.925 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-14T09:14:10.278 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-14T09:14:10.292 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-14T09:14:10.336 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-14T09:14:10.368 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-base. 2023-10-14T09:14:10.382 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:10.435 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-base (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:10.681 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-14T09:14:10.695 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-14T09:14:10.740 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-14T09:14:11.160 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-14T09:14:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-14T09:14:11.174 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T09:14:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-14T09:14:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-14T09:14:11.226 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:14:11.525 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cheroot. 2023-10-14T09:14:11.538 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-14T09:14:11.583 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-14T09:14:11.629 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-14T09:14:11.643 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T09:14:11.688 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:14:11.853 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-14T09:14:11.866 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-14T09:14:11.911 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-14T09:14:11.991 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-14T09:14:12.042 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-14T09:14:12.042 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:14:12.239 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-14T09:14:12.253 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-14T09:14:12.297 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-14T09:14:12.385 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-14T09:14:12.399 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-14T09:14:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-14T09:14:12.600 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-14T09:14:12.615 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-14T09:14:12.658 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-14T09:14:12.771 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librados2. 2023-10-14T09:14:12.785 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../011-librados2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:12.829 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librados2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:12.919 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempora. 2023-10-14T09:14:12.934 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-14T09:14:12.969 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-14T09:14:13.241 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librbd1. 2023-10-14T09:14:13.254 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../012-librbd1_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:13.289 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-portend. 2023-10-14T09:14:13.303 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-14T09:14:13.324 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librbd1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:13.347 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-14T09:14:13.658 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-14T09:14:13.668 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs2. 2023-10-14T09:14:13.673 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-14T09:14:13.682 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:13.716 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-14T09:14:13.726 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:14.004 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rados. 2023-10-14T09:14:14.018 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:14.019 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-14T09:14:14.034 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-14T09:14:14.062 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rados (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:14.077 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-14T09:14:14.390 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-14T09:14:14.405 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:14.448 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-argparse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:14.449 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-natsort. 2023-10-14T09:14:14.463 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-14T09:14:14.506 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-14T09:14:14.717 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cephfs. 2023-10-14T09:14:14.731 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:14.767 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cephfs (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:14.976 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-logutils. 2023-10-14T09:14:14.991 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-14T09:14:15.020 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-14T09:14:15.034 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:15.035 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-14T09:14:15.069 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:15.287 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-14T09:14:15.302 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-14T09:14:15.337 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-14T09:14:15.389 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-prettytable. 2023-10-14T09:14:15.404 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-14T09:14:15.448 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-14T09:14:15.648 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-mako. 2023-10-14T09:14:15.663 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-14T09:14:15.706 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-14T09:14:15.717 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rbd. 2023-10-14T09:14:15.731 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:15.767 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rbd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:16.051 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-14T09:14:16.066 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-14T09:14:16.078 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-14T09:14:16.092 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-14T09:14:16.109 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-14T09:14:16.136 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-14T09:14:16.412 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-14T09:14:16.428 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-14T09:14:16.464 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librgw2. 2023-10-14T09:14:16.478 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../021-librgw2_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:16.487 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-14T09:14:16.522 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librgw2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:16.757 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webob. 2023-10-14T09:14:16.772 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-14T09:14:16.806 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-14T09:14:17.083 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rgw. 2023-10-14T09:14:17.097 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:17.142 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:17.143 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-waitress. 2023-10-14T09:14:17.158 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-14T09:14:17.204 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-14T09:14:17.469 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-14T09:14:17.483 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-14T09:14:17.513 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempita. 2023-10-14T09:14:17.519 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-14T09:14:17.528 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-14T09:14:17.588 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-14T09:14:17.805 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libradosstriper1. 2023-10-14T09:14:17.819 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:17.863 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libradosstriper1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:17.890 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-paste. 2023-10-14T09:14:17.906 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-14T09:14:17.948 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-14T09:14:18.260 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-14T09:14:18.275 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-14T09:14:18.318 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-14T09:14:18.325 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-common. 2023-10-14T09:14:18.339 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:18.383 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:18.655 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-14T09:14:18.670 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-14T09:14:18.713 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-14T09:14:18.991 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webtest. 2023-10-14T09:14:19.006 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-14T09:14:19.041 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-14T09:14:19.352 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pecan. 2023-10-14T09:14:19.367 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-14T09:14:19.410 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-14T09:14:19.430 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-base. 2023-10-14T09:14:19.444 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:19.489 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-base (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:19.782 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-certifi. 2023-10-14T09:14:19.797 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-14T09:14:19.840 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-14T09:14:20.168 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-idna. 2023-10-14T09:14:20.183 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-14T09:14:20.226 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-14T09:14:20.334 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-14T09:14:20.347 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-14T09:14:20.422 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-14T09:14:20.512 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-urllib3. 2023-10-14T09:14:20.527 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-14T09:14:20.570 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-14T09:14:20.711 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cheroot. 2023-10-14T09:14:20.725 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-14T09:14:20.770 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-14T09:14:20.916 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests. 2023-10-14T09:14:20.930 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-14T09:14:20.974 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-14T09:14:21.073 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-14T09:14:21.086 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-14T09:14:21.123 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-14T09:14:21.268 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-14T09:14:21.283 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-14T09:14:21.318 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-14T09:14:21.425 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-14T09:14:21.439 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-14T09:14:21.484 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-14T09:14:21.605 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-14T09:14:21.619 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:21.663 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:21.811 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-14T09:14:21.826 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-14T09:14:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-14T09:14:22.076 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-14T09:14:22.090 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:22.134 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:22.172 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempora. 2023-10-14T09:14:22.187 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-14T09:14:22.223 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-14T09:14:22.445 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-openssl. 2023-10-14T09:14:22.460 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-14T09:14:22.492 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-portend. 2023-10-14T09:14:22.503 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-14T09:14:22.506 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-14T09:14:22.550 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-14T09:14:22.798 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr. 2023-10-14T09:14:22.813 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:22.848 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:22.886 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-14T09:14:22.901 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-14T09:14:22.945 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-14T09:14:23.247 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-14T09:14:23.260 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mon. 2023-10-14T09:14:23.262 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-14T09:14:23.275 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:23.305 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-14T09:14:23.318 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mon (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:23.634 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-natsort. 2023-10-14T09:14:23.648 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-14T09:14:23.692 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-14T09:14:24.029 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-logutils. 2023-10-14T09:14:24.043 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-14T09:14:24.087 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-14T09:14:24.138 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-osd. 2023-10-14T09:14:24.153 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:24.196 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-osd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:24.389 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-14T09:14:24.404 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-14T09:14:24.450 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-14T09:14:24.744 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-mako. 2023-10-14T09:14:24.759 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-14T09:14:24.802 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-14T09:14:25.164 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-14T09:14:25.179 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-14T09:14:25.222 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-14T09:14:26.109 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-14T09:14:26.124 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-14T09:14:26.141 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph. 2023-10-14T09:14:26.156 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../061-ceph_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:26.167 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-14T09:14:26.208 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:26.487 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webob. 2023-10-14T09:14:26.502 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-14T09:14:26.519 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-fuse. 2023-10-14T09:14:26.534 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:26.545 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-14T09:14:26.569 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:26.889 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mds. 2023-10-14T09:14:26.890 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-waitress. 2023-10-14T09:14:26.904 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:26.904 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-14T09:14:26.947 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mds (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:26.970 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-14T09:14:27.260 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempita. 2023-10-14T09:14:27.274 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-14T09:14:27.294 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephadm. 2023-10-14T09:14:27.309 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../064-cephadm_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:27.318 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-14T09:14:27.352 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:27.646 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-paste. 2023-10-14T09:14:27.647 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-14T09:14:27.661 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-14T09:14:27.662 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-14T09:14:27.697 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-14T09:14:27.704 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-14T09:14:28.008 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-14T09:14:28.022 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-14T09:14:28.024 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-14T09:14:28.039 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-14T09:14:28.066 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-14T09:14:28.082 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-14T09:14:28.394 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-14T09:14:28.408 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-14T09:14:28.443 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-14T09:14:28.738 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webtest. 2023-10-14T09:14:28.753 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-14T09:14:28.796 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-14T09:14:29.038 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-babel. 2023-10-14T09:14:29.052 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-14T09:14:29.083 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pecan. 2023-10-14T09:14:29.096 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-14T09:14:29.097 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-14T09:14:29.132 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-14T09:14:29.383 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jinja2. 2023-10-14T09:14:29.396 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-14T09:14:29.433 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-14T09:14:29.455 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-certifi. 2023-10-14T09:14:29.470 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-14T09:14:29.504 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-14T09:14:29.795 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-14T09:14:29.808 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:29.824 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-idna. 2023-10-14T09:14:29.839 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-14T09:14:29.853 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:29.907 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-14T09:14:30.165 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-14T09:14:30.179 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-14T09:14:30.223 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-14T09:14:30.227 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-urllib3. 2023-10-14T09:14:30.242 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-14T09:14:30.285 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-14T09:14:30.534 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-14T09:14:30.549 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-14T09:14:30.592 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-14T09:14:30.730 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests. 2023-10-14T09:14:30.745 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-14T09:14:30.789 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-14T09:14:30.895 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-routes. 2023-10-14T09:14:30.910 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-14T09:14:30.953 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-14T09:14:31.125 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-14T09:14:31.140 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-14T09:14:31.183 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-14T09:14:31.290 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-14T09:14:31.305 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:31.348 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-14T09:14:31.486 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:31.528 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:31.743 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-14T09:14:31.757 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-14T09:14:31.793 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-14T09:14:31.908 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-14T09:14:31.922 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:31.966 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:32.272 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-joblib. 2023-10-14T09:14:32.286 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-14T09:14:32.294 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-openssl. 2023-10-14T09:14:32.309 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-14T09:14:32.330 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-14T09:14:32.352 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-14T09:14:32.672 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr. 2023-10-14T09:14:32.687 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:32.700 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-14T09:14:32.714 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-14T09:14:32.722 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:32.758 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-14T09:14:33.070 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn. 2023-10-14T09:14:33.075 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mon. 2023-10-14T09:14:33.084 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-14T09:14:33.090 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:33.128 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-14T09:14:33.133 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mon (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:33.787 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-14T09:14:33.801 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:33.845 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:33.946 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-osd. 2023-10-14T09:14:33.960 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:34.004 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-osd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:34.815 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cachetools. 2023-10-14T09:14:34.830 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-14T09:14:34.873 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-14T09:14:35.199 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph. 2023-10-14T09:14:35.201 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-14T09:14:35.214 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../061-ceph_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:35.216 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-14T09:14:35.257 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:35.259 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-14T09:14:35.594 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-fuse. 2023-10-14T09:14:35.608 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:35.652 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:35.796 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-14T09:14:35.811 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-14T09:14:35.854 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-14T09:14:35.989 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mds. 2023-10-14T09:14:36.003 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:36.038 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mds (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:36.115 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rsa. 2023-10-14T09:14:36.130 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-14T09:14:36.190 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-14T09:14:36.408 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephadm. 2023-10-14T09:14:36.423 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../064-cephadm_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:36.466 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:36.595 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-google-auth. 2023-10-14T09:14:36.609 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-14T09:14:36.653 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-14T09:14:36.761 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-14T09:14:36.777 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-14T09:14:36.819 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-14T09:14:36.973 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-14T09:14:36.987 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-14T09:14:37.031 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-14T09:14:37.139 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-14T09:14:37.154 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-14T09:14:37.197 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-14T09:14:37.317 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-websocket. 2023-10-14T09:14:37.332 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-14T09:14:37.367 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-14T09:14:37.662 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-14T09:14:37.677 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-14T09:14:37.720 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-14T09:14:38.178 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-babel. 2023-10-14T09:14:38.192 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-14T09:14:38.236 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-14T09:14:38.392 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-14T09:14:38.406 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:38.450 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:38.531 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jinja2. 2023-10-14T09:14:38.544 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-14T09:14:38.589 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-14T09:14:38.762 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-14T09:14:38.777 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-14T09:14:38.812 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-14T09:14:38.917 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-14T09:14:38.931 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:38.984 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:39.123 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-14T09:14:39.139 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-14T09:14:39.181 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-14T09:14:39.354 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-14T09:14:39.368 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-14T09:14:39.413 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-14T09:14:39.467 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package jq. 2023-10-14T09:14:39.483 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-14T09:14:39.525 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-14T09:14:39.702 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-14T09:14:39.713 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-14T09:14:39.757 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-14T09:14:39.778 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package socat. 2023-10-14T09:14:39.794 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-14T09:14:39.836 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-14T09:14:40.035 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-routes. 2023-10-14T09:14:40.050 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-14T09:14:40.085 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-14T09:14:40.131 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package xmlstarlet. 2023-10-14T09:14:40.147 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-14T09:14:40.181 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-14T09:14:40.422 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-14T09:14:40.437 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:40.472 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:40.585 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-test. 2023-10-14T09:14:40.600 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:40.652 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-test (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:41.038 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-14T09:14:41.052 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-14T09:14:41.092 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-14T09:14:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-joblib. 2023-10-14T09:14:41.586 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-14T09:14:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-14T09:14:41.991 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-14T09:14:42.006 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-14T09:14:42.049 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-14T09:14:42.354 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn. 2023-10-14T09:14:42.368 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-14T09:14:42.411 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-14T09:14:42.448 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-volume. 2023-10-14T09:14:42.463 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:42.498 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-volume (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:42.869 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-14T09:14:42.884 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:42.918 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-mirror (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:43.053 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-14T09:14:43.067 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:43.103 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:43.230 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-colorama. 2023-10-14T09:14:43.246 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-14T09:14:43.288 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-14T09:14:43.549 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-shell. 2023-10-14T09:14:43.565 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:43.607 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-shell (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:43.860 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephfs-top. 2023-10-14T09:14:43.876 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:43.943 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephfs-top (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:44.056 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cachetools. 2023-10-14T09:14:44.071 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-14T09:14:44.114 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-14T09:14:44.180 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-14T09:14:44.195 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:44.229 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs-dev (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:44.417 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-14T09:14:44.433 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-14T09:14:44.476 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-14T09:14:44.566 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package nvme-cli. 2023-10-14T09:14:44.581 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-14T09:14:44.624 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-14T09:14:44.788 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-14T09:14:44.803 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-14T09:14:44.837 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-14T09:14:44.971 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-14T09:14:44.985 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-14T09:14:45.046 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-14T09:14:45.107 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rsa. 2023-10-14T09:14:45.122 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-14T09:14:45.156 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-14T09:14:45.465 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-14T09:14:45.479 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-14T09:14:45.523 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-14T09:14:45.587 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-google-auth. 2023-10-14T09:14:45.603 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-14T09:14:45.729 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-14T09:14:46.035 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastescript. 2023-10-14T09:14:46.051 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-14T09:14:46.057 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-14T09:14:46.072 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-14T09:14:46.115 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-14T09:14:46.118 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-14T09:14:46.427 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-websocket. 2023-10-14T09:14:46.438 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pluggy. 2023-10-14T09:14:46.442 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-14T09:14:46.453 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-14T09:14:46.485 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-14T09:14:46.496 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-14T09:14:46.774 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-psutil. 2023-10-14T09:14:46.789 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-14T09:14:46.805 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-14T09:14:46.821 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-14T09:14:46.823 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-14T09:14:46.855 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-14T09:14:47.135 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-py. 2023-10-14T09:14:47.151 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-14T09:14:47.210 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-14T09:14:47.519 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-14T09:14:47.530 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pygments. 2023-10-14T09:14:47.533 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:47.545 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-14T09:14:47.580 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-14T09:14:47.586 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:47.905 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-14T09:14:47.919 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-14T09:14:47.964 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-14T09:14:47.967 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-14T09:14:47.982 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-14T09:14:48.025 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-14T09:14:48.275 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-14T09:14:48.289 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-14T09:14:48.333 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-14T09:14:48.361 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-toml. 2023-10-14T09:14:48.376 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-14T09:14:48.419 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-14T09:14:48.570 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package jq. 2023-10-14T09:14:48.584 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-14T09:14:48.628 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-14T09:14:48.722 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pytest. 2023-10-14T09:14:48.738 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-14T09:14:48.780 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-14T09:14:48.889 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package socat. 2023-10-14T09:14:48.903 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-14T09:14:48.947 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-14T09:14:49.100 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplejson. 2023-10-14T09:14:49.116 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-14T09:14:49.158 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-14T09:14:49.258 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package xmlstarlet. 2023-10-14T09:14:49.273 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-14T09:14:49.317 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-14T09:14:49.461 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-14T09:14:49.477 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-14T09:14:49.519 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-14T09:14:49.663 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-test. 2023-10-14T09:14:49.677 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:49.721 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-test (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:50.157 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package radosgw. 2023-10-14T09:14:50.171 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../113-radosgw_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:50.206 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking radosgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:50.860 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package rbd-fuse. 2023-10-14T09:14:50.875 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:50.917 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking rbd-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:51.220 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-14T09:14:51.482 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-14T09:14:51.599 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-14T09:14:51.767 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-volume. 2023-10-14T09:14:51.782 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:51.817 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-volume (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:51.884 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-14T09:14:52.180 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-14T09:14:52.194 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:52.229 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-mirror (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:52.264 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-14T09:14:52.541 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-colorama. 2023-10-14T09:14:52.556 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-14T09:14:52.599 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-14T09:14:52.894 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-shell. 2023-10-14T09:14:52.909 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:52.923 INFO:teuthology.orchestra.run.smithi157.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-14T09:14:52.952 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-shell (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:52.977 INFO:teuthology.orchestra.run.smithi157.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-10-14T09:14:53.026 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:53.222 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-top. 2023-10-14T09:14:53.237 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6730-g4ba8a190-1jammy_all.deb ... 2023-10-14T09:14:53.272 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-top (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:53.491 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-14T09:14:53.506 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:53.549 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs-dev (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:53.828 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user cephadm....done 2023-10-14T09:14:53.944 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package nvme-cli. 2023-10-14T09:14:53.959 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-14T09:14:53.991 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-14T09:14:54.011 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-14T09:14:54.284 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-14T09:14:54.349 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-14T09:14:54.364 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-14T09:14:54.407 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-14T09:14:54.543 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-14T09:14:54.669 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-14T09:14:54.836 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-14T09:14:54.850 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-14T09:14:54.894 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-14T09:14:54.937 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-14T09:14:55.197 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-14T09:14:55.230 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastescript. 2023-10-14T09:14:55.245 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-14T09:14:55.288 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-14T09:14:55.297 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-14T09:14:55.609 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pluggy. 2023-10-14T09:14:55.623 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-14T09:14:55.633 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-14T09:14:55.667 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-14T09:14:55.945 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-psutil. 2023-10-14T09:14:55.960 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-14T09:14:55.995 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-14T09:14:56.235 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-14T09:14:56.340 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-py. 2023-10-14T09:14:56.355 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-14T09:14:56.390 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-14T09:14:56.503 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-14T09:14:56.701 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pygments. 2023-10-14T09:14:56.716 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-14T09:14:56.751 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-14T09:14:56.779 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-14T09:14:57.055 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-14T09:14:57.189 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-14T09:14:57.203 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-14T09:14:57.247 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-14T09:14:57.348 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-14T09:14:57.567 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-toml. 2023-10-14T09:14:57.581 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-14T09:14:57.624 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-14T09:14:57.624 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-14T09:14:57.900 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-argparse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:57.936 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pytest. 2023-10-14T09:14:57.950 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-14T09:14:57.994 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-14T09:14:58.159 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-14T09:14:58.310 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-14T09:14:58.314 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplejson. 2023-10-14T09:14:58.329 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-14T09:14:58.372 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-14T09:14:58.578 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-14T09:14:58.667 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-14T09:14:58.681 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-14T09:14:58.734 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-14T09:14:58.854 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-14T09:14:58.980 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-14T09:14:59.348 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-14T09:14:59.404 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package radosgw. 2023-10-14T09:14:59.418 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../113-radosgw_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:14:59.463 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking radosgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:14:59.473 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-14T09:14:59.866 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-14T09:15:00.024 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package rbd-fuse. 2023-10-14T09:15:00.038 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6730-g4ba8a190-1jammy_amd64.deb ... 2023-10-14T09:15:00.082 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking rbd-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:00.134 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-14T09:15:00.367 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-14T09:15:00.444 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-14T09:15:00.637 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-14T09:15:00.747 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-14T09:15:01.005 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-14T09:15:01.146 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-14T09:15:01.376 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-14T09:15:01.397 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-14T09:15:01.540 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-14T09:15:01.665 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-14T09:15:01.981 INFO:teuthology.orchestra.run.smithi078.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-14T09:15:01.983 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-14T09:15:02.191 INFO:teuthology.orchestra.run.smithi078.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-10-14T09:15:02.240 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:02.393 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-14T09:15:02.654 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-14T09:15:02.804 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user cephadm....done 2023-10-14T09:15:02.940 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-14T09:15:03.046 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-14T09:15:03.233 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-14T09:15:03.347 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-14T09:15:03.493 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-14T09:15:03.619 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-14T09:15:03.673 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-14T09:15:03.878 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-14T09:15:04.033 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-14T09:15:04.138 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-14T09:15:04.247 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-14T09:15:04.284 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-14T09:15:04.385 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:04.549 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-14T09:15:04.686 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-idna (3.3-1) ... 2023-10-14T09:15:04.918 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-14T09:15:05.054 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-14T09:15:05.178 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-14T09:15:05.429 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-14T09:15:05.739 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-14T09:15:05.998 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-14T09:15:06.258 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-14T09:15:06.293 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:15:06.438 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-14T09:15:06.533 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-argparse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:06.802 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-14T09:15:06.912 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-14T09:15:06.927 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-14T09:15:07.029 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-14T09:15:07.130 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-14T09:15:07.178 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-14T09:15:07.440 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-14T09:15:07.579 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-14T09:15:07.714 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-14T09:15:07.716 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-14T09:15:08.009 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:15:08.082 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-14T09:15:08.118 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-14T09:15:08.216 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-14T09:15:08.252 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-14T09:15:08.492 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-14T09:15:08.562 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-14T09:15:08.768 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-14T09:15:08.822 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-14T09:15:09.086 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-14T09:15:09.106 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-14T09:15:09.374 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-14T09:15:09.642 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-14T09:15:09.764 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-14T09:15:09.918 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-14T09:15:10.031 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-14T09:15:10.043 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-14T09:15:10.183 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-14T09:15:10.308 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-14T09:15:10.353 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-14T09:15:10.479 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-14T09:15:10.626 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-14T09:15:10.797 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-14T09:15:11.028 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-14T09:15:11.106 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-14T09:15:11.288 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-14T09:15:11.374 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-14T09:15:11.697 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-14T09:15:11.761 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-14T09:15:11.982 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-14T09:15:12.010 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-14T09:15:12.122 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-14T09:15:12.300 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-14T09:15:12.523 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-14T09:15:12.660 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-14T09:15:12.791 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-14T09:15:12.919 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-14T09:15:13.045 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:13.050 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:15:13.159 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-14T09:15:13.346 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-idna (3.3-1) ... 2023-10-14T09:15:13.486 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-14T09:15:13.689 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-14T09:15:13.795 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-14T09:15:14.080 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-14T09:15:14.206 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-14T09:15:14.482 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-14T09:15:14.774 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-14T09:15:14.903 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:15:15.030 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-14T09:15:15.051 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-14T09:15:15.289 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-14T09:15:15.398 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-14T09:15:15.427 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-14T09:15:15.525 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-14T09:15:15.720 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-14T09:15:15.834 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-14T09:15:16.072 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-14T09:15:16.102 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-14T09:15:16.198 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librados2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:16.316 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librgw2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:16.362 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:15:16.487 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-14T09:15:16.519 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:16.597 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-14T09:15:16.637 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:16.779 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libradosstriper1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:16.890 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-14T09:15:16.905 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-14T09:15:17.166 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-14T09:15:17.199 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librbd1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:17.325 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-modules-core (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:17.451 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:17.484 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-14T09:15:17.660 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-14T09:15:17.660 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-14T09:15:17.752 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-14T09:15:18.011 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-14T09:15:18.286 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs-dev (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:18.287 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-14T09:15:18.411 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rados (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:18.430 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-14T09:15:18.546 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-top (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:18.672 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-14T09:15:18.698 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-14T09:15:18.824 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-14T09:15:19.126 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-14T09:15:19.435 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-14T09:15:19.694 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-14T09:15:19.960 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rbd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:20.086 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up rbd-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:20.119 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-14T09:15:20.212 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:20.346 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cephfs (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:20.364 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-14T09:15:20.473 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-shell (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:20.490 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-14T09:15:20.598 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:20.883 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-14T09:15:21.144 INFO:teuthology.orchestra.run.smithi157.stdout:Adding group ceph....done 2023-10-14T09:15:21.159 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-14T09:15:21.419 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-14T09:15:21.528 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user ceph....done 2023-10-14T09:15:21.545 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-14T09:15:21.715 INFO:teuthology.orchestra.run.smithi157.stdout:Setting system user ceph properties....done 2023-10-14T09:15:21.731 INFO:teuthology.orchestra.run.smithi157.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-14T09:15:21.871 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-14T09:15:21.874 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-14T09:15:22.223 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-14T09:15:22.258 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-14T09:15:22.499 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-14T09:15:22.624 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-14T09:15:22.901 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-14T09:15:22.933 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephfs-mirror (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:23.141 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-14T09:15:23.142 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-14T09:15:23.169 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-14T09:15:23.428 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-14T09:15:23.794 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-test (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:23.821 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-14T09:15:23.918 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up radosgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:24.106 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-14T09:15:24.458 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-14T09:15:24.459 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-14T09:15:24.459 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-14T09:15:24.584 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librados2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:24.710 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librgw2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:24.914 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:25.015 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs2 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:25.070 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-base (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:25.141 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libradosstriper1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:25.267 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-14T09:15:25.431 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-14T09:15:25.552 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librbd1 (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:25.662 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-modules-core (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:25.788 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:25.998 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-14T09:15:25.999 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-14T09:15:26.081 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mds (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:26.303 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-14T09:15:26.303 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-14T09:15:26.598 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs-dev (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:26.707 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rados (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:26.833 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-top (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:26.959 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-14T09:15:27.191 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:27.430 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-14T09:15:27.431 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-14T09:15:28.051 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-osd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:28.239 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rbd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:28.365 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up rbd-fuse (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:28.379 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-14T09:15:28.379 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-14T09:15:28.491 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:28.617 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cephfs (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:28.735 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-shell (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:28.844 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-common (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:29.011 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:29.129 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:29.246 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mon (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:29.432 INFO:teuthology.orchestra.run.smithi078.stdout:Adding group ceph....done 2023-10-14T09:15:29.448 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-14T09:15:29.448 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-14T09:15:29.816 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user ceph....done 2023-10-14T09:15:29.985 INFO:teuthology.orchestra.run.smithi078.stdout:Setting system user ceph properties....done 2023-10-14T09:15:30.002 INFO:teuthology.orchestra.run.smithi078.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-14T09:15:30.089 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:30.142 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-14T09:15:30.232 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:30.358 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-dashboard (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:30.501 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-volume (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:30.515 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-14T09:15:30.870 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-14T09:15:31.188 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-mirror (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:31.497 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-14T09:15:31.498 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-14T09:15:32.089 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-test (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:32.121 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-14T09:15:32.215 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up radosgw (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:32.662 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-14T09:15:32.667 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-14T09:15:32.742 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2023-10-14T09:15:32.763 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-14T09:15:32.763 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-14T09:15:32.906 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2023-10-14T09:15:32.907 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2023-10-14T09:15:33.055 INFO:teuthology.orchestra.run.smithi157.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-14T09:15:33.055 INFO:teuthology.orchestra.run.smithi157.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-14T09:15:33.056 INFO:teuthology.orchestra.run.smithi157.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-14T09:15:33.056 INFO:teuthology.orchestra.run.smithi157.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-14T09:15:33.056 INFO:teuthology.orchestra.run.smithi157.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-14T09:15:33.056 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2023-10-14T09:15:33.057 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-14T09:15:33.057 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-14T09:15:33.057 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-14T09:15:33.057 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-14T09:15:33.057 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-14T09:15:33.058 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-14T09:15:33.059 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2023-10-14T09:15:33.059 INFO:teuthology.orchestra.run.smithi157.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-14T09:15:33.059 INFO:teuthology.orchestra.run.smithi157.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-14T09:15:33.060 INFO:teuthology.orchestra.run.smithi157.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-14T09:15:33.060 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-14T09:15:33.060 INFO:teuthology.orchestra.run.smithi157.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-14T09:15:33.060 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2023-10-14T09:15:33.060 INFO:teuthology.orchestra.run.smithi157.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-14T09:15:33.061 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-14T09:15:33.061 INFO:teuthology.orchestra.run.smithi157.stdout: libengine-pkcs11-openssl 2023-10-14T09:15:33.106 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2023-10-14T09:15:33.108 INFO:teuthology.orchestra.run.smithi157.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-14T09:15:33.108 INFO:teuthology.orchestra.run.smithi157.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-14T09:15:33.108 INFO:teuthology.orchestra.run.smithi157.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-14T09:15:33.108 INFO:teuthology.orchestra.run.smithi157.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-14T09:15:33.108 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-14T09:15:33.109 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-14T09:15:33.109 INFO:teuthology.orchestra.run.smithi157.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-14T09:15:33.109 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2023-10-14T09:15:33.110 INFO:teuthology.orchestra.run.smithi157.stdout: libssl3 2023-10-14T09:15:33.295 INFO:teuthology.orchestra.run.smithi157.stdout:1 upgraded, 39 newly installed, 0 to remove and 258 not upgraded. 2023-10-14T09:15:33.296 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 54.6 MB of archives. 2023-10-14T09:15:33.296 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-14T09:15:33.296 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-14T09:15:33.342 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-base (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:33.701 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-14T09:15:33.796 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-14T09:15:34.053 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-14T09:15:34.089 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-14T09:15:34.091 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-14T09:15:34.096 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-14T09:15:34.099 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-14T09:15:34.100 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-14T09:15:34.103 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-14T09:15:34.105 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-14T09:15:34.270 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-14T09:15:34.270 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-14T09:15:34.310 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mds (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:34.521 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-14T09:15:34.534 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-14T09:15:34.534 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-14T09:15:35.162 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:35.360 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-14T09:15:35.360 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-14T09:15:35.520 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-14T09:15:35.522 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-14T09:15:35.550 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-14T09:15:35.552 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-14T09:15:35.553 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-14T09:15:35.557 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-14T09:15:35.559 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-14T09:15:35.586 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-14T09:15:35.750 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-14T09:15:35.964 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-osd (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:36.268 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-14T09:15:36.269 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-14T09:15:36.496 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-14T09:15:36.496 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-14T09:15:36.522 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-14T09:15:36.601 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-14T09:15:36.609 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-14T09:15:36.610 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-14T09:15:36.611 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-14T09:15:36.612 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-14T09:15:36.641 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-14T09:15:36.643 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-14T09:15:36.858 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:36.983 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:37.151 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mon (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:37.269 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-14T09:15:37.354 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-14T09:15:37.354 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-14T09:15:37.354 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-14T09:15:37.355 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-14T09:15:37.355 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-14T09:15:37.442 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-14T09:15:37.447 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-14T09:15:37.911 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-14T09:15:37.913 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-14T09:15:37.961 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-cephadm (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:38.096 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:38.300 INFO:teuthology.orchestra.run.smithi157.stdout:Preconfiguring packages ... 2023-10-14T09:15:38.439 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 54.6 MB in 5s (11.4 MB/s) 2023-10-14T09:15:38.514 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-dashboard (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:38.581 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package flex. 2023-10-14T09:15:38.652 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139851 files and directories currently installed.) 2023-10-14T09:15:38.656 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-14T09:15:38.656 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-volume (18.0.0-6730-g4ba8a190-1jammy) ... 2023-10-14T09:15:38.696 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-14T09:15:39.009 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-14T09:15:39.248 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-14T09:15:39.418 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-14T09:15:39.840 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T09:15:40.077 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-14T09:15:40.385 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package bison. 2023-10-14T09:15:40.458 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139924 files and directories currently installed.) 2023-10-14T09:15:40.462 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-14T09:15:40.512 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-14T09:15:40.540 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-14T09:15:40.544 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-14T09:15:40.618 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-10-14T09:15:40.781 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-10-14T09:15:40.782 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-10-14T09:15:40.927 INFO:teuthology.orchestra.run.smithi078.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-14T09:15:40.927 INFO:teuthology.orchestra.run.smithi078.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-14T09:15:40.927 INFO:teuthology.orchestra.run.smithi078.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-14T09:15:40.927 INFO:teuthology.orchestra.run.smithi078.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-14T09:15:40.928 INFO:teuthology.orchestra.run.smithi078.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-14T09:15:40.928 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-10-14T09:15:40.928 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-14T09:15:40.928 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-14T09:15:40.928 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-14T09:15:40.929 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-14T09:15:40.930 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-14T09:15:40.930 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-14T09:15:40.930 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-10-14T09:15:40.930 INFO:teuthology.orchestra.run.smithi078.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-14T09:15:40.931 INFO:teuthology.orchestra.run.smithi078.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-14T09:15:40.931 INFO:teuthology.orchestra.run.smithi078.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-14T09:15:40.931 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-14T09:15:40.931 INFO:teuthology.orchestra.run.smithi078.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-14T09:15:40.931 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-10-14T09:15:40.932 INFO:teuthology.orchestra.run.smithi078.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-14T09:15:40.932 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-14T09:15:40.932 INFO:teuthology.orchestra.run.smithi078.stdout: libengine-pkcs11-openssl 2023-10-14T09:15:40.932 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-14T09:15:40.944 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-14T09:15:40.977 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-10-14T09:15:40.978 INFO:teuthology.orchestra.run.smithi078.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-14T09:15:40.978 INFO:teuthology.orchestra.run.smithi078.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-14T09:15:40.979 INFO:teuthology.orchestra.run.smithi078.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-14T09:15:40.979 INFO:teuthology.orchestra.run.smithi078.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-14T09:15:40.979 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-14T09:15:40.979 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-14T09:15:40.979 INFO:teuthology.orchestra.run.smithi078.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-14T09:15:40.980 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2023-10-14T09:15:40.980 INFO:teuthology.orchestra.run.smithi078.stdout: libssl3 2023-10-14T09:15:40.988 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-14T09:15:41.037 INFO:teuthology.orchestra.run.smithi078.stdout:1 upgraded, 39 newly installed, 0 to remove and 258 not upgraded. 2023-10-14T09:15:41.038 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 54.6 MB of archives. 2023-10-14T09:15:41.038 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-14T09:15:41.038 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-14T09:15:41.139 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-10-14T09:15:41.195 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-14T09:15:41.202 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-14T09:15:41.203 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-14T09:15:41.205 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-14T09:15:41.206 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-14T09:15:41.206 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-14T09:15:41.207 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-14T09:15:41.208 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-14T09:15:41.209 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-14T09:15:41.214 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-14T09:15:41.226 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-14T09:15:41.283 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package dump. 2023-10-14T09:15:41.297 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-14T09:15:41.333 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking dump (0.4b47-3) ... 2023-10-14T09:15:41.450 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-14T09:15:41.453 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-14T09:15:41.453 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-14T09:15:41.456 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-14T09:15:41.457 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-14T09:15:41.461 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-14T09:15:41.463 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-14T09:15:41.470 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-14T09:15:41.471 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-10-14T09:15:41.492 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-14T09:15:41.493 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-14T09:15:41.503 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-14T09:15:41.525 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-14T09:15:41.529 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-14T09:15:41.530 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-14T09:15:41.530 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-14T09:15:41.531 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-14T09:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-14T09:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-14T09:15:41.595 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package indent. 2023-10-14T09:15:41.609 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:41.661 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-14T09:15:41.697 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-14T09:15:41.697 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-14T09:15:41.698 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-14T09:15:41.698 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-14T09:15:41.699 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-14T09:15:41.699 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-14T09:15:41.711 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-14T09:15:41.711 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-14T09:15:41.955 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-14T09:15:41.970 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-14T09:15:42.014 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-14T09:15:42.096 INFO:teuthology.orchestra.run.smithi078.stdout:Preconfiguring packages ... 2023-10-14T09:15:42.258 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 54.6 MB in 1s (75.3 MB/s) 2023-10-14T09:15:42.326 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-14T09:15:42.340 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-14T09:15:42.384 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-14T09:15:42.401 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package flex. 2023-10-14T09:15:42.474 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139851 files and directories currently installed.) 2023-10-14T09:15:42.478 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-14T09:15:42.567 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-14T09:15:42.620 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-14T09:15:42.635 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-14T09:15:42.678 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-14T09:15:43.053 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-14T09:15:43.057 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-14T09:15:43.072 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-14T09:15:43.115 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-14T09:15:43.223 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-10-14T09:15:43.384 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-14T09:15:43.399 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-14T09:15:43.442 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-14T09:15:43.629 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T09:15:43.712 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjson-perl. 2023-10-14T09:15:43.727 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-14T09:15:43.762 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-14T09:15:44.065 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-14T09:15:44.080 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-14T09:15:44.123 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-14T09:15:44.151 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package bison. 2023-10-14T09:15:44.211 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139924 files and directories currently installed.) 2023-10-14T09:15:44.215 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-14T09:15:44.260 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-14T09:15:44.694 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-14T09:15:44.708 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-14T09:15:44.752 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-14T09:15:45.088 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package dump. 2023-10-14T09:15:45.103 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-14T09:15:45.147 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking dump (0.4b47-3) ... 2023-10-14T09:15:45.434 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package indent. 2023-10-14T09:15:45.449 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:45.476 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-14T09:15:45.491 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-14T09:15:45.501 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-14T09:15:45.534 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T09:15:45.753 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-14T09:15:45.761 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-14T09:15:45.768 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-14T09:15:45.777 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-14T09:15:45.803 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-14T09:15:45.820 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T09:15:46.106 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-14T09:15:46.121 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-14T09:15:46.140 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-14T09:15:46.156 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-14T09:15:46.188 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T09:15:46.199 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-14T09:15:46.443 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-14T09:15:46.458 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-14T09:15:46.501 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-14T09:15:46.508 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-14T09:15:46.524 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-14T09:15:46.567 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-14T09:15:46.838 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-14T09:15:46.853 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-14T09:15:46.894 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-14T09:15:46.896 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-14T09:15:46.910 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-14T09:15:46.952 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-14T09:15:47.132 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-14T09:15:47.147 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-14T09:15:47.190 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-14T09:15:47.289 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-14T09:15:47.304 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:47.338 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:15:47.443 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjson-perl. 2023-10-14T09:15:47.458 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-14T09:15:47.501 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-14T09:15:47.675 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-14T09:15:47.690 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:47.733 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T09:15:47.898 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-14T09:15:47.914 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-14T09:15:47.948 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-14T09:15:48.061 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-14T09:15:48.077 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:48.119 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T09:15:48.388 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-14T09:15:48.404 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-14T09:15:48.447 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T09:15:48.958 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-14T09:15:48.974 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-14T09:15:49.017 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-14T09:15:49.310 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-14T09:15:49.325 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-14T09:15:49.368 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T09:15:49.369 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package modemmanager. 2023-10-14T09:15:49.385 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-14T09:15:49.455 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T09:15:49.629 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-14T09:15:49.644 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-14T09:15:49.687 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T09:15:49.998 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-14T09:15:50.014 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-14T09:15:50.048 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T09:15:50.050 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package network-manager. 2023-10-14T09:15:50.066 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-14T09:15:50.117 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-14T09:15:50.384 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-14T09:15:50.399 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-14T09:15:50.443 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-14T09:15:50.741 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ppp. 2023-10-14T09:15:50.755 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-14T09:15:50.770 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-14T09:15:50.786 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-14T09:15:50.828 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-14T09:15:51.123 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-14T09:15:51.182 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-14T09:15:51.197 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:51.240 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:15:51.446 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package pptp-linux. 2023-10-14T09:15:51.460 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-14T09:15:51.504 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-14T09:15:51.559 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-14T09:15:51.574 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:51.617 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T09:15:51.765 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-14T09:15:51.779 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-14T09:15:51.814 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-14T09:15:51.912 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-14T09:15:51.926 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:51.970 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T09:15:52.068 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-14T09:15:52.082 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-14T09:15:52.126 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client-common (238) ... 2023-10-14T09:15:52.214 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-14T09:15:52.229 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-10-14T09:15:52.272 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T09:15:52.421 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-14T09:15:52.436 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:52.471 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:15:52.802 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-14T09:15:52.817 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-14T09:15:52.860 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-14T09:15:53.051 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-common. 2023-10-14T09:15:53.065 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-14T09:15:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-14T09:15:53.149 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-common (238) ... 2023-10-14T09:15:53.171 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package modemmanager. 2023-10-14T09:15:53.186 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-14T09:15:53.221 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T09:15:53.583 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-14. 2023-10-14T09:15:53.598 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:53.644 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:15:53.861 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager. 2023-10-14T09:15:53.877 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-14T09:15:53.927 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-14T09:15:54.495 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ppp. 2023-10-14T09:15:54.510 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-14T09:15:54.834 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-14T09:15:54.896 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql. 2023-10-14T09:15:54.911 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-14T09:15:54.971 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql (14+238) ... 2023-10-14T09:15:55.182 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pptp-linux. 2023-10-14T09:15:55.196 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-14T09:15:55.206 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-client. 2023-10-14T09:15:55.221 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-14T09:15:55.240 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-14T09:15:55.257 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-client (14+238) ... 2023-10-14T09:15:55.484 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-14T09:15:55.499 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-14T09:15:55.518 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-14T09:15:55.532 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-14T09:15:55.542 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-14T09:15:55.576 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-14T09:15:55.854 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-14T09:15:55.861 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package tcl8.6. 2023-10-14T09:15:55.869 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-14T09:15:55.876 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-14T09:15:55.904 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-common (238) ... 2023-10-14T09:15:55.920 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-14T09:15:56.214 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package tcl. 2023-10-14T09:15:56.216 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-14T09:15:56.230 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-14T09:15:56.230 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:56.274 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:15:56.277 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-14T09:15:56.609 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package wpasupplicant. 2023-10-14T09:15:56.624 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-14T09:15:56.658 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-14T09:15:56.846 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-common. 2023-10-14T09:15:56.860 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-14T09:15:56.921 INFO:teuthology.orchestra.run.smithi078.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-14T09:15:56.952 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-common (238) ... 2023-10-14T09:15:56.996 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-14T09:15:57.011 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-14T09:15:57.054 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-14T09:15:57.457 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-14T09:15:57.469 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-14. 2023-10-14T09:15:57.473 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-14T09:15:57.484 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-14T09:15:57.524 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-14T09:15:57.530 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:15:57.808 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client-common (238) ... 2023-10-14T09:15:58.030 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-14T09:15:58.156 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-14T09:15:58.307 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:15:58.425 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-14T09:15:58.542 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-14T09:15:58.651 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:15:58.715 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql. 2023-10-14T09:15:58.730 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-14T09:15:58.764 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql (14+238) ... 2023-10-14T09:15:59.358 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client. 2023-10-14T09:15:59.373 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-14T09:15:59.417 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client (14+238) ... 2023-10-14T09:15:59.659 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-14T09:15:59.694 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-14T09:15:59.709 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-14T09:15:59.752 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-14T09:15:59.760 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-14T09:16:00.071 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl8.6. 2023-10-14T09:16:00.087 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-14T09:16:00.113 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-14T09:16:00.114 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-14T09:16:00.129 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-14T09:16:00.382 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl. 2023-10-14T09:16:00.398 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-14T09:16:00.437 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-14T09:16:00.819 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-14T09:16:00.827 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package wpasupplicant. 2023-10-14T09:16:00.842 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-14T09:16:00.885 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-14T09:16:00.970 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T09:16:01.130 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-14T09:16:01.222 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-14T09:16:01.238 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-14T09:16:01.280 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-14T09:16:01.298 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-14T09:16:01.424 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-14T09:16:01.583 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-14T09:16:01.658 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-14T09:16:01.674 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-14T09:16:01.726 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-14T09:16:01.826 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-14T09:16:02.017 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-common (238) ... 2023-10-14T09:16:02.222 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-14T09:16:02.332 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-14T09:16:02.441 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:16:02.567 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-14T09:16:02.693 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-14T09:16:02.819 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:16:03.064 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-14T09:16:03.308 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up dump (0.4b47-3) ... 2023-10-14T09:16:03.479 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-14T09:16:03.594 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T09:16:03.763 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-14T09:16:03.819 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-14T09:16:03.914 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-14T09:16:03.925 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-14T09:16:04.304 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-14T09:16:04.305 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-14T09:16:04.382 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-14T09:16:04.508 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-14T09:16:04.615 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-14T09:16:04.722 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-14T09:16:04.869 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-14T09:16:04.970 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-14T09:16:05.079 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-14T09:16:05.112 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-10-14T09:16:05.230 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T09:16:05.238 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-14T09:16:05.364 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-14T09:16:05.381 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-14T09:16:05.523 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-14T09:16:05.566 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-client (14+238) ... 2023-10-14T09:16:05.624 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-14T09:16:05.683 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-14T09:16:05.750 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-14T09:16:06.268 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:06.268 INFO:teuthology.orchestra.run.smithi157.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-14T09:16:06.269 INFO:teuthology.orchestra.run.smithi157.stdout:which means they are currently configured by ifupdown: 2023-10-14T09:16:06.269 INFO:teuthology.orchestra.run.smithi157.stdout:- enp3s0f1 2023-10-14T09:16:06.269 INFO:teuthology.orchestra.run.smithi157.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-14T09:16:06.269 INFO:teuthology.orchestra.run.smithi157.stdout:remove their configuration from /etc/network/interfaces. 2023-10-14T09:16:06.269 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:06.403 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-14T09:16:06.464 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-14T09:16:06.581 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up dump (0.4b47-3) ... 2023-10-14T09:16:06.702 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-14T09:16:06.758 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T09:16:06.796 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-14T09:16:06.884 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-14T09:16:07.010 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-14T09:16:07.136 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-14T09:16:07.211 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-14T09:16:07.262 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-14T09:16:07.351 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-14T09:16:07.421 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-14T09:16:07.547 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-14T09:16:07.707 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-14T09:16:07.841 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T09:16:07.919 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T09:16:07.959 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-14T09:16:08.079 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-14T09:16:08.135 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client (14+238) ... 2023-10-14T09:16:08.205 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-14T09:16:08.261 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-14T09:16:08.339 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-common (238) ... 2023-10-14T09:16:08.826 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:08.827 INFO:teuthology.orchestra.run.smithi078.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-14T09:16:08.827 INFO:teuthology.orchestra.run.smithi078.stdout:which means they are currently configured by ifupdown: 2023-10-14T09:16:08.827 INFO:teuthology.orchestra.run.smithi078.stdout:- enp3s0f1 2023-10-14T09:16:08.827 INFO:teuthology.orchestra.run.smithi078.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-14T09:16:08.828 INFO:teuthology.orchestra.run.smithi078.stdout:remove their configuration from /etc/network/interfaces. 2023-10-14T09:16:08.828 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:08.959 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-14T09:16:09.237 INFO:teuthology.orchestra.run.smithi157.stdout:Adding user postgres to group ssl-cert 2023-10-14T09:16:09.337 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-14T09:16:09.494 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:09.494 INFO:teuthology.orchestra.run.smithi157.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-14T09:16:09.739 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-14T09:16:09.782 INFO:teuthology.orchestra.run.smithi157.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-14T09:16:09.782 INFO:teuthology.orchestra.run.smithi157.stdout:Removing obsolete dictionary files: 2023-10-14T09:16:10.464 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-14T09:16:10.498 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-14T09:16:10.615 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-14T09:16:10.741 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-14T09:16:10.859 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-common (238) ... 2023-10-14T09:16:10.983 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:16:11.313 INFO:teuthology.orchestra.run.smithi157.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-14T09:16:11.345 INFO:teuthology.orchestra.run.smithi157.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-14T09:16:11.408 INFO:teuthology.orchestra.run.smithi157.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-14T09:16:11.409 INFO:teuthology.orchestra.run.smithi157.stdout:This user must also own the server process. 2023-10-14T09:16:11.409 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:11.409 INFO:teuthology.orchestra.run.smithi157.stdout:The database cluster will be initialized with locale "en_US". 2023-10-14T09:16:11.409 INFO:teuthology.orchestra.run.smithi157.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-14T09:16:11.410 INFO:teuthology.orchestra.run.smithi157.stdout:The default text search configuration will be set to "english". 2023-10-14T09:16:11.410 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:11.410 INFO:teuthology.orchestra.run.smithi157.stdout:Data page checksums are disabled. 2023-10-14T09:16:11.410 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:11.410 INFO:teuthology.orchestra.run.smithi157.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-14T09:16:11.411 INFO:teuthology.orchestra.run.smithi157.stdout:creating subdirectories ... ok 2023-10-14T09:16:11.411 INFO:teuthology.orchestra.run.smithi157.stdout:selecting dynamic shared memory implementation ... posix 2023-10-14T09:16:11.434 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default max_connections ... 100 2023-10-14T09:16:11.470 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default shared_buffers ... 128MB 2023-10-14T09:16:11.484 INFO:teuthology.orchestra.run.smithi157.stdout:selecting default time zone ... Etc/UTC 2023-10-14T09:16:11.484 INFO:teuthology.orchestra.run.smithi157.stdout:creating configuration files ... ok 2023-10-14T09:16:11.653 INFO:teuthology.orchestra.run.smithi157.stdout:running bootstrap script ... ok 2023-10-14T09:16:11.766 INFO:teuthology.orchestra.run.smithi078.stdout:Adding user postgres to group ssl-cert 2023-10-14T09:16:12.042 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:12.043 INFO:teuthology.orchestra.run.smithi078.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-14T09:16:12.300 INFO:teuthology.orchestra.run.smithi157.stdout:performing post-bootstrap initialization ... ok 2023-10-14T09:16:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-14T09:16:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:Removing obsolete dictionary files: 2023-10-14T09:16:12.831 INFO:teuthology.orchestra.run.smithi157.stdout:syncing data to disk ... ok 2023-10-14T09:16:13.028 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-14T09:16:13.371 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-14T09:16:13.476 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-14T09:16:13.822 INFO:teuthology.orchestra.run.smithi078.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-14T09:16:13.843 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-14T09:16:13.888 INFO:teuthology.orchestra.run.smithi078.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-14T09:16:13.888 INFO:teuthology.orchestra.run.smithi078.stdout:This user must also own the server process. 2023-10-14T09:16:13.888 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:13.889 INFO:teuthology.orchestra.run.smithi078.stdout:The database cluster will be initialized with locale "en_US". 2023-10-14T09:16:13.889 INFO:teuthology.orchestra.run.smithi078.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-14T09:16:13.889 INFO:teuthology.orchestra.run.smithi078.stdout:The default text search configuration will be set to "english". 2023-10-14T09:16:13.889 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:13.889 INFO:teuthology.orchestra.run.smithi078.stdout:Data page checksums are disabled. 2023-10-14T09:16:13.890 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:13.890 INFO:teuthology.orchestra.run.smithi078.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-14T09:16:13.891 INFO:teuthology.orchestra.run.smithi078.stdout:creating subdirectories ... ok 2023-10-14T09:16:13.891 INFO:teuthology.orchestra.run.smithi078.stdout:selecting dynamic shared memory implementation ... posix 2023-10-14T09:16:13.913 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default max_connections ... 100 2023-10-14T09:16:13.949 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default shared_buffers ... 128MB 2023-10-14T09:16:13.963 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default time zone ... Etc/UTC 2023-10-14T09:16:13.964 INFO:teuthology.orchestra.run.smithi078.stdout:creating configuration files ... ok 2023-10-14T09:16:14.132 INFO:teuthology.orchestra.run.smithi078.stdout:running bootstrap script ... ok 2023-10-14T09:16:14.752 INFO:teuthology.orchestra.run.smithi078.stdout:performing post-bootstrap initialization ... ok 2023-10-14T09:16:15.278 INFO:teuthology.orchestra.run.smithi078.stdout:syncing data to disk ... ok 2023-10-14T09:16:15.794 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-14T09:16:16.457 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T09:16:16.583 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-14T09:16:16.734 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up postgresql (14+238) ... 2023-10-14T09:16:16.835 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T09:16:16.953 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T09:16:17.215 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-14T09:16:17.215 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-14T09:16:17.980 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-14T09:16:18.282 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-14T09:16:18.434 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-14T09:16:19.159 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T09:16:19.260 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-14T09:16:19.386 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql (14+238) ... 2023-10-14T09:16:19.529 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-14T09:16:19.552 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-14T09:16:19.644 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-14T09:16:19.963 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-14T09:16:20.221 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-14T09:16:20.221 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-14T09:16:20.315 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-14T09:16:20.320 DEBUG:teuthology.parallel:result is None 2023-10-14T09:16:20.965 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-14T09:16:21.283 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-14T09:16:21.437 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-14T09:16:22.821 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-14T09:16:22.921 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-14T09:16:23.615 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-14T09:16:23.620 DEBUG:teuthology.parallel:result is None 2023-10-14T09:16:23.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T09:16:23.843 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-query -W -f '${Version}' ceph 2023-10-14T09:16:23.865 INFO:teuthology.orchestra.run.smithi078.stdout:18.0.0-6730-g4ba8a190-1jammy 2023-10-14T09:16:23.866 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730-g4ba8a190-1jammy 2023-10-14T09:16:23.866 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730-g4ba8a190-1jammy is installed. 2023-10-14T09:16:23.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T09:16:24.002 DEBUG:teuthology.orchestra.run.smithi157:> dpkg-query -W -f '${Version}' ceph 2023-10-14T09:16:24.027 INFO:teuthology.orchestra.run.smithi157.stdout:18.0.0-6730-g4ba8a190-1jammy 2023-10-14T09:16:24.027 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730-g4ba8a190-1jammy 2023-10-14T09:16:24.027 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730-g4ba8a190-1jammy is installed. 2023-10-14T09:16:24.028 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T09:16:24.028 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:24.029 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T09:16:24.049 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:24.050 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T09:16:24.091 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T09:16:24.092 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:24.092 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T09:16:24.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T09:16:24.174 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:24.174 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T09:16:24.197 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T09:16:24.259 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T09:16:24.259 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:24.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T09:16:24.280 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T09:16:24.342 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:24.343 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T09:16:24.365 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T09:16:24.427 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T09:16:24.427 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:24.427 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T09:16:24.447 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T09:16:24.510 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:24.511 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T09:16:24.532 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T09:16:24.595 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T09:16:24.663 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T09:16:24.664 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2023-10-14T09:16:24.668 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2023-10-14T09:16:24.690 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T09:16:24.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T09:16:24.730 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T09:16:24.754 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T09:16:24.755 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T09:16:24.790 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T09:16:24.825 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-14T09:16:24.825 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-14T09:16:24.825 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-14T09:16:24.826 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:24.826 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T09:16:24.863 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T09:16:24.958 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:24.958 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T09:16:24.968 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T09:16:25.066 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T09:16:25.066 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', '\\(MDS_INSUFFICIENT_STANDBY\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_DAMAGE\\)', '\\(FS_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T09:16:25.066 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143', 'branch': 'rishabh-2023oct13', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}', 'email': None, 'first_in_suite': False, 'job_id': '7425143', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', '\\(MDS_INSUFFICIENT_STANDBY\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_DAMAGE\\)', '\\(FS_DEGRADED\\)'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'disabled': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdn8snkywa347m3Vm++j/7zGb0bP1DuqZrs03Tlk65YGWV1sN7+opB4oVBc817xO1lvLUtO36qUhJ6w+UsU+hw=', 'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVtw7vNZj/l0SLmC2AuhNX31JfCkue1KDpMCHJBMQdkODprV+rab9GcwgdALBISm5/EjTEyEraPySW/2rvK7L8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', '\\(MDS_INSUFFICIENT_STANDBY\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_DAMAGE\\)', '\\(FS_DEGRADED\\)'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'exec': {'mon.a': ['ceph config set mgr mgr/crash/warn_recent_interval 0']}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_failover']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_18:04:14', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T09:16:25.067 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T09:16:25.071 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T09:16:25.081 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T09:16:25.128 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T09:16:25.151 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:25.151 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T09:16:25.195 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T09:16:25.195 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2023-10-14T09:16:25.247 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T09:16:25.247 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:16:25.247 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 903 Links: 1 2023-10-14T09:16:25.247 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:16:25.248 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-10-14 09:10:10.995441085 +0000 2023-10-14T09:16:25.248 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-10-14 09:10:10.599444621 +0000 2023-10-14T09:16:25.248 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-10-14 09:10:10.599444621 +0000 2023-10-14T09:16:25.248 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-10-14 09:10:10.599444621 +0000 2023-10-14T09:16:25.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T09:16:25.312 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-10-14T09:16:25.312 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-10-14T09:16:25.313 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000357788 s, 1.4 MB/s 2023-10-14T09:16:25.314 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T09:16:25.365 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2023-10-14T09:16:25.420 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T09:16:25.421 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:16:25.421 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 921 Links: 1 2023-10-14T09:16:25.421 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:16:25.421 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-10-14 09:10:11.683434940 +0000 2023-10-14T09:16:25.421 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-10-14 09:10:11.255438763 +0000 2023-10-14T09:16:25.422 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-10-14 09:10:11.255438763 +0000 2023-10-14T09:16:25.422 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-10-14 09:10:11.255438763 +0000 2023-10-14T09:16:25.422 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T09:16:25.481 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-10-14T09:16:25.481 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-10-14T09:16:25.481 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000354607 s, 1.4 MB/s 2023-10-14T09:16:25.483 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T09:16:25.533 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2023-10-14T09:16:25.583 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T09:16:25.584 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:16:25.584 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-10-14T09:16:25.584 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:16:25.584 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-10-14 09:10:12.383428687 +0000 2023-10-14T09:16:25.585 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-10-14 09:10:11.947432581 +0000 2023-10-14T09:16:25.585 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-10-14 09:10:11.947432581 +0000 2023-10-14T09:16:25.585 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-10-14 09:10:11.947432581 +0000 2023-10-14T09:16:25.585 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T09:16:25.649 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-10-14T09:16:25.649 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-10-14T09:16:25.649 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000352814 s, 1.5 MB/s 2023-10-14T09:16:25.651 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T09:16:25.705 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2023-10-14T09:16:25.755 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T09:16:25.756 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:16:25.756 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 954 Links: 1 2023-10-14T09:16:25.756 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:16:25.756 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-10-14 09:10:13.035422863 +0000 2023-10-14T09:16:25.757 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-10-14 09:10:12.639426400 +0000 2023-10-14T09:16:25.757 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-10-14 09:10:12.639426400 +0000 2023-10-14T09:16:25.757 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-10-14 09:10:12.639426400 +0000 2023-10-14T09:16:25.757 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T09:16:25.817 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-10-14T09:16:25.817 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-10-14T09:16:25.817 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000347872 s, 1.5 MB/s 2023-10-14T09:16:25.818 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T09:16:25.873 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T09:16:25.873 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:25.873 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T09:16:25.883 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T09:16:25.884 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2023-10-14T09:16:25.935 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T09:16:25.935 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:16:25.935 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 904 Links: 1 2023-10-14T09:16:25.935 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:16:25.936 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-14 09:10:10.972528183 +0000 2023-10-14T09:16:25.936 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-14 09:10:10.576531720 +0000 2023-10-14T09:16:25.936 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-14 09:10:10.576531720 +0000 2023-10-14T09:16:25.937 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-10-14 09:10:10.576531720 +0000 2023-10-14T09:16:25.937 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T09:16:25.997 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-14T09:16:25.997 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-14T09:16:25.997 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.00027734 s, 1.8 MB/s 2023-10-14T09:16:25.999 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T09:16:26.052 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2023-10-14T09:16:26.103 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T09:16:26.103 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:16:26.103 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 919 Links: 1 2023-10-14T09:16:26.103 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:16:26.104 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-14 09:10:11.596522609 +0000 2023-10-14T09:16:26.104 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-14 09:10:11.216526004 +0000 2023-10-14T09:16:26.104 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-14 09:10:11.216526004 +0000 2023-10-14T09:16:26.104 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-10-14 09:10:11.216526004 +0000 2023-10-14T09:16:26.104 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T09:16:26.165 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-14T09:16:26.165 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-14T09:16:26.165 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000283052 s, 1.8 MB/s 2023-10-14T09:16:26.167 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T09:16:26.220 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2023-10-14T09:16:26.274 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T09:16:26.275 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:16:26.275 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-10-14T09:16:26.275 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:16:26.275 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-14 09:10:12.284516464 +0000 2023-10-14T09:16:26.275 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-14 09:10:11.852520323 +0000 2023-10-14T09:16:26.276 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-14 09:10:11.852520323 +0000 2023-10-14T09:16:26.276 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-10-14 09:10:11.852520323 +0000 2023-10-14T09:16:26.276 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T09:16:26.337 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-14T09:16:26.337 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-14T09:16:26.338 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000276334 s, 1.9 MB/s 2023-10-14T09:16:26.339 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T09:16:26.392 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2023-10-14T09:16:26.442 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T09:16:26.443 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T09:16:26.443 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-10-14T09:16:26.443 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T09:16:26.443 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2023-10-14 09:10:12.940510605 +0000 2023-10-14T09:16:26.443 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2023-10-14 09:10:12.536514214 +0000 2023-10-14T09:16:26.444 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2023-10-14 09:10:12.536514214 +0000 2023-10-14T09:16:26.444 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2023-10-14 09:10:12.536514214 +0000 2023-10-14T09:16:26.444 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T09:16:26.505 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2023-10-14T09:16:26.505 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2023-10-14T09:16:26.505 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000269181 s, 1.9 MB/s 2023-10-14T09:16:26.507 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T09:16:26.560 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T09:16:26.561 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T09:16:26.561 INFO:tasks.ceph:Generating config... 2023-10-14T09:16:26.562 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-14T09:16:26.562 INFO:tasks.ceph:[client] debug client = 20 2023-10-14T09:16:26.563 INFO:tasks.ceph:[client] debug ms = 1 2023-10-14T09:16:26.563 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-14T09:16:26.563 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-14T09:16:26.563 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-14T09:16:26.564 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-14T09:16:26.564 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-14T09:16:26.564 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-14T09:16:26.564 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-14T09:16:26.565 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-14T09:16:26.565 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-14T09:16:26.565 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-14T09:16:26.566 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-14T09:16:26.566 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-14T09:16:26.567 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T09:16:26.567 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T09:16:26.567 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T09:16:26.567 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T09:16:26.568 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T09:16:26.568 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-14T09:16:26.568 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-14T09:16:26.568 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-10-14T09:16:26.569 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-14T09:16:26.569 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-14T09:16:26.569 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-14T09:16:26.569 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T09:16:26.570 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T09:16:26.570 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-14T09:16:26.570 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-14T09:16:26.570 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-14T09:16:26.571 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-14T09:16:26.571 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-14T09:16:26.571 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-14T09:16:26.571 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-14T09:16:26.572 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T09:16:26.572 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T09:16:26.618 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T09:16:26.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T09:16:26.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T09:16:26.787 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '172.21.15.157'), ('mon.c', '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]')] 2023-10-14T09:16:26.788 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-14T09:16:26.789 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:26.789 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T09:16:26.839 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --add b 172.21.15.157 --addv c '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:26.934 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:26.935 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid 1f80be0e-0937-433c-91b2-bf32e5285783 2023-10-14T09:16:26.935 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = pacific 2023-10-14T09:16:26.935 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2023-10-14T09:16:26.935 INFO:teuthology.orchestra.run.smithi078.stdout:fsid 1f80be0e-0937-433c-91b2-bf32e5285783 2023-10-14T09:16:26.935 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2023-10-14T09:16:26.935971+0000 2023-10-14T09:16:26.936 INFO:teuthology.orchestra.run.smithi078.stdout:created 2023-10-14T09:16:26.935971+0000 2023-10-14T09:16:26.936 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 16 (pacific) 2023-10-14T09:16:26.936 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2023-10-14T09:16:26.936 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2023-10-14T09:16:26.936 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2023-10-14T09:16:26.937 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2023-10-14T09:16:26.937 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-14T09:16:26.938 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T09:16:26.987 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1f80be0e-0937-433c-91b2-bf32e5285783... 2023-10-14T09:16:26.988 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T09:16:27.038 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T09:16:27.078 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2023-10-14T09:16:27.079 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2023-10-14T09:16:27.079 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T09:16:27.079 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2023-10-14T09:16:27.079 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.079 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2023-10-14T09:16:27.080 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.080 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2023-10-14T09:16:27.080 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.080 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2023-10-14T09:16:27.080 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2023-10-14T09:16:27.081 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.081 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2023-10-14T09:16:27.081 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2023-10-14T09:16:27.081 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.081 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T09:16:27.081 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2023-10-14T09:16:27.082 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.082 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T09:16:27.082 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T09:16:27.082 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.083 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2023-10-14T09:16:27.083 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.083 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2023-10-14T09:16:27.083 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2023-10-14T09:16:27.083 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2023-10-14T09:16:27.083 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2023-10-14T09:16:27.084 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2023-10-14T09:16:27.084 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2023-10-14T09:16:27.084 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2023-10-14T09:16:27.084 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T09:16:27.084 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T09:16:27.085 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2023-10-14T09:16:27.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.085 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T09:16:27.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.085 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2023-10-14T09:16:27.086 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.086 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2023-10-14T09:16:27.086 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.086 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2023-10-14T09:16:27.086 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2023-10-14T09:16:27.087 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2023-10-14T09:16:27.087 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2023-10-14T09:16:27.087 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 1f80be0e-0937-433c-91b2-bf32e5285783 2023-10-14T09:16:27.087 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.087 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2023-10-14T09:16:27.088 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2023-10-14T09:16:27.088 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.088 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2023-10-14T09:16:27.088 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2023-10-14T09:16:27.088 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2023-10-14T09:16:27.089 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.089 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2023-10-14T09:16:27.089 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2023-10-14T09:16:27.089 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.089 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2023-10-14T09:16:27.090 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2023-10-14T09:16:27.090 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2023-10-14T09:16:27.090 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.090 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2023-10-14T09:16:27.090 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2023-10-14T09:16:27.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.091 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2023-10-14T09:16:27.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.091 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2023-10-14T09:16:27.092 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.092 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2023-10-14T09:16:27.092 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.092 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2023-10-14T09:16:27.092 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2023-10-14T09:16:27.092 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.093 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2023-10-14T09:16:27.093 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2023-10-14T09:16:27.093 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2023-10-14T09:16:27.093 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore compression mode = aggressive 2023-10-14T09:16:27.093 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2023-10-14T09:16:27.094 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 20 2023-10-14T09:16:27.094 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 20 2023-10-14T09:16:27.094 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-10-14T09:16:27.094 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2023-10-14T09:16:27.094 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 10 2023-10-14T09:16:27.095 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T09:16:27.095 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2023-10-14T09:16:27.095 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2023-10-14T09:16:27.095 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2023-10-14T09:16:27.095 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2023-10-14T09:16:27.096 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-10-14T09:16:27.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.096 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2023-10-14T09:16:27.096 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-10-14T09:16:27.096 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2023-10-14T09:16:27.097 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-10-14T09:16:27.097 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-10-14T09:16:27.097 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-10-14T09:16:27.097 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-10-14T09:16:27.097 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2023-10-14T09:16:27.098 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2023-10-14T09:16:27.098 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-10-14T09:16:27.098 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-10-14T09:16:27.098 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2023-10-14T09:16:27.098 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-10-14T09:16:27.099 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2023-10-14T09:16:27.099 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2023-10-14T09:16:27.099 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-10-14T09:16:27.099 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2023-10-14T09:16:27.099 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2023-10-14T09:16:27.100 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-10-14T09:16:27.100 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.100 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T09:16:27.100 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T09:16:27.100 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T09:16:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T09:16:27.101 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T09:16:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T09:16:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.102 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2023-10-14T09:16:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2023-10-14T09:16:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2023-10-14T09:16:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2023-10-14T09:16:27.103 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:16:27.104 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2023-10-14T09:16:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2023-10-14T09:16:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2023-10-14T09:16:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2023-10-14T09:16:27.104 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T09:16:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T09:16:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2023-10-14T09:16:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2023-10-14T09:16:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-10-14T09:16:27.105 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-10-14T09:16:27.106 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-10-14T09:16:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2023-10-14T09:16:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2023-10-14T09:16:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2023-10-14T09:16:27.106 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-10-14T09:16:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-10-14T09:16:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-10-14T09:16:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-10-14T09:16:27.107 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2023-10-14T09:16:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2023-10-14T09:16:27.107 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds balancer = 20 2023-10-14T09:16:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-10-14T09:16:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2023-10-14T09:16:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2023-10-14T09:16:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2023-10-14T09:16:27.108 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2023-10-14T09:16:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-10-14T09:16:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-10-14T09:16:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-10-14T09:16:27.111 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2023-10-14T09:16:27.111 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2023-10-14T09:16:27.111 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T09:16:27.111 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2023-10-14T09:16:27.112 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.112 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2023-10-14T09:16:27.112 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.112 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2023-10-14T09:16:27.112 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.113 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2023-10-14T09:16:27.113 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2023-10-14T09:16:27.113 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.113 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2023-10-14T09:16:27.113 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2023-10-14T09:16:27.114 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.114 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T09:16:27.114 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2023-10-14T09:16:27.114 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.114 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T09:16:27.114 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T09:16:27.115 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.115 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2023-10-14T09:16:27.115 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.115 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2023-10-14T09:16:27.115 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2023-10-14T09:16:27.116 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2023-10-14T09:16:27.116 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2023-10-14T09:16:27.116 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2023-10-14T09:16:27.116 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2023-10-14T09:16:27.116 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2023-10-14T09:16:27.116 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T09:16:27.117 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T09:16:27.117 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2023-10-14T09:16:27.117 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.117 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T09:16:27.117 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.118 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2023-10-14T09:16:27.118 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.118 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2023-10-14T09:16:27.118 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.118 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2023-10-14T09:16:27.119 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2023-10-14T09:16:27.119 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2023-10-14T09:16:27.119 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.78,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2023-10-14T09:16:27.119 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = 1f80be0e-0937-433c-91b2-bf32e5285783 2023-10-14T09:16:27.119 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.120 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2023-10-14T09:16:27.120 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2023-10-14T09:16:27.120 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.120 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2023-10-14T09:16:27.120 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2023-10-14T09:16:27.120 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2023-10-14T09:16:27.121 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.121 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2023-10-14T09:16:27.121 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2023-10-14T09:16:27.121 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.121 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2023-10-14T09:16:27.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2023-10-14T09:16:27.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2023-10-14T09:16:27.122 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2023-10-14T09:16:27.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2023-10-14T09:16:27.123 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.123 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2023-10-14T09:16:27.123 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.123 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2023-10-14T09:16:27.123 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.124 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2023-10-14T09:16:27.124 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.124 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2023-10-14T09:16:27.124 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2023-10-14T09:16:27.124 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.125 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2023-10-14T09:16:27.125 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2023-10-14T09:16:27.125 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2023-10-14T09:16:27.125 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore compression mode = aggressive 2023-10-14T09:16:27.125 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2023-10-14T09:16:27.126 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 20 2023-10-14T09:16:27.126 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 20 2023-10-14T09:16:27.126 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-10-14T09:16:27.126 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2023-10-14T09:16:27.126 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 10 2023-10-14T09:16:27.127 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T09:16:27.127 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2023-10-14T09:16:27.127 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2023-10-14T09:16:27.127 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2023-10-14T09:16:27.127 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2023-10-14T09:16:27.128 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2023-10-14T09:16:27.128 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.128 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2023-10-14T09:16:27.128 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-10-14T09:16:27.128 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2023-10-14T09:16:27.128 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2023-10-14T09:16:27.129 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2023-10-14T09:16:27.129 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2023-10-14T09:16:27.129 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2023-10-14T09:16:27.129 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2023-10-14T09:16:27.129 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.130 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2023-10-14T09:16:27.130 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-10-14T09:16:27.130 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2023-10-14T09:16:27.130 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2023-10-14T09:16:27.130 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2023-10-14T09:16:27.131 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2023-10-14T09:16:27.131 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2023-10-14T09:16:27.131 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2023-10-14T09:16:27.131 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2023-10-14T09:16:27.131 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2023-10-14T09:16:27.132 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2023-10-14T09:16:27.132 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.132 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T09:16:27.132 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T09:16:27.132 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T09:16:27.133 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.133 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T09:16:27.133 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T09:16:27.133 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T09:16:27.133 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.134 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2023-10-14T09:16:27.134 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2023-10-14T09:16:27.134 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.134 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2023-10-14T09:16:27.134 INFO:teuthology.orchestra.run.smithi157.stdout: mon op complaint time = 120 2023-10-14T09:16:27.134 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-14T09:16:27.135 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2023-10-14T09:16:27.135 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2023-10-14T09:16:27.135 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2023-10-14T09:16:27.135 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2023-10-14T09:16:27.135 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T09:16:27.136 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T09:16:27.136 INFO:teuthology.orchestra.run.smithi157.stdout: client mount timeout = 600 2023-10-14T09:16:27.136 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2023-10-14T09:16:27.136 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-10-14T09:16:27.136 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2023-10-14T09:16:27.136 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2023-10-14T09:16:27.137 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2023-10-14T09:16:27.137 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2023-10-14T09:16:27.137 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2023-10-14T09:16:27.137 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2023-10-14T09:16:27.138 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2023-10-14T09:16:27.138 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2023-10-14T09:16:27.138 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2023-10-14T09:16:27.138 INFO:teuthology.orchestra.run.smithi157.stdout:[mds] 2023-10-14T09:16:27.138 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds = 20 2023-10-14T09:16:27.139 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds balancer = 20 2023-10-14T09:16:27.139 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2023-10-14T09:16:27.139 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug frag = True 2023-10-14T09:16:27.139 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug scatterstat = True 2023-10-14T09:16:27.139 INFO:teuthology.orchestra.run.smithi157.stdout: mds op complaint time = 180 2023-10-14T09:16:27.140 INFO:teuthology.orchestra.run.smithi157.stdout: mds verify scatter = True 2023-10-14T09:16:27.140 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2023-10-14T09:16:27.140 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2023-10-14T09:16:27.140 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2023-10-14T09:16:27.140 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T09:16:27.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T09:16:27.207 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T09:16:27.208 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:27.208 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T09:16:27.217 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:27.218 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T09:16:27.271 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:16:27.272 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:27.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T09:16:27.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T09:16:27.351 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:27.352 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:27.403 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:16:27.404 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:27.404 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T09:16:27.404 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T09:16:27.441 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:27.441 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:27.490 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T09:16:27.491 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T09:16:27.491 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T09:16:27.547 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T09:16:27.552 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T09:16:27.614 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T09:16:27.645 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T09:16:27.646 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T09:16:27.701 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T09:16:27.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-14T09:16:27.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T09:16:27.822 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T09:16:27.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-14T09:16:27.846 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T09:16:27.907 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T09:16:27.911 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-14T09:16:27.933 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T09:16:28.029 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T09:16:28.033 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-14T09:16:28.055 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T09:16:28.055 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T09:16:28.099 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T09:16:28.116 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-14T09:16:28.160 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-14T09:16:28.177 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T09:16:28.177 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T09:16:28.177 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T09:16:28.198 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T09:16:28.199 INFO:tasks.ceph:role: osd.0 2023-10-14T09:16:28.199 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:16:28.199 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T09:16:28.266 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:16:28.267 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:16:28.267 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:16:28.267 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T09:16:28.267 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:16:28.267 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:16:28.268 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:16:28.268 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T09:16:28.268 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:16:28.268 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:16:28.716 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-10-14T09:16:28.721 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-10-14T09:16:28.721 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T09:16:28.840 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T09:16:28.858 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T09:16:28.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:16:28.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T09:16:28.923 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T09:16:28.923 INFO:tasks.ceph:role: osd.1 2023-10-14T09:16:28.924 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:16:28.924 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T09:16:28.995 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:16:28.995 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:16:28.996 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:16:28.996 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T09:16:28.996 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:16:28.996 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:16:28.996 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:16:28.996 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T09:16:28.997 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:16:28.997 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:16:29.485 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-10-14T09:16:29.488 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-10-14T09:16:29.488 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T09:16:29.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T09:16:29.648 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T09:16:29.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:16:29.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T09:16:29.712 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T09:16:29.712 INFO:tasks.ceph:role: osd.2 2023-10-14T09:16:29.713 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:16:29.713 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T09:16:29.784 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:16:29.785 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:16:29.785 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:16:29.785 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T09:16:29.785 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:16:29.786 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:16:29.786 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:16:29.786 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T09:16:29.786 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:16:29.786 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:16:30.269 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-10-14T09:16:30.273 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-10-14T09:16:30.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-14T09:16:30.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T09:16:30.424 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T09:16:30.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:16:30.426 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-14T09:16:30.492 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T09:16:30.493 INFO:tasks.ceph:role: osd.3 2023-10-14T09:16:30.493 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:16:30.493 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T09:16:30.564 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:16:30.565 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:16:30.565 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:16:30.566 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T09:16:30.566 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:16:30.566 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:16:30.566 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:16:30.566 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T09:16:30.567 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:16:30.567 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:16:31.014 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-10-14T09:16:31.017 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-10-14T09:16:31.017 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-14T09:16:31.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-14T09:16:31.136 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T09:16:31.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:16:31.137 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:31.283+0000 7f5f75392640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T09:16:31.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:31.283+0000 7f5f75392640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T09:16:31.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:31.283+0000 7f5f75392640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T09:16:31.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:31.283+0000 7f5f75392640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T09:16:31.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:31.283+0000 7f5f75392640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T09:16:31.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:31.291+0000 7f5f75392640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-14T09:16:34.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T09:16:34.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:34.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:34.391+0000 7f2929f05640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T09:16:34.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:34.391+0000 7f2929f05640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T09:16:34.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:34.391+0000 7f2929f05640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T09:16:34.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:34.391+0000 7f2929f05640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T09:16:34.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:34.391+0000 7f2929f05640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T09:16:34.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:34.391+0000 7f2929f05640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-14T09:16:37.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T09:16:37.424 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:37.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:37.519+0000 7fc447177640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T09:16:37.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:37.519+0000 7fc447177640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T09:16:37.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:37.519+0000 7fc447177640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T09:16:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:37.519+0000 7fc447177640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T09:16:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:37.519+0000 7fc447177640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T09:16:37.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:37.519+0000 7fc447177640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-14T09:16:40.497 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T09:16:40.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:40.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:40.611+0000 7f3395d6e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-14T09:16:40.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:40.611+0000 7f3395d6e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-14T09:16:40.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:40.611+0000 7f3395d6e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T09:16:40.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:40.611+0000 7f3395d6e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T09:16:40.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:40.611+0000 7f3395d6e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T09:16:40.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:16:40.611+0000 7f3395d6e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-14T09:16:43.601 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-14T09:16:43.623 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-14T09:16:43.647 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T09:16:43.648 INFO:tasks.ceph:role: osd.4 2023-10-14T09:16:43.649 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:16:43.649 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T09:16:43.711 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:16:43.711 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:16:43.712 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:16:43.712 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T09:16:43.712 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:16:43.712 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:16:43.712 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:16:43.713 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T09:16:43.713 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:16:43.713 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:16:43.736 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-10-14T09:16:43.738 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-10-14T09:16:43.739 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-14T09:16:43.813 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-14T09:16:43.874 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T09:16:43.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:16:43.875 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-14T09:16:43.937 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T09:16:43.938 INFO:tasks.ceph:role: osd.5 2023-10-14T09:16:43.938 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:16:43.938 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T09:16:44.005 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:16:44.005 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:16:44.006 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:16:44.006 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T09:16:44.006 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:16:44.006 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:16:44.007 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:16:44.007 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T09:16:44.007 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:16:44.007 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:16:44.029 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-10-14T09:16:44.032 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-10-14T09:16:44.033 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-14T09:16:44.103 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-14T09:16:44.165 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T09:16:44.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:16:44.167 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-14T09:16:44.233 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T09:16:44.233 INFO:tasks.ceph:role: osd.6 2023-10-14T09:16:44.233 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:16:44.234 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T09:16:44.293 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:16:44.293 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:16:44.293 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:16:44.293 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T09:16:44.294 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:16:44.294 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:16:44.294 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:16:44.294 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T09:16:44.295 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:16:44.295 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:16:44.317 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-10-14T09:16:44.320 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-10-14T09:16:44.320 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-14T09:16:44.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-14T09:16:44.446 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T09:16:44.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:16:44.447 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-14T09:16:44.509 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T09:16:44.510 INFO:tasks.ceph:role: osd.7 2023-10-14T09:16:44.510 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:16:44.510 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T09:16:44.573 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T09:16:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T09:16:44.573 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T09:16:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T09:16:44.574 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T09:16:44.574 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2023-10-14T09:16:44.574 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T09:16:44.575 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T09:16:44.575 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T09:16:44.575 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T09:16:44.598 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2023-10-14T09:16:44.600 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2023-10-14T09:16:44.600 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-14T09:16:44.671 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-14T09:16:44.730 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2023-10-14T09:16:44.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:16:44.731 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:45.091 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:45.088+0000 7f0ef2c6e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-14T09:16:45.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:45.088+0000 7f0ef2c6e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-14T09:16:45.092 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:45.088+0000 7f0ef2c6e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T09:16:45.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:45.088+0000 7f0ef2c6e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T09:16:45.093 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:45.088+0000 7f0ef2c6e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T09:16:45.094 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:45.092+0000 7f0ef2c6e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-14T09:16:48.065 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-14T09:16:48.087 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:48.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:48.184+0000 7fdc1ad9b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-14T09:16:48.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:48.184+0000 7fdc1ad9b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-14T09:16:48.189 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:48.184+0000 7fdc1ad9b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T09:16:48.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:48.184+0000 7fdc1ad9b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T09:16:48.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:48.184+0000 7fdc1ad9b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T09:16:48.190 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:48.188+0000 7fdc1ad9b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-14T09:16:51.184 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-14T09:16:51.206 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:51.307 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:51.304+0000 7f02d0b09640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-14T09:16:51.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:51.304+0000 7f02d0b09640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-14T09:16:51.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:51.304+0000 7f02d0b09640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T09:16:51.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:51.304+0000 7f02d0b09640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T09:16:51.308 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:51.304+0000 7f02d0b09640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T09:16:51.309 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:51.304+0000 7f02d0b09640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-14T09:16:54.312 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-14T09:16:54.334 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:54.436 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:54.432+0000 7fbff10ba640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-14T09:16:54.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:54.432+0000 7fbff10ba640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-14T09:16:54.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:54.432+0000 7fbff10ba640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T09:16:54.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:54.432+0000 7fbff10ba640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T09:16:54.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:54.432+0000 7fbff10ba640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T09:16:54.438 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:16:54.436+0000 7fbff10ba640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-14T09:16:55.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:16:55.073 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:16:57.424 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-14T09:16:57.445 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T09:16:57.446 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:57.446 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-14T09:16:57.469 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:57.469 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-14T09:16:57.532 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:57.533 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-14T09:16:57.597 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:57.597 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T09:16:57.660 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:57.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T09:16:57.724 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:57.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T09:16:57.791 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:57.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-14T09:16:57.854 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:57.855 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T09:16:57.876 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:57.876 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-14T09:16:57.937 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:57.938 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-14T09:16:58.001 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:58.001 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-14T09:16:58.065 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:58.065 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-14T09:16:58.129 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:58.129 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-14T09:16:58.193 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:58.193 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-14T09:16:58.253 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:16:58.253 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T09:16:58.262 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:16:58.263 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-14T09:16:58.305 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T09:16:58.306 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T09:16:58.310 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T09:16:58.357 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2023-10-14T09:16:58.357 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBrXCplHo6+IBAAYlZ/yTZ218ZTWrSrdrbMqw== 2023-10-14T09:16:58.358 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-10-14T09:16:58.358 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBrXCplhsLmKRAAh8xCTPA/y4J2P6Wrtjhsmg== 2023-10-14T09:16:58.358 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-10-14T09:16:58.358 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBrXCplyQgYMRAAUINKmFCk+Z/ZuXWS4jy6pA== 2023-10-14T09:16:58.359 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2023-10-14T09:16:58.359 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBvXCplRbUIERAAxIwLnriE5yazQuG99AspDA== 2023-10-14T09:16:58.359 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2023-10-14T09:16:58.359 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQByXCplCwR5FxAAPSn4N/Xk7EqzAIbGdqAqDw== 2023-10-14T09:16:58.360 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2023-10-14T09:16:58.360 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB1XCplKGweHxAANSlcBJy0zm+39CW/uXeXkw== 2023-10-14T09:16:58.360 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2023-10-14T09:16:58.360 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB4XCplj5WWJBAA6XrafZI+Cd1amO+1NXHZTg== 2023-10-14T09:16:58.360 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2023-10-14T09:16:58.361 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBrXCplJ22TJBAAa4iVMc6qk+OSZzjVxZK1vQ== 2023-10-14T09:16:58.361 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-10-14T09:16:58.361 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBrXCplguQMNhAAmOv7zgsuTno4plE11cCfHw== 2023-10-14T09:16:58.361 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-10-14T09:16:58.361 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBsXCpl0Ke9ARAA+K+1Mg8wTPbUaCqaw29UcA== 2023-10-14T09:16:58.362 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2023-10-14T09:16:58.362 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB9XCplJ2dvBRAAYXKOTsTzJPft95usETS37Q== 2023-10-14T09:16:58.362 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2023-10-14T09:16:58.362 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCAXCpl2K8+CxAAHgjM1Ks8gdbubAWxQMIYzg== 2023-10-14T09:16:58.362 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2023-10-14T09:16:58.363 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCDXCplmbxJEhAAYJisQ3hmg2kVRDCTQ8E3Dg== 2023-10-14T09:16:58.363 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2023-10-14T09:16:58.363 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCGXCpl/IsAGhAA7nfW9Eyjokq/8fh2sPDgLg== 2023-10-14T09:16:58.363 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-10-14T09:16:58.363 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBsXCplSecJBhAAyIuXUmhDhdaJgqqjjqAa/w== 2023-10-14T09:16:58.364 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2023-10-14T09:16:58.364 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBsXCplVQWDCRAA2Pez8tuTqaOfwhvWBep0hg== 2023-10-14T09:16:58.371 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2023-10-14T09:16:58.371 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBrXCplHo6+IBAAYlZ/yTZ218ZTWrSrdrbMqw== 2023-10-14T09:16:58.371 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2023-10-14T09:16:58.371 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBrXCplhsLmKRAAh8xCTPA/y4J2P6Wrtjhsmg== 2023-10-14T09:16:58.372 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2023-10-14T09:16:58.372 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBrXCplyQgYMRAAUINKmFCk+Z/ZuXWS4jy6pA== 2023-10-14T09:16:58.372 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2023-10-14T09:16:58.372 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBvXCplRbUIERAAxIwLnriE5yazQuG99AspDA== 2023-10-14T09:16:58.372 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2023-10-14T09:16:58.373 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQByXCplCwR5FxAAPSn4N/Xk7EqzAIbGdqAqDw== 2023-10-14T09:16:58.373 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2023-10-14T09:16:58.373 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB1XCplKGweHxAANSlcBJy0zm+39CW/uXeXkw== 2023-10-14T09:16:58.373 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2023-10-14T09:16:58.373 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB4XCplj5WWJBAA6XrafZI+Cd1amO+1NXHZTg== 2023-10-14T09:16:58.373 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2023-10-14T09:16:58.374 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBrXCplJ22TJBAAa4iVMc6qk+OSZzjVxZK1vQ== 2023-10-14T09:16:58.374 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2023-10-14T09:16:58.374 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBrXCplguQMNhAAmOv7zgsuTno4plE11cCfHw== 2023-10-14T09:16:58.374 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2023-10-14T09:16:58.374 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBsXCpl0Ke9ARAA+K+1Mg8wTPbUaCqaw29UcA== 2023-10-14T09:16:58.375 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2023-10-14T09:16:58.375 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB9XCplJ2dvBRAAYXKOTsTzJPft95usETS37Q== 2023-10-14T09:16:58.375 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2023-10-14T09:16:58.375 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCAXCpl2K8+CxAAHgjM1Ks8gdbubAWxQMIYzg== 2023-10-14T09:16:58.375 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2023-10-14T09:16:58.376 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCDXCplmbxJEhAAYJisQ3hmg2kVRDCTQ8E3Dg== 2023-10-14T09:16:58.376 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2023-10-14T09:16:58.376 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQCGXCpl/IsAGhAA7nfW9Eyjokq/8fh2sPDgLg== 2023-10-14T09:16:58.376 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2023-10-14T09:16:58.376 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBsXCplSecJBhAAyIuXUmhDhdaJgqqjjqAa/w== 2023-10-14T09:16:58.377 INFO:teuthology.orchestra.run.smithi157.stdout:[client.1] 2023-10-14T09:16:58.377 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBsXCplVQWDCRAA2Pez8tuTqaOfwhvWBep0hg== 2023-10-14T09:16:58.378 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T09:16:58.414 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T09:16:58.475 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:16:58.479 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:16:58.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:16:58.541 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:16:58.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:58.602 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:58.656 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:58.660 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:58.714 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:58.717 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:58.772 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:58.776 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:58.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T09:16:58.833 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T09:16:58.887 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:16:58.891 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:16:58.949 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:16:58.953 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T09:16:59.011 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:59.015 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:59.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:59.073 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:59.127 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:59.131 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:59.185 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:59.189 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T09:16:59.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:16:59.247 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:16:59.305 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:16:59.309 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T09:16:59.367 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T09:16:59.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T09:16:59.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T09:16:59.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T09:16:59.525 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-14T09:16:59.546 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T09:16:59.661 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-14T09:16:59.681 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-14T09:16:59.745 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T09:16:59.856 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-14T09:16:59.877 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:59.881 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T09:16:59.925 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T09:16:59.926 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T09:16:59.926 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T09:16:59.934 INFO:tasks.ceph.mon.a:Started 2023-10-14T09:16:59.934 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-14T09:16:59.935 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-14T09:16:59.976 INFO:tasks.ceph.mon.b:Started 2023-10-14T09:16:59.977 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-14T09:16:59.977 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-14T09:16:59.981 INFO:tasks.ceph.mon.c:Started 2023-10-14T09:16:59.982 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T09:16:59.982 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-14T09:16:59.982 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-14T09:16:59.986 INFO:tasks.ceph.mgr.y:Started 2023-10-14T09:16:59.986 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T09:16:59.987 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T09:16:59.990 INFO:tasks.ceph.mgr.x:Started 2023-10-14T09:16:59.991 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T09:16:59.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T09:17:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8bc6b640 1 Processor -- start 2023-10-14T09:17:00.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8bc6b640 1 -- start start 2023-10-14T09:17:00.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8bc6b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0f84151400 0x7f0f84069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8bc6b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0f840c04c0 0x7f0f8415e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8bc6b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f840a7660 con 0x7f0f8406dcf0 2023-10-14T09:17:00.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8bc6b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f841517e0 con 0x7f0f84151400 2023-10-14T09:17:00.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8bc6b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f84154820 con 0x7f0f840c04c0 2023-10-14T09:17:00.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f89a07640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0f84151400 0x7f0f84069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f89a07640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0f84151400 0x7f0f84069e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38552/0 (socket says 172.21.15.78:38552) 2023-10-14T09:17:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f89a07640 1 -- 172.21.15.78:0/1657991090 learned_addr learned my addr 172.21.15.78:0/1657991090 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f89a07640 1 -- 172.21.15.78:0/1657991090 >> v2:172.21.15.78:3300/0 conn(0x7f0f84151400 msgr2=0x7f0f84069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T09:17:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f89a07640 1 -- 172.21.15.78:0/1657991090 >> v2:172.21.15.78:3300/0 conn(0x7f0f84151400 msgr2=0x7f0f84069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:17:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f89a07640 1 --2- 172.21.15.78:0/1657991090 >> v2:172.21.15.78:3300/0 conn(0x7f0f84151400 0x7f0f84069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:17:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8a208640 1 --2- 172.21.15.78:0/1657991090 >> v2:172.21.15.157:3300/0 conn(0x7f0f840c04c0 0x7f0f8415e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f89a07640 1 --2- 172.21.15.78:0/1657991090 >> v2:172.21.15.78:3300/0 conn(0x7f0f84151400 0x7f0f84069e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T09:17:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8a208640 1 -- 172.21.15.78:0/1657991090 >> v2:172.21.15.157:3300/0 conn(0x7f0f840c04c0 msgr2=0x7f0f8415e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T09:17:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8a208640 1 -- 172.21.15.78:0/1657991090 >> v2:172.21.15.157:3300/0 conn(0x7f0f840c04c0 msgr2=0x7f0f8415e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T09:17:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8a208640 1 --2- 172.21.15.78:0/1657991090 >> v2:172.21.15.157:3300/0 conn(0x7f0f840c04c0 0x7f0f8415e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T09:17:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.139+0000 7f0f8a208640 1 --2- 172.21.15.78:0/1657991090 >> v2:172.21.15.157:3300/0 conn(0x7f0f840c04c0 0x7f0f8415e680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T09:17:00.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556827838 0 0) 0x7f0f840a7660 con 0x7f0f8406dcf0 2023-10-14T09:17:00.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f70003530 con 0x7f0f8406dcf0 2023-10-14T09:17:00.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2490503943 0 0) 0x7f0f70003530 con 0x7f0f8406dcf0 2023-10-14T09:17:00.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 >> v2:172.21.15.157:3300/0 conn(0x7f0f840c04c0 msgr2=0x7f0f8415e680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:17:00.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 --2- 172.21.15.78:0/1657991090 >> v2:172.21.15.157:3300/0 conn(0x7f0f840c04c0 0x7f0f8415e680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 >> v2:172.21.15.78:3300/0 conn(0x7f0f84151400 msgr2=0x7f0f84069e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:17:00.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 --2- 172.21.15.78:0/1657991090 >> v2:172.21.15.78:3300/0 conn(0x7f0f84151400 0x7f0f84069e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84154ac0 con 0x7f0f8406dcf0 2023-10-14T09:17:00.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f0f74001680 con 0x7f0f8406dcf0 2023-10-14T09:17:00.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 >> v1:172.21.15.78:6789/0 conn(0x7f0f8406dcf0 legacy=0x7f0f840bfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:00.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 --2- 172.21.15.78:0/1657991090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f70003980 0x7f0f70003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 --2- 172.21.15.78:0/1657991090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f700047d0 0x7f0f70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 --2- 172.21.15.78:0/1657991090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f70005190 0x7f0f7000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f841517e0 con 0x7f0f70003980 2023-10-14T09:17:00.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84154820 con 0x7f0f70005190 2023-10-14T09:17:00.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7000c090 con 0x7f0f700047d0 2023-10-14T09:17:00.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f89a07640 1 --2- 172.21.15.78:0/1657991090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f70003980 0x7f0f70003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f89206640 1 --2- 172.21.15.78:0/1657991090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f700047d0 0x7f0f70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.287+0000 7f0f8a208640 1 --2- 172.21.15.78:0/1657991090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f70005190 0x7f0f7000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.291+0000 7f0f89a07640 1 -- 172.21.15.78:0/1657991090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f700047d0 msgr2=0x7f0f70004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:00.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.291+0000 7f0f89a07640 1 --2- 172.21.15.78:0/1657991090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f700047d0 0x7f0f70004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.291+0000 7f0f89a07640 1 -- 172.21.15.78:0/1657991090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f70005190 msgr2=0x7f0f7000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:00.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.291+0000 7f0f89a07640 1 --2- 172.21.15.78:0/1657991090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f70005190 0x7f0f7000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.291+0000 7f0f89a07640 1 -- 172.21.15.78:0/1657991090 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f70003530 con 0x7f0f70003980 2023-10-14T09:17:00.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.291+0000 7f0f8a208640 1 -- 172.21.15.78:0/1657991090 reap_dead start 2023-10-14T09:17:00.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.291+0000 7f0f89a07640 1 --2- 172.21.15.78:0/1657991090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f70003980 0x7f0f70003da0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009890 tx=0x7f0f8001c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09afcd15c3011ff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:00.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.295+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f800aa670 con 0x7f0f70003980 2023-10-14T09:17:00.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.295+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f800aa7d0 con 0x7f0f70003980 2023-10-14T09:17:00.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.295+0000 7f0f88a05640 1 -- 172.21.15.78:0/1657991090 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f800aab80 con 0x7f0f70003980 2023-10-14T09:17:00.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.295+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/1657991090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f70003980 msgr2=0x7f0f70003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:00.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.295+0000 7f0f8bc6b640 1 --2- 172.21.15.78:0/1657991090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f70003980 0x7f0f70003da0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009890 tx=0x7f0f8001c5d0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.295+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/1657991090 shutdown_connections 2023-10-14T09:17:00.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.295+0000 7f0f8bc6b640 1 --2- 172.21.15.78:0/1657991090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f70003980 0x7f0f70003da0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.295+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/1657991090 >> 172.21.15.78:0/1657991090 conn(0x7f0f840c63a0 msgr2=0x7f0f840c67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:00.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.295+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/1657991090 shutdown_connections 2023-10-14T09:17:00.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.295+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/1657991090 wait complete. 2023-10-14T09:17:00.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.295+0000 7f0f8bc6b640 1 Processor -- start 2023-10-14T09:17:00.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f8bc6b640 1 -- start start 2023-10-14T09:17:00.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f8bc6b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f70003980 0x7f0f840ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f8bc6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f84150990 0x7f0f840c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f8bc6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f840abbd0 0x7f0f840c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f8bc6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f841572c0 con 0x7f0f84150990 2023-10-14T09:17:00.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f8bc6b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84145990 con 0x7f0f70003980 2023-10-14T09:17:00.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f8bc6b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840c51c0 con 0x7f0f840abbd0 2023-10-14T09:17:00.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f89206640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f84150990 0x7f0f840c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f89206640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f84150990 0x7f0f840c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38578/0 (socket says 172.21.15.78:38578) 2023-10-14T09:17:00.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f89206640 1 -- 172.21.15.78:0/429262902 learned_addr learned my addr 172.21.15.78:0/429262902 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:00.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f8a208640 1 --2- 172.21.15.78:0/429262902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f840abbd0 0x7f0f840c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f89a07640 1 --2- 172.21.15.78:0/429262902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f70003980 0x7f0f840ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f89206640 1 -- 172.21.15.78:0/429262902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f840abbd0 msgr2=0x7f0f840c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f89206640 1 --2- 172.21.15.78:0/429262902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f840abbd0 0x7f0f840c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f89206640 1 -- 172.21.15.78:0/429262902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f70003980 msgr2=0x7f0f840ab690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f89206640 1 --2- 172.21.15.78:0/429262902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f70003980 0x7f0f840ab690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f89206640 1 -- 172.21.15.78:0/429262902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84150e90 con 0x7f0f84150990 2023-10-14T09:17:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f89206640 1 --2- 172.21.15.78:0/429262902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f84150990 0x7f0f840c5610 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0f74000fc0 tx=0x7f0f7400fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f7a7fc640 1 -- 172.21.15.78:0/429262902 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f740052e0 con 0x7f0f84150990 2023-10-14T09:17:00.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f7a7fc640 1 -- 172.21.15.78:0/429262902 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f74005460 con 0x7f0f84150990 2023-10-14T09:17:00.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f7a7fc640 1 -- 172.21.15.78:0/429262902 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400d970 con 0x7f0f84150990 2023-10-14T09:17:00.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/429262902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8414fea0 con 0x7f0f84150990 2023-10-14T09:17:00.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/429262902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f84150460 con 0x7f0f84150990 2023-10-14T09:17:00.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f7a7fc640 1 -- 172.21.15.78:0/429262902 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0f74003600 con 0x7f0f84150990 2023-10-14T09:17:00.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f7a7fc640 1 -- 172.21.15.78:0/429262902 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0f7401d460 con 0x7f0f84150990 2023-10-14T09:17:00.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.299+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/429262902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f840c5330 con 0x7f0f84150990 2023-10-14T09:17:00.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.303+0000 7f0f7a7fc640 1 -- 172.21.15.78:0/429262902 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0f840c5330 con 0x7f0f84150990 2023-10-14T09:17:00.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.363+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/429262902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0f84074110 con 0x7f0f84150990 2023-10-14T09:17:00.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.367+0000 7f0f7a7fc640 1 -- 172.21.15.78:0/429262902 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0f74003a40 con 0x7f0f84150990 2023-10-14T09:17:00.369 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2023-10-14T09:17:00.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.367+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/429262902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f84150990 msgr2=0x7f0f840c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:00.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.367+0000 7f0f8bc6b640 1 --2- 172.21.15.78:0/429262902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f84150990 0x7f0f840c5610 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0f74000fc0 tx=0x7f0f7400fca0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.367+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/429262902 shutdown_connections 2023-10-14T09:17:00.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.367+0000 7f0f8bc6b640 1 --2- 172.21.15.78:0/429262902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0f840abbd0 0x7f0f840c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.367+0000 7f0f8bc6b640 1 --2- 172.21.15.78:0/429262902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f84150990 0x7f0f840c5610 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.367+0000 7f0f8bc6b640 1 --2- 172.21.15.78:0/429262902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f70003980 0x7f0f840ab690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.367+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/429262902 >> 172.21.15.78:0/429262902 conn(0x7f0f840c63a0 msgr2=0x7f0f840c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:00.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.367+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/429262902 shutdown_connections 2023-10-14T09:17:00.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:00.367+0000 7f0f8bc6b640 1 -- 172.21.15.78:0/429262902 wait complete. 2023-10-14T09:17:00.389 INFO:tasks.ceph:check_enable_crimson: False 2023-10-14T09:17:00.389 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T09:17:00.390 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:17:00.390 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T09:17:00.411 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:17:00.411 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T09:17:00.471 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:17:00.472 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T09:17:00.486 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:00.484+0000 7fcb5d603180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T09:17:00.505 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:00.503+0000 7fcc85e46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T09:17:00.525 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:17:00.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-14T09:17:00.587 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:17:00.588 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-14T09:17:00.608 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:17:00.609 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-14T09:17:00.669 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:17:00.670 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-14T09:17:00.734 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:17:00.734 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-14T09:17:00.797 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new fb7f8a9f-6e8d-42c2-906d-79467322e729 0 2023-10-14T09:17:00.977 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.972+0000 7fca0e9b8640 1 Processor -- start 2023-10-14T09:17:00.978 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca0e9b8640 1 -- start start 2023-10-14T09:17:00.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca0e9b8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca080c52f0 0x7fca08154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca0e9b8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca08157da0 0x7fca08151070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca0e9b8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0806b240 con 0x7fca0806ad40 2023-10-14T09:17:00.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca0e9b8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0806c050 con 0x7fca080c52f0 2023-10-14T09:17:00.980 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca0e9b8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca080c7c10 con 0x7fca08157da0 2023-10-14T09:17:00.980 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca07fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca080c52f0 0x7fca08154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca0cf55640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca08157da0 0x7fca08151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca07fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca080c52f0 0x7fca08154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39310/0 (socket says 172.21.15.157:39310) 2023-10-14T09:17:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca07fff640 1 -- 172.21.15.157:0/3194298325 learned_addr learned my addr 172.21.15.157:0/3194298325 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca0cf55640 1 -- 172.21.15.157:0/3194298325 >> v2:172.21.15.157:3300/0 conn(0x7fca080c52f0 msgr2=0x7fca08154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca0cf55640 1 --2- 172.21.15.157:0/3194298325 >> v2:172.21.15.157:3300/0 conn(0x7fca080c52f0 0x7fca08154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca0cf55640 1 -- 172.21.15.157:0/3194298325 >> v1:172.21.15.78:6789/0 conn(0x7fca0806ad40 legacy=0x7fca080c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca0cf55640 1 -- 172.21.15.157:0/3194298325 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca081544a0 con 0x7fca08157da0 2023-10-14T09:17:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.976+0000 7fca07fff640 1 --2- 172.21.15.157:0/3194298325 >> v2:172.21.15.157:3300/0 conn(0x7fca080c52f0 0x7fca08154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:00.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca0cf55640 1 --2- 172.21.15.157:0/3194298325 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca08157da0 0x7fca08151070 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca00009d90 tx=0x7fca0001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=407c01a718b23804 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:00.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca06ffd640 1 -- 172.21.15.157:0/3194298325 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000a5870 con 0x7fca08157da0 2023-10-14T09:17:00.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca06ffd640 1 -- 172.21.15.157:0/3194298325 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca000a59d0 con 0x7fca08157da0 2023-10-14T09:17:00.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca06ffd640 1 -- 172.21.15.157:0/3194298325 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000a5d60 con 0x7fca08157da0 2023-10-14T09:17:00.985 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3194298325 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca08157da0 msgr2=0x7fca08151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:00.985 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca0e9b8640 1 --2- 172.21.15.157:0/3194298325 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca08157da0 0x7fca08151070 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca00009d90 tx=0x7fca0001c8c0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.985 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3194298325 shutdown_connections 2023-10-14T09:17:00.985 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca0e9b8640 1 --2- 172.21.15.157:0/3194298325 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca08157da0 0x7fca08151070 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca0e9b8640 1 --2- 172.21.15.157:0/3194298325 >> v2:172.21.15.157:3300/0 conn(0x7fca080c52f0 0x7fca08154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3194298325 >> 172.21.15.157:0/3194298325 conn(0x7fca080ab0f0 msgr2=0x7fca080ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3194298325 shutdown_connections 2023-10-14T09:17:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3194298325 wait complete. 2023-10-14T09:17:00.989 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca0e9b8640 1 Processor -- start 2023-10-14T09:17:00.989 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.980+0000 7fca0e9b8640 1 -- start start 2023-10-14T09:17:00.989 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca0e9b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca0806ad40 0x7fca081466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.989 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca0e9b8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca080c52f0 0x7fca08150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.990 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca0e9b8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca08157da0 0x7fca081455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:00.990 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca0e9b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca081ecc90 con 0x7fca0806ad40 2023-10-14T09:17:00.990 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca0e9b8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca081ecf50 con 0x7fca080c52f0 2023-10-14T09:17:00.990 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca0e9b8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0814f950 con 0x7fca08157da0 2023-10-14T09:17:00.990 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca0cf55640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca08157da0 0x7fca081455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.991 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca077fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca080c52f0 0x7fca08150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.991 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca07fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca0806ad40 0x7fca081466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:00.991 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca077fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca080c52f0 0x7fca08150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39314/0 (socket says 172.21.15.157:39314) 2023-10-14T09:17:00.991 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca077fe640 1 -- 172.21.15.157:0/3730225090 learned_addr learned my addr 172.21.15.157:0/3730225090 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:00.991 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca07fff640 1 -- 172.21.15.157:0/3730225090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca08157da0 msgr2=0x7fca081455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:00.992 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca07fff640 1 --2- 172.21.15.157:0/3730225090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca08157da0 0x7fca081455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.992 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca07fff640 1 -- 172.21.15.157:0/3730225090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca080c52f0 msgr2=0x7fca08150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:00.992 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca07fff640 1 --2- 172.21.15.157:0/3730225090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca080c52f0 0x7fca08150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:00.993 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca07fff640 1 -- 172.21.15.157:0/3730225090 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f80094d0 con 0x7fca0806ad40 2023-10-14T09:17:00.993 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca077fe640 1 --2- 172.21.15.157:0/3730225090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca080c52f0 0x7fca08150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:00.993 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca07fff640 1 --2- 172.21.15.157:0/3730225090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca0806ad40 0x7fca081466e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800e910 tx=0x7fc9f800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:00.994 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca04ff9640 1 -- 172.21.15.157:0/3730225090 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f800ca00 con 0x7fca0806ad40 2023-10-14T09:17:00.994 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca04ff9640 1 -- 172.21.15.157:0/3730225090 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f800cb60 con 0x7fca0806ad40 2023-10-14T09:17:00.994 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca04ff9640 1 -- 172.21.15.157:0/3730225090 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8004030 con 0x7fca0806ad40 2023-10-14T09:17:00.995 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3730225090 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca00009a70 con 0x7fca0806ad40 2023-10-14T09:17:00.995 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca04ff9640 1 -- 172.21.15.157:0/3730225090 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc9f8003620 con 0x7fca0806ad40 2023-10-14T09:17:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3730225090 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0814ff10 con 0x7fca0806ad40 2023-10-14T09:17:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca04ff9640 1 -- 172.21.15.157:0/3730225090 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc9f8003df0 con 0x7fca0806ad40 2023-10-14T09:17:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:00.984+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3730225090 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca08067250 con 0x7fca0806ad40 2023-10-14T09:17:01.011 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.008+0000 7fca04ff9640 1 -- 172.21.15.157:0/3730225090 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc9f803ab40 con 0x7fca0806ad40 2023-10-14T09:17:01.043 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:01.039+0000 7fcc85e46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T09:17:01.044 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:01.040+0000 7fcb5d603180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T09:17:01.077 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.072+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3730225090 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fb7f8a9f-6e8d-42c2-906d-79467322e729", "id": 0} v 0) v1 -- 0x7fca080730f0 con 0x7fca0806ad40 2023-10-14T09:17:01.080 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.076+0000 7fca04ff9640 1 -- 172.21.15.157:0/3730225090 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb7f8a9f-6e8d-42c2-906d-79467322e729", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc9f8029070 con 0x7fca0806ad40 2023-10-14T09:17:01.081 INFO:teuthology.orchestra.run.smithi157.stdout:0 2023-10-14T09:17:01.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.076+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3730225090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca0806ad40 msgr2=0x7fca081466e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.076+0000 7fca0e9b8640 1 --2- 172.21.15.157:0/3730225090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca0806ad40 0x7fca081466e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800e910 tx=0x7fc9f800edd0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.080+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3730225090 shutdown_connections 2023-10-14T09:17:01.083 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.080+0000 7fca0e9b8640 1 --2- 172.21.15.157:0/3730225090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca08157da0 0x7fca081455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.080+0000 7fca0e9b8640 1 --2- 172.21.15.157:0/3730225090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca080c52f0 0x7fca08150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.080+0000 7fca0e9b8640 1 --2- 172.21.15.157:0/3730225090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca0806ad40 0x7fca081466e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.080+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3730225090 >> 172.21.15.157:0/3730225090 conn(0x7fca080ab0f0 msgr2=0x7fca080ab4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:01.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.080+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3730225090 shutdown_connections 2023-10-14T09:17:01.084 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.080+0000 7fca0e9b8640 1 -- 172.21.15.157:0/3730225090 wait complete. 2023-10-14T09:17:01.100 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new c5c17401-4f3a-449f-b874-f5e42396a285 1 2023-10-14T09:17:01.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.232+0000 7fbc92686640 1 Processor -- start 2023-10-14T09:17:01.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.232+0000 7fbc92686640 1 -- start start 2023-10-14T09:17:01.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc92686640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbc8c0c52f0 0x7fbc8c154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.240 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc92686640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbc8c06ad40 0x7fbc8c157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc92686640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8c06b240 con 0x7fbc8c0c7500 2023-10-14T09:17:01.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc92686640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c06c050 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc92686640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c1544a0 con 0x7fbc8c06ad40 2023-10-14T09:17:01.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc8b7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbc8c06ad40 0x7fbc8c157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc90c23640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fbc8c0c7500 0x7fbc8c151070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:35190/0 (socket says 172.21.15.157:35190) 2023-10-14T09:17:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc8b7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbc8c06ad40 0x7fbc8c157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:39326/0 (socket says 172.21.15.157:39326) 2023-10-14T09:17:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc90c23640 1 -- 172.21.15.157:0/1281357195 learned_addr learned my addr 172.21.15.157:0/1281357195 (peer_addr_for_me v1:172.21.15.157:0/0) 2023-10-14T09:17:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc8bfff640 1 --2- 172.21.15.157:0/1281357195 >> v2:172.21.15.78:3300/0 conn(0x7fbc8c0c52f0 0x7fbc8c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc8b7fe640 1 -- 172.21.15.157:0/1281357195 >> v2:172.21.15.78:3300/0 conn(0x7fbc8c0c52f0 msgr2=0x7fbc8c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:01.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc8b7fe640 1 --2- 172.21.15.157:0/1281357195 >> v2:172.21.15.78:3300/0 conn(0x7fbc8c0c52f0 0x7fbc8c154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc8b7fe640 1 -- 172.21.15.157:0/1281357195 >> v1:172.21.15.157:6789/0 conn(0x7fbc8c0c7500 legacy=0x7fbc8c151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.236+0000 7fbc8b7fe640 1 -- 172.21.15.157:0/1281357195 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c1582e0 con 0x7fbc8c06ad40 2023-10-14T09:17:01.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc8b7fe640 1 --2- 172.21.15.157:0/1281357195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc8c06ad40 0x7fbc8c157da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0c9160 tx=0x7fbc8001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16837019445bcc9e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:01.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc8affd640 1 -- 172.21.15.157:0/1281357195 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc800ab600 con 0x7fbc8c06ad40 2023-10-14T09:17:01.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc8affd640 1 -- 172.21.15.157:0/1281357195 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc800a7050 con 0x7fbc8c06ad40 2023-10-14T09:17:01.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc8affd640 1 -- 172.21.15.157:0/1281357195 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc800ab980 con 0x7fbc8c06ad40 2023-10-14T09:17:01.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc92686640 1 -- 172.21.15.157:0/1281357195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc8c06ad40 msgr2=0x7fbc8c157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc92686640 1 --2- 172.21.15.157:0/1281357195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc8c06ad40 0x7fbc8c157da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0c9160 tx=0x7fbc8001c3d0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc92686640 1 -- 172.21.15.157:0/1281357195 shutdown_connections 2023-10-14T09:17:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc92686640 1 --2- 172.21.15.157:0/1281357195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc8c06ad40 0x7fbc8c157da0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc92686640 1 --2- 172.21.15.157:0/1281357195 >> v2:172.21.15.78:3300/0 conn(0x7fbc8c0c52f0 0x7fbc8c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc92686640 1 -- 172.21.15.157:0/1281357195 >> 172.21.15.157:0/1281357195 conn(0x7fbc8c0ab0f0 msgr2=0x7fbc8c0ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc92686640 1 -- 172.21.15.157:0/1281357195 shutdown_connections 2023-10-14T09:17:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.240+0000 7fbc92686640 1 -- 172.21.15.157:0/1281357195 wait complete. 2023-10-14T09:17:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc92686640 1 Processor -- start 2023-10-14T09:17:01.251 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc92686640 1 -- start start 2023-10-14T09:17:01.251 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc92686640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc8c06ad40 0x7fbc8c1ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.251 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc92686640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc8c0c52f0 0x7fbc8c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.252 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc92686640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc8c0c7500 0x7fbc8c1ef850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.252 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc92686640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1569d0 con 0x7fbc8c0c7500 2023-10-14T09:17:01.252 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc92686640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1ec2e0 con 0x7fbc8c06ad40 2023-10-14T09:17:01.253 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc92686640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c155750 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.254 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc8b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc8c0c52f0 0x7fbc8c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.254 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc8bfff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc8c06ad40 0x7fbc8c1ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc8b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc8c0c52f0 0x7fbc8c1524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:34458/0 (socket says 172.21.15.157:34458) 2023-10-14T09:17:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc8b7fe640 1 -- 172.21.15.157:0/3476444879 learned_addr learned my addr 172.21.15.157:0/3476444879 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc90c23640 1 --2- 172.21.15.157:0/3476444879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc8c0c7500 0x7fbc8c1ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc8b7fe640 1 -- 172.21.15.157:0/3476444879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc8c06ad40 msgr2=0x7fbc8c1ecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc8b7fe640 1 --2- 172.21.15.157:0/3476444879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc8c06ad40 0x7fbc8c1ecda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc8b7fe640 1 -- 172.21.15.157:0/3476444879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc8c0c7500 msgr2=0x7fbc8c1ef850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc8b7fe640 1 --2- 172.21.15.157:0/3476444879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc8c0c7500 0x7fbc8c1ef850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc8b7fe640 1 -- 172.21.15.157:0/3476444879 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc80009420 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.256 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc8bfff640 1 --2- 172.21.15.157:0/3476444879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc8c06ad40 0x7fbc8c1ecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc8b7fe640 1 --2- 172.21.15.157:0/3476444879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc8c0c52f0 0x7fbc8c1524e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbc800ae040 tx=0x7fbc80019170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc88ff9640 1 -- 172.21.15.157:0/3476444879 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc800b4840 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc88ff9640 1 -- 172.21.15.157:0/3476444879 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc800b49c0 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc88ff9640 1 -- 172.21.15.157:0/3476444879 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc800b4d70 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc92686640 1 -- 172.21.15.157:0/3476444879 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c155a30 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc92686640 1 -- 172.21.15.157:0/3476444879 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c1ec880 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc88ff9640 1 -- 172.21.15.157:0/3476444879 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbc800b2040 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc88ff9640 1 -- 172.21.15.157:0/3476444879 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fbc800aa750 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.258 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.244+0000 7fbc92686640 1 -- 172.21.15.157:0/3476444879 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c067250 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.259 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:01.248+0000 7fcb5d603180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T09:17:01.259 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.256+0000 7fbc88ff9640 1 -- 172.21.15.157:0/3476444879 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fbc800dbb40 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.260 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:01.251+0000 7fcc85e46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T09:17:01.327 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.324+0000 7fbc92686640 1 -- 172.21.15.157:0/3476444879 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c5c17401-4f3a-449f-b874-f5e42396a285", "id": 1} v 0) v1 -- 0x7fbc8c14e6a0 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.334 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.332+0000 7fbc88ff9640 1 -- 172.21.15.157:0/3476444879 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c5c17401-4f3a-449f-b874-f5e42396a285", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbc800ca030 con 0x7fbc8c0c52f0 2023-10-14T09:17:01.334 INFO:teuthology.orchestra.run.smithi157.stdout:1 2023-10-14T09:17:01.336 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.332+0000 7fbc92686640 1 -- 172.21.15.157:0/3476444879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc8c0c52f0 msgr2=0x7fbc8c1524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.336 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.332+0000 7fbc92686640 1 --2- 172.21.15.157:0/3476444879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc8c0c52f0 0x7fbc8c1524e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbc800ae040 tx=0x7fbc80019170 comp rx=0 tx=0).stop 2023-10-14T09:17:01.336 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.332+0000 7fbc92686640 1 -- 172.21.15.157:0/3476444879 shutdown_connections 2023-10-14T09:17:01.336 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.332+0000 7fbc92686640 1 --2- 172.21.15.157:0/3476444879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc8c0c7500 0x7fbc8c1ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.336 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.332+0000 7fbc92686640 1 --2- 172.21.15.157:0/3476444879 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc8c0c52f0 0x7fbc8c1524e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.337 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.332+0000 7fbc92686640 1 --2- 172.21.15.157:0/3476444879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc8c06ad40 0x7fbc8c1ecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.337 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.332+0000 7fbc92686640 1 -- 172.21.15.157:0/3476444879 >> 172.21.15.157:0/3476444879 conn(0x7fbc8c0ab0f0 msgr2=0x7fbc8c14d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:01.337 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.332+0000 7fbc92686640 1 -- 172.21.15.157:0/3476444879 shutdown_connections 2023-10-14T09:17:01.337 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.332+0000 7fbc92686640 1 -- 172.21.15.157:0/3476444879 wait complete. 2023-10-14T09:17:01.355 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new cda00e01-383f-4c56-a121-796e5f7c9c64 2 2023-10-14T09:17:01.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80ee09640 1 Processor -- start 2023-10-14T09:17:01.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80ee09640 1 -- start start 2023-10-14T09:17:01.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80ee09640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8080c4030 0x7fe8080c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80ee09640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe808153d90 0x7fe8081541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80ee09640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8080c7af0 con 0x7fe80806cc50 2023-10-14T09:17:01.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80ee09640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8080c5300 con 0x7fe808153d90 2023-10-14T09:17:01.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80ee09640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe808157360 con 0x7fe8080c4030 2023-10-14T09:17:01.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80cba5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8080c4030 0x7fe8080c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.494 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80d3a6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe808153d90 0x7fe8081541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80cba5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8080c4030 0x7fe8080c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:60940/0 (socket says 172.21.15.157:60940) 2023-10-14T09:17:01.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80cba5640 1 -- 172.21.15.157:0/3902142056 learned_addr learned my addr 172.21.15.157:0/3902142056 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:01.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80cba5640 1 -- 172.21.15.157:0/3902142056 >> v2:172.21.15.157:3300/0 conn(0x7fe808153d90 msgr2=0x7fe8081541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:01.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80cba5640 1 --2- 172.21.15.157:0/3902142056 >> v2:172.21.15.157:3300/0 conn(0x7fe808153d90 0x7fe8081541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.488+0000 7fe80cba5640 1 -- 172.21.15.157:0/3902142056 >> v1:172.21.15.78:6789/0 conn(0x7fe80806cc50 legacy=0x7fe8080c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.492+0000 7fe80cba5640 1 -- 172.21.15.157:0/3902142056 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808157ee0 con 0x7fe8080c4030 2023-10-14T09:17:01.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.492+0000 7fe80d3a6640 1 --2- 172.21.15.157:0/3902142056 >> v2:172.21.15.157:3300/0 conn(0x7fe808153d90 0x7fe8081541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:01.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.492+0000 7fe80cba5640 1 --2- 172.21.15.157:0/3902142056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8080c4030 0x7fe8080c75b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009870 tx=0x7fe7fc01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cb3119bedc64a2f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:01.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.492+0000 7fe8077fe640 1 -- 172.21.15.157:0/3902142056 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0aa610 con 0x7fe8080c4030 2023-10-14T09:17:01.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.492+0000 7fe8077fe640 1 -- 172.21.15.157:0/3902142056 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc0a6040 con 0x7fe8080c4030 2023-10-14T09:17:01.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.492+0000 7fe8077fe640 1 -- 172.21.15.157:0/3902142056 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0aa990 con 0x7fe8080c4030 2023-10-14T09:17:01.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.492+0000 7fe80ee09640 1 -- 172.21.15.157:0/3902142056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8080c4030 msgr2=0x7fe8080c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.492+0000 7fe80ee09640 1 --2- 172.21.15.157:0/3902142056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8080c4030 0x7fe8080c75b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009870 tx=0x7fe7fc01c4b0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.492+0000 7fe80ee09640 1 -- 172.21.15.157:0/3902142056 shutdown_connections 2023-10-14T09:17:01.500 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.492+0000 7fe80ee09640 1 --2- 172.21.15.157:0/3902142056 >> v2:172.21.15.157:3300/0 conn(0x7fe808153d90 0x7fe8081541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 --2- 172.21.15.157:0/3902142056 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe8080c4030 0x7fe8080c75b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 -- 172.21.15.157:0/3902142056 >> 172.21.15.157:0/3902142056 conn(0x7fe8080ab240 msgr2=0x7fe8080ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:01.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 -- 172.21.15.157:0/3902142056 shutdown_connections 2023-10-14T09:17:01.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 -- 172.21.15.157:0/3902142056 wait complete. 2023-10-14T09:17:01.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 Processor -- start 2023-10-14T09:17:01.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 -- start start 2023-10-14T09:17:01.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe80806cc50 0x7fe8081ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8080c4030 0x7fe808141a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe808153d90 0x7fe808141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe808149ff0 con 0x7fe8080c4030 2023-10-14T09:17:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8081f0520 con 0x7fe80806cc50 2023-10-14T09:17:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80ee09640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe808153440 con 0x7fe808153d90 2023-10-14T09:17:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80cba5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe80806cc50 0x7fe8081ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80d3a6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe808153d90 0x7fe808141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80cba5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe80806cc50 0x7fe8081ef840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52220/0 (socket says 172.21.15.157:52220) 2023-10-14T09:17:01.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80cba5640 1 -- 172.21.15.157:0/3804815478 learned_addr learned my addr 172.21.15.157:0/3804815478 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:01.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe807fff640 1 --2- 172.21.15.157:0/3804815478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8080c4030 0x7fe808141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80cba5640 1 -- 172.21.15.157:0/3804815478 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe808153d90 msgr2=0x7fe808141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80cba5640 1 --2- 172.21.15.157:0/3804815478 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe808153d90 0x7fe808141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80cba5640 1 -- 172.21.15.157:0/3804815478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8080c4030 msgr2=0x7fe808141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80cba5640 1 --2- 172.21.15.157:0/3804815478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8080c4030 0x7fe808141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80cba5640 1 -- 172.21.15.157:0/3804815478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe800009a70 con 0x7fe80806cc50 2023-10-14T09:17:01.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80d3a6640 1 --2- 172.21.15.157:0/3804815478 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe808153d90 0x7fe808141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:01.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.496+0000 7fe80cba5640 1 --2- 172.21.15.157:0/3804815478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe80806cc50 0x7fe8081ef840 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc01a0e0 tx=0x7fe7fc01acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:01.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.500+0000 7fe8057fa640 1 -- 172.21.15.157:0/3804815478 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0bd5f0 con 0x7fe80806cc50 2023-10-14T09:17:01.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.500+0000 7fe8057fa640 1 -- 172.21.15.157:0/3804815478 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc0bd750 con 0x7fe80806cc50 2023-10-14T09:17:01.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.500+0000 7fe80ee09640 1 -- 172.21.15.157:0/3804815478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc0094d0 con 0x7fe80806cc50 2023-10-14T09:17:01.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.500+0000 7fe8057fa640 1 -- 172.21.15.157:0/3804815478 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0bdb00 con 0x7fe80806cc50 2023-10-14T09:17:01.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.500+0000 7fe80ee09640 1 -- 172.21.15.157:0/3804815478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8080aac40 con 0x7fe80806cc50 2023-10-14T09:17:01.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.500+0000 7fe8057fa640 1 -- 172.21.15.157:0/3804815478 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe7fc0c63f0 con 0x7fe80806cc50 2023-10-14T09:17:01.508 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.500+0000 7fe8057fa640 1 -- 172.21.15.157:0/3804815478 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe7fc0b3810 con 0x7fe80806cc50 2023-10-14T09:17:01.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.500+0000 7fe80ee09640 1 -- 172.21.15.157:0/3804815478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8080aaa80 con 0x7fe80806cc50 2023-10-14T09:17:01.509 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.504+0000 7fe8057fa640 1 -- 172.21.15.157:0/3804815478 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe7fc0b33f0 con 0x7fe80806cc50 2023-10-14T09:17:01.572 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.568+0000 7fe80ee09640 1 -- 172.21.15.157:0/3804815478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cda00e01-383f-4c56-a121-796e5f7c9c64", "id": 2} v 0) v1 -- 0x7fe808074110 con 0x7fe80806cc50 2023-10-14T09:17:01.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.576+0000 7fe8057fa640 1 -- 172.21.15.157:0/3804815478 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cda00e01-383f-4c56-a121-796e5f7c9c64", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe7fc0b35d0 con 0x7fe80806cc50 2023-10-14T09:17:01.579 INFO:teuthology.orchestra.run.smithi157.stdout:2 2023-10-14T09:17:01.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.576+0000 7fe80ee09640 1 -- 172.21.15.157:0/3804815478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe80806cc50 msgr2=0x7fe8081ef840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.576+0000 7fe80ee09640 1 --2- 172.21.15.157:0/3804815478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe80806cc50 0x7fe8081ef840 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc01a0e0 tx=0x7fe7fc01acf0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.576+0000 7fe80ee09640 1 -- 172.21.15.157:0/3804815478 shutdown_connections 2023-10-14T09:17:01.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.576+0000 7fe80ee09640 1 --2- 172.21.15.157:0/3804815478 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe808153d90 0x7fe808141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.580 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.576+0000 7fe80ee09640 1 --2- 172.21.15.157:0/3804815478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8080c4030 0x7fe808141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.576+0000 7fe80ee09640 1 --2- 172.21.15.157:0/3804815478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe80806cc50 0x7fe8081ef840 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.576+0000 7fe80ee09640 1 -- 172.21.15.157:0/3804815478 >> 172.21.15.157:0/3804815478 conn(0x7fe8080ab240 msgr2=0x7fe808152900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:01.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.576+0000 7fe80ee09640 1 -- 172.21.15.157:0/3804815478 shutdown_connections 2023-10-14T09:17:01.581 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.576+0000 7fe80ee09640 1 -- 172.21.15.157:0/3804815478 wait complete. 2023-10-14T09:17:01.599 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813 3 2023-10-14T09:17:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.732+0000 7f7142dc5640 1 Processor -- start 2023-10-14T09:17:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.732+0000 7f7142dc5640 1 -- start start 2023-10-14T09:17:01.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.732+0000 7f7142dc5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f713c0c52f0 0x7f713c154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.732+0000 7f7142dc5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f713c157da0 0x7f713c151070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.732+0000 7f7142dc5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c06b240 con 0x7f713c06ad40 2023-10-14T09:17:01.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.732+0000 7f7142dc5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c06c050 con 0x7f713c157da0 2023-10-14T09:17:01.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.732+0000 7f7142dc5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c0c7c10 con 0x7f713c0c52f0 2023-10-14T09:17:01.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.736+0000 7f7140b61640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f713c0c52f0 0x7f713c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.736+0000 7f7140b61640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f713c0c52f0 0x7f713c154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52232/0 (socket says 172.21.15.157:52232) 2023-10-14T09:17:01.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.736+0000 7f7140b61640 1 -- 172.21.15.157:0/1046629398 learned_addr learned my addr 172.21.15.157:0/1046629398 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:01.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.736+0000 7f7141362640 1 --2- 172.21.15.157:0/1046629398 >> v2:172.21.15.78:3300/0 conn(0x7f713c157da0 0x7f713c151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.736+0000 7f7140b61640 1 -- 172.21.15.157:0/1046629398 >> v2:172.21.15.78:3300/0 conn(0x7f713c157da0 msgr2=0x7f713c151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:01.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.736+0000 7f7140b61640 1 --2- 172.21.15.157:0/1046629398 >> v2:172.21.15.78:3300/0 conn(0x7f713c157da0 0x7f713c151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.736+0000 7f7140b61640 1 -- 172.21.15.157:0/1046629398 >> v1:172.21.15.78:6789/0 conn(0x7f713c06ad40 legacy=0x7f713c0c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.736+0000 7f7140b61640 1 -- 172.21.15.157:0/1046629398 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c1544a0 con 0x7f713c0c52f0 2023-10-14T09:17:01.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.736+0000 7f7140b61640 1 --2- 172.21.15.157:0/1046629398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f713c0c52f0 0x7f713c154930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f713c06d030 tx=0x7f713001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63569c6a0916ee6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.736+0000 7f713b7fe640 1 -- 172.21.15.157:0/1046629398 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300ad660 con 0x7f713c0c52f0 2023-10-14T09:17:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f713b7fe640 1 -- 172.21.15.157:0/1046629398 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71300ad7c0 con 0x7f713c0c52f0 2023-10-14T09:17:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f713b7fe640 1 -- 172.21.15.157:0/1046629398 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300adb50 con 0x7f713c0c52f0 2023-10-14T09:17:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 -- 172.21.15.157:0/1046629398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f713c0c52f0 msgr2=0x7f713c154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 --2- 172.21.15.157:0/1046629398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f713c0c52f0 0x7f713c154930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f713c06d030 tx=0x7f713001c470 comp rx=0 tx=0).stop 2023-10-14T09:17:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 -- 172.21.15.157:0/1046629398 shutdown_connections 2023-10-14T09:17:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 --2- 172.21.15.157:0/1046629398 >> v2:172.21.15.78:3300/0 conn(0x7f713c157da0 0x7f713c151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 --2- 172.21.15.157:0/1046629398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f713c0c52f0 0x7f713c154930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 -- 172.21.15.157:0/1046629398 >> 172.21.15.157:0/1046629398 conn(0x7f713c0ab0f0 msgr2=0x7f713c0ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 -- 172.21.15.157:0/1046629398 shutdown_connections 2023-10-14T09:17:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 -- 172.21.15.157:0/1046629398 wait complete. 2023-10-14T09:17:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 Processor -- start 2023-10-14T09:17:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 -- start start 2023-10-14T09:17:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f713c06ad40 0x7f713c14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f713c0c52f0 0x7f713c145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f713c157da0 0x7f713c145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0a9a60 con 0x7f713c0c52f0 2023-10-14T09:17:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0a9fe0 con 0x7f713c06ad40 2023-10-14T09:17:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7142dc5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c14ec50 con 0x7f713c157da0 2023-10-14T09:17:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.740+0000 7f7140b61640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f713c06ad40 0x7f713c14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7140b61640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f713c06ad40 0x7f713c14fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52236/0 (socket says 172.21.15.157:52236) 2023-10-14T09:17:01.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7140b61640 1 -- 172.21.15.157:0/344679356 learned_addr learned my addr 172.21.15.157:0/344679356 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:01.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7141362640 1 --2- 172.21.15.157:0/344679356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f713c157da0 0x7f713c145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f713bfff640 1 --2- 172.21.15.157:0/344679356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f713c0c52f0 0x7f713c145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7140b61640 1 -- 172.21.15.157:0/344679356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f713c157da0 msgr2=0x7f713c145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7140b61640 1 --2- 172.21.15.157:0/344679356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f713c157da0 0x7f713c145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7140b61640 1 -- 172.21.15.157:0/344679356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f713c0c52f0 msgr2=0x7f713c145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7140b61640 1 --2- 172.21.15.157:0/344679356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f713c0c52f0 0x7f713c145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7140b61640 1 -- 172.21.15.157:0/344679356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300094d0 con 0x7f713c06ad40 2023-10-14T09:17:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7140b61640 1 --2- 172.21.15.157:0/344679356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f713c06ad40 0x7f713c14fae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7130019080 tx=0x7f7130019210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f71397fa640 1 -- 172.21.15.157:0/344679356 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300b6850 con 0x7f713c06ad40 2023-10-14T09:17:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f71397fa640 1 -- 172.21.15.157:0/344679356 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71300b69b0 con 0x7f713c06ad40 2023-10-14T09:17:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f71397fa640 1 -- 172.21.15.157:0/344679356 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300b6d40 con 0x7f713c06ad40 2023-10-14T09:17:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7142dc5640 1 -- 172.21.15.157:0/344679356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c0a9c70 con 0x7f713c06ad40 2023-10-14T09:17:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7142dc5640 1 -- 172.21.15.157:0/344679356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c0c3920 con 0x7f713c06ad40 2023-10-14T09:17:01.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f71397fa640 1 -- 172.21.15.157:0/344679356 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f71300b4070 con 0x7f713c06ad40 2023-10-14T09:17:01.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f71397fa640 1 -- 172.21.15.157:0/344679356 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f71300bfb90 con 0x7f713c06ad40 2023-10-14T09:17:01.752 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.744+0000 7f7142dc5640 1 -- 172.21.15.157:0/344679356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c0a9e00 con 0x7f713c06ad40 2023-10-14T09:17:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.748+0000 7f71397fa640 1 -- 172.21.15.157:0/344679356 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f71300ddb40 con 0x7f713c06ad40 2023-10-14T09:17:01.817 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.812+0000 7f7142dc5640 1 -- 172.21.15.157:0/344679356 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813", "id": 3} v 0) v1 -- 0x7f713c067250 con 0x7f713c06ad40 2023-10-14T09:17:01.822 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.820+0000 7f71397fa640 1 -- 172.21.15.157:0/344679356 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f71300cc030 con 0x7f713c06ad40 2023-10-14T09:17:01.823 INFO:teuthology.orchestra.run.smithi157.stdout:3 2023-10-14T09:17:01.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.820+0000 7f7142dc5640 1 -- 172.21.15.157:0/344679356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f713c06ad40 msgr2=0x7f713c14fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.820+0000 7f7142dc5640 1 --2- 172.21.15.157:0/344679356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f713c06ad40 0x7f713c14fae0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7130019080 tx=0x7f7130019210 comp rx=0 tx=0).stop 2023-10-14T09:17:01.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.820+0000 7f7142dc5640 1 -- 172.21.15.157:0/344679356 shutdown_connections 2023-10-14T09:17:01.824 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.820+0000 7f7142dc5640 1 --2- 172.21.15.157:0/344679356 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f713c157da0 0x7f713c145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.820+0000 7f7142dc5640 1 --2- 172.21.15.157:0/344679356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f713c0c52f0 0x7f713c145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.820+0000 7f7142dc5640 1 --2- 172.21.15.157:0/344679356 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f713c06ad40 0x7f713c14fae0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.820+0000 7f7142dc5640 1 -- 172.21.15.157:0/344679356 >> 172.21.15.157:0/344679356 conn(0x7f713c0ab0f0 msgr2=0x7f713c0c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:01.825 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.820+0000 7f7142dc5640 1 -- 172.21.15.157:0/344679356 shutdown_connections 2023-10-14T09:17:01.826 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.820+0000 7f7142dc5640 1 -- 172.21.15.157:0/344679356 wait complete. 2023-10-14T09:17:01.843 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 54c76eda-1a80-46b2-a1af-addca7fed3e8 4 2023-10-14T09:17:01.903 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:01.903+0000 7fcc85e46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T09:17:01.910 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:01.908+0000 7fcb5d603180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T09:17:01.964 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:01.963+0000 7fcc85e46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T09:17:01.974 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:01.972+0000 7fcb5d603180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T09:17:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.976+0000 7f30793d9640 1 Processor -- start 2023-10-14T09:17:01.980 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.976+0000 7f30793d9640 1 -- start start 2023-10-14T09:17:01.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.976+0000 7f30793d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30740c4030 0x7f30740c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.976+0000 7f30793d9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f307406cc50 0x7f30740c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.982 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.976+0000 7f30793d9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30740c7af0 con 0x7f3074153d90 2023-10-14T09:17:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.976+0000 7f30793d9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30740c5300 con 0x7f307406cc50 2023-10-14T09:17:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.976+0000 7f30793d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3074157360 con 0x7f30740c4030 2023-10-14T09:17:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3072ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30740c4030 0x7f30740c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3072ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30740c4030 0x7f30740c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:60966/0 (socket says 172.21.15.157:60966) 2023-10-14T09:17:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3072ffd640 1 -- 172.21.15.157:0/601306930 learned_addr learned my addr 172.21.15.157:0/601306930 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f30727fc640 1 --2- 172.21.15.157:0/601306930 >> v2:172.21.15.78:3300/0 conn(0x7f307406cc50 0x7f30740c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3072ffd640 1 -- 172.21.15.157:0/601306930 >> v2:172.21.15.78:3300/0 conn(0x7f307406cc50 msgr2=0x7f30740c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3072ffd640 1 --2- 172.21.15.157:0/601306930 >> v2:172.21.15.78:3300/0 conn(0x7f307406cc50 0x7f30740c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3072ffd640 1 -- 172.21.15.157:0/601306930 >> v1:172.21.15.157:6789/0 conn(0x7f3074153d90 legacy=0x7f30741541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3072ffd640 1 -- 172.21.15.157:0/601306930 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3074157ee0 con 0x7f30740c4030 2023-10-14T09:17:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3071ffb640 1 -- 172.21.15.157:0/601306930 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418393738 0 0) 0x7f30740c7af0 con 0x7f3074153d90 2023-10-14T09:17:01.985 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f30727fc640 1 --2- 172.21.15.157:0/601306930 >> v2:172.21.15.78:3300/0 conn(0x7f307406cc50 0x7f30740c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:01.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3072ffd640 1 --2- 172.21.15.157:0/601306930 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30740c4030 0x7f30740c75b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3064009870 tx=0x7f306401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e65d1a503b6bb96 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:01.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3071ffb640 1 -- 172.21.15.157:0/601306930 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30640ac620 con 0x7f30740c4030 2023-10-14T09:17:01.986 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3071ffb640 1 -- 172.21.15.157:0/601306930 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30640ac780 con 0x7f30740c4030 2023-10-14T09:17:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.980+0000 7f3071ffb640 1 -- 172.21.15.157:0/601306930 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30640acb10 con 0x7f30740c4030 2023-10-14T09:17:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.984+0000 7f30793d9640 1 -- 172.21.15.157:0/601306930 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30740c4030 msgr2=0x7f30740c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.984+0000 7f30793d9640 1 --2- 172.21.15.157:0/601306930 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30740c4030 0x7f30740c75b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3064009870 tx=0x7f306401c4b0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.984+0000 7f30793d9640 1 -- 172.21.15.157:0/601306930 shutdown_connections 2023-10-14T09:17:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.984+0000 7f30793d9640 1 --2- 172.21.15.157:0/601306930 >> v2:172.21.15.78:3300/0 conn(0x7f307406cc50 0x7f30740c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.984+0000 7f30793d9640 1 --2- 172.21.15.157:0/601306930 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30740c4030 0x7f30740c75b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.984+0000 7f30793d9640 1 -- 172.21.15.157:0/601306930 >> 172.21.15.157:0/601306930 conn(0x7f30740ab240 msgr2=0x7f30740ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:01.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.984+0000 7f30793d9640 1 -- 172.21.15.157:0/601306930 shutdown_connections 2023-10-14T09:17:01.988 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.984+0000 7f30793d9640 1 -- 172.21.15.157:0/601306930 wait complete. 2023-10-14T09:17:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.984+0000 7f30793d9640 1 Processor -- start 2023-10-14T09:17:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.984+0000 7f30793d9640 1 -- start start 2023-10-14T09:17:01.991 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30793d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307406cc50 0x7f30740c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.992 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30793d9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30740c4030 0x7f30741561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.992 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30793d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3074153d90 0x7f307414d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:01.992 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30793d9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30741ecc40 con 0x7f307406cc50 2023-10-14T09:17:01.992 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30793d9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30740c0ec0 con 0x7f30740c4030 2023-10-14T09:17:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30793d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30741ed130 con 0x7f3074153d90 2023-10-14T09:17:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30737fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3074153d90 0x7f307414d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30727fc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30740c4030 0x7f30741561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f3072ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307406cc50 0x7f30740c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30727fc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30740c4030 0x7f30741561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52250/0 (socket says 172.21.15.157:52250) 2023-10-14T09:17:01.994 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30737fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3074153d90 0x7f307414d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:60968/0 (socket says 172.21.15.157:60968) 2023-10-14T09:17:01.994 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30727fc640 1 -- 172.21.15.157:0/1862637443 learned_addr learned my addr 172.21.15.157:0/1862637443 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:01.994 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30727fc640 1 -- 172.21.15.157:0/1862637443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3074153d90 msgr2=0x7f307414d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.994 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30727fc640 1 --2- 172.21.15.157:0/1862637443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3074153d90 0x7f307414d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.994 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30727fc640 1 -- 172.21.15.157:0/1862637443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307406cc50 msgr2=0x7f30740c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:01.994 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30727fc640 1 --2- 172.21.15.157:0/1862637443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307406cc50 0x7f30740c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30727fc640 1 -- 172.21.15.157:0/1862637443 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640094d0 con 0x7f30740c4030 2023-10-14T09:17:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30737fe640 1 --2- 172.21.15.157:0/1862637443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3074153d90 0x7f307414d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f3072ffd640 1 --2- 172.21.15.157:0/1862637443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307406cc50 0x7f30740c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30727fc640 1 --2- 172.21.15.157:0/1862637443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30740c4030 0x7f30741561b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f306800e810 tx=0x7f306800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f305b7fe640 1 -- 172.21.15.157:0/1862637443 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800c6d0 con 0x7f30740c4030 2023-10-14T09:17:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f305b7fe640 1 -- 172.21.15.157:0/1862637443 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800c830 con 0x7f30740c4030 2023-10-14T09:17:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30793d9640 1 -- 172.21.15.157:0/1862637443 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3074157100 con 0x7f30740c4030 2023-10-14T09:17:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f305b7fe640 1 -- 172.21.15.157:0/1862637443 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800cbe0 con 0x7f30740c4030 2023-10-14T09:17:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f305b7fe640 1 -- 172.21.15.157:0/1862637443 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f306801c750 con 0x7f30740c4030 2023-10-14T09:17:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30793d9640 1 -- 172.21.15.157:0/1862637443 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30741ece50 con 0x7f30740c4030 2023-10-14T09:17:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f305b7fe640 1 -- 172.21.15.157:0/1862637443 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f306800ce00 con 0x7f30740c4030 2023-10-14T09:17:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.988+0000 7f30793d9640 1 -- 172.21.15.157:0/1862637443 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3074074110 con 0x7f30740c4030 2023-10-14T09:17:01.998 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:01.992+0000 7f305b7fe640 1 -- 172.21.15.157:0/1862637443 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3068021060 con 0x7f30740c4030 2023-10-14T09:17:02.025 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:02.023+0000 7fcc85e46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T09:17:02.042 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:02.040+0000 7fcb5d603180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T09:17:02.062 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.060+0000 7f30793d9640 1 -- 172.21.15.157:0/1862637443 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "54c76eda-1a80-46b2-a1af-addca7fed3e8", "id": 4} v 0) v1 -- 0x7f3074157b40 con 0x7f30740c4030 2023-10-14T09:17:02.069 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.064+0000 7f305b7fe640 1 -- 172.21.15.157:0/1862637443 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "54c76eda-1a80-46b2-a1af-addca7fed3e8", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3068017070 con 0x7f30740c4030 2023-10-14T09:17:02.070 INFO:teuthology.orchestra.run.smithi157.stdout:4 2023-10-14T09:17:02.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.068+0000 7f30793d9640 1 -- 172.21.15.157:0/1862637443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30740c4030 msgr2=0x7f30741561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.068+0000 7f30793d9640 1 --2- 172.21.15.157:0/1862637443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30740c4030 0x7f30741561b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f306800e810 tx=0x7f306800ecd0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.068+0000 7f30793d9640 1 -- 172.21.15.157:0/1862637443 shutdown_connections 2023-10-14T09:17:02.071 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.068+0000 7f30793d9640 1 --2- 172.21.15.157:0/1862637443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3074153d90 0x7f307414d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.068+0000 7f30793d9640 1 --2- 172.21.15.157:0/1862637443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30740c4030 0x7f30741561b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.068+0000 7f30793d9640 1 --2- 172.21.15.157:0/1862637443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f307406cc50 0x7f30740c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.068+0000 7f30793d9640 1 -- 172.21.15.157:0/1862637443 >> 172.21.15.157:0/1862637443 conn(0x7f30740ab240 msgr2=0x7f3074150ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:02.072 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.068+0000 7f30793d9640 1 -- 172.21.15.157:0/1862637443 shutdown_connections 2023-10-14T09:17:02.073 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.068+0000 7f30793d9640 1 -- 172.21.15.157:0/1862637443 wait complete. 2023-10-14T09:17:02.090 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 88a2bc95-e817-424d-9494-25456a052e54 5 2023-10-14T09:17:02.113 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:02.111+0000 7fcc85e46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T09:17:02.135 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:02.132+0000 7fcb5d603180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T09:17:02.172 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:02.171+0000 7fcc85e46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T09:17:02.197 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:02.192+0000 7fcb5d603180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T09:17:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.224+0000 7f62cac6b640 1 Processor -- start 2023-10-14T09:17:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.224+0000 7f62cac6b640 1 -- start start 2023-10-14T09:17:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62cac6b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f62c406cc50 0x7f62c40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62cac6b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62c4153d90 0x7f62c41541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62cac6b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c40c7af0 con 0x7f62c40c4030 2023-10-14T09:17:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62cac6b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40c5300 con 0x7f62c4153d90 2023-10-14T09:17:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62cac6b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c4157360 con 0x7f62c406cc50 2023-10-14T09:17:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62c3fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f62c406cc50 0x7f62c40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62c3fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f62c406cc50 0x7f62c40c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52264/0 (socket says 172.21.15.157:52264) 2023-10-14T09:17:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62c3fff640 1 -- 172.21.15.157:0/2400791047 learned_addr learned my addr 172.21.15.157:0/2400791047 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62c9208640 1 --2- 172.21.15.157:0/2400791047 >> v2:172.21.15.78:3300/0 conn(0x7f62c4153d90 0x7f62c41541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62c3fff640 1 -- 172.21.15.157:0/2400791047 >> v2:172.21.15.78:3300/0 conn(0x7f62c4153d90 msgr2=0x7f62c41541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:02.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62c3fff640 1 --2- 172.21.15.157:0/2400791047 >> v2:172.21.15.78:3300/0 conn(0x7f62c4153d90 0x7f62c41541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62c3fff640 1 -- 172.21.15.157:0/2400791047 >> v1:172.21.15.157:6789/0 conn(0x7f62c40c4030 legacy=0x7f62c40c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62c3fff640 1 -- 172.21.15.157:0/2400791047 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c4157ee0 con 0x7f62c406cc50 2023-10-14T09:17:02.234 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62c37fe640 1 -- 172.21.15.157:0/2400791047 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335856248 0 0) 0x7f62c40c7af0 con 0x7f62c40c4030 2023-10-14T09:17:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.228+0000 7f62c3fff640 1 --2- 172.21.15.157:0/2400791047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62c406cc50 0x7f62c40c75b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f62c40c6d50 tx=0x7f62b001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef9e36ed39daef6e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62c37fe640 1 -- 172.21.15.157:0/2400791047 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b00ab670 con 0x7f62c406cc50 2023-10-14T09:17:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62c37fe640 1 -- 172.21.15.157:0/2400791047 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b00ab7d0 con 0x7f62c406cc50 2023-10-14T09:17:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62c37fe640 1 -- 172.21.15.157:0/2400791047 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b00abb60 con 0x7f62c406cc50 2023-10-14T09:17:02.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 -- 172.21.15.157:0/2400791047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62c406cc50 msgr2=0x7f62c40c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 --2- 172.21.15.157:0/2400791047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62c406cc50 0x7f62c40c75b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f62c40c6d50 tx=0x7f62b001c470 comp rx=0 tx=0).stop 2023-10-14T09:17:02.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 -- 172.21.15.157:0/2400791047 shutdown_connections 2023-10-14T09:17:02.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 --2- 172.21.15.157:0/2400791047 >> v2:172.21.15.78:3300/0 conn(0x7f62c4153d90 0x7f62c41541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.237 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 --2- 172.21.15.157:0/2400791047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62c406cc50 0x7f62c40c75b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 -- 172.21.15.157:0/2400791047 >> 172.21.15.157:0/2400791047 conn(0x7f62c40ab240 msgr2=0x7f62c40ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:02.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 -- 172.21.15.157:0/2400791047 shutdown_connections 2023-10-14T09:17:02.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 -- 172.21.15.157:0/2400791047 wait complete. 2023-10-14T09:17:02.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 Processor -- start 2023-10-14T09:17:02.238 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 -- start start 2023-10-14T09:17:02.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62c406cc50 0x7f62c41553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62c40c4030 0x7f62c414a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c4153d90 0x7f62c414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40ac8d0 con 0x7f62c4153d90 2023-10-14T09:17:02.241 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41ec9d0 con 0x7f62c406cc50 2023-10-14T09:17:02.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.232+0000 7f62cac6b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c414b3c0 con 0x7f62c40c4030 2023-10-14T09:17:02.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c8a07640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62c406cc50 0x7f62c41553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62c40c4030 0x7f62c414a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62c40c4030 0x7f62c414a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:60972/0 (socket says 172.21.15.157:60972) 2023-10-14T09:17:02.242 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c9208640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c4153d90 0x7f62c414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c8a07640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62c406cc50 0x7f62c41553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52270/0 (socket says 172.21.15.157:52270) 2023-10-14T09:17:02.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c3fff640 1 -- 172.21.15.157:0/2175211212 learned_addr learned my addr 172.21.15.157:0/2175211212 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:02.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c8a07640 1 -- 172.21.15.157:0/2175211212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62c40c4030 msgr2=0x7f62c414a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c8a07640 1 --2- 172.21.15.157:0/2175211212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62c40c4030 0x7f62c414a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.243 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c8a07640 1 -- 172.21.15.157:0/2175211212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c4153d90 msgr2=0x7f62c414ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c8a07640 1 --2- 172.21.15.157:0/2175211212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c4153d90 0x7f62c414ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c8a07640 1 -- 172.21.15.157:0/2175211212 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b00094d0 con 0x7f62c406cc50 2023-10-14T09:17:02.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c3fff640 1 --2- 172.21.15.157:0/2175211212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62c40c4030 0x7f62c414a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:02.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c8a07640 1 --2- 172.21.15.157:0/2175211212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62c406cc50 0x7f62c41553c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f62b80011f0 tx=0x7f62b800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:02.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c17fa640 1 -- 172.21.15.157:0/2175211212 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b80052d0 con 0x7f62c406cc50 2023-10-14T09:17:02.244 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c17fa640 1 -- 172.21.15.157:0/2175211212 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b8005430 con 0x7f62c406cc50 2023-10-14T09:17:02.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c17fa640 1 -- 172.21.15.157:0/2175211212 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8003840 con 0x7f62c406cc50 2023-10-14T09:17:02.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62cac6b640 1 -- 172.21.15.157:0/2175211212 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c41ef4b0 con 0x7f62c406cc50 2023-10-14T09:17:02.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62cac6b640 1 -- 172.21.15.157:0/2175211212 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c41ec0a0 con 0x7f62c406cc50 2023-10-14T09:17:02.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c17fa640 1 -- 172.21.15.157:0/2175211212 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f62b8003ca0 con 0x7f62c406cc50 2023-10-14T09:17:02.245 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62c17fa640 1 -- 172.21.15.157:0/2175211212 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f62b8011b10 con 0x7f62c406cc50 2023-10-14T09:17:02.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.236+0000 7f62cac6b640 1 -- 172.21.15.157:0/2175211212 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c4074110 con 0x7f62c406cc50 2023-10-14T09:17:02.246 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.240+0000 7f62c17fa640 1 -- 172.21.15.157:0/2175211212 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f62b8017070 con 0x7f62c406cc50 2023-10-14T09:17:02.259 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:02.255+0000 7fcc85e46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T09:17:02.289 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:02.284+0000 7fcb5d603180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T09:17:02.312 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.308+0000 7f62cac6b640 1 -- 172.21.15.157:0/2175211212 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "88a2bc95-e817-424d-9494-25456a052e54", "id": 5} v 0) v1 -- 0x7f62c40c7040 con 0x7f62c406cc50 2023-10-14T09:17:02.316 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.312+0000 7f62c17fa640 1 -- 172.21.15.157:0/2175211212 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88a2bc95-e817-424d-9494-25456a052e54", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f62b8011590 con 0x7f62c406cc50 2023-10-14T09:17:02.316 INFO:teuthology.orchestra.run.smithi157.stdout:5 2023-10-14T09:17:02.317 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.312+0000 7f62cac6b640 1 -- 172.21.15.157:0/2175211212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62c406cc50 msgr2=0x7f62c41553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.312+0000 7f62cac6b640 1 --2- 172.21.15.157:0/2175211212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62c406cc50 0x7f62c41553c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f62b80011f0 tx=0x7f62b800c8c0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.312+0000 7f62cac6b640 1 -- 172.21.15.157:0/2175211212 shutdown_connections 2023-10-14T09:17:02.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.316+0000 7f62cac6b640 1 --2- 172.21.15.157:0/2175211212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62c4153d90 0x7f62c414ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.318 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.316+0000 7f62cac6b640 1 --2- 172.21.15.157:0/2175211212 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62c40c4030 0x7f62c414a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.316+0000 7f62cac6b640 1 --2- 172.21.15.157:0/2175211212 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62c406cc50 0x7f62c41553c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.316+0000 7f62cac6b640 1 -- 172.21.15.157:0/2175211212 >> 172.21.15.157:0/2175211212 conn(0x7f62c40ab240 msgr2=0x7f62c4151680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:02.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.316+0000 7f62cac6b640 1 -- 172.21.15.157:0/2175211212 shutdown_connections 2023-10-14T09:17:02.319 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.316+0000 7f62cac6b640 1 -- 172.21.15.157:0/2175211212 wait complete. 2023-10-14T09:17:02.320 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:02.319+0000 7fcc85e46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T09:17:02.336 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new d2e85be6-a9ed-4e64-bcb1-186878103a71 6 2023-10-14T09:17:02.352 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:02.348+0000 7fcb5d603180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T09:17:02.473 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:02.471+0000 7fcc85e46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T09:17:02.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.484+0000 7f625299d640 1 Processor -- start 2023-10-14T09:17:02.489 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.484+0000 7f625299d640 1 -- start start 2023-10-14T09:17:02.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f625299d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f624c0c4030 0x7f624c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.490 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f625299d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f624c153d90 0x7f624c1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f625299d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c0c7af0 con 0x7f624c06cc50 2023-10-14T09:17:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f625299d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c0c5300 con 0x7f624c0c4030 2023-10-14T09:17:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f625299d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c157360 con 0x7f624c153d90 2023-10-14T09:17:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f6250f3a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f624c153d90 0x7f624c1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f6250f3a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f624c153d90 0x7f624c1541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52286/0 (socket says 172.21.15.157:52286) 2023-10-14T09:17:02.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f624bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f624c0c4030 0x7f624c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f6250f3a640 1 -- 172.21.15.157:0/2463380421 learned_addr learned my addr 172.21.15.157:0/2463380421 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:02.492 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f6250f3a640 1 -- 172.21.15.157:0/2463380421 >> v2:172.21.15.78:3300/0 conn(0x7f624c0c4030 msgr2=0x7f624c0c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:02.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f6250f3a640 1 --2- 172.21.15.157:0/2463380421 >> v2:172.21.15.78:3300/0 conn(0x7f624c0c4030 0x7f624c0c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f6250f3a640 1 -- 172.21.15.157:0/2463380421 >> v1:172.21.15.78:6789/0 conn(0x7f624c06cc50 legacy=0x7f624c0c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.493 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.488+0000 7f6250f3a640 1 -- 172.21.15.157:0/2463380421 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c157ee0 con 0x7f624c153d90 2023-10-14T09:17:02.495 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f6250f3a640 1 --2- 172.21.15.157:0/2463380421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624c153d90 0x7f624c1541a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f624c0c0710 tx=0x7f624401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3e7565982121bcf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:02.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f624affd640 1 -- 172.21.15.157:0/2463380421 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440a5800 con 0x7f624c153d90 2023-10-14T09:17:02.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f624affd640 1 -- 172.21.15.157:0/2463380421 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62440a5960 con 0x7f624c153d90 2023-10-14T09:17:02.496 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f624affd640 1 -- 172.21.15.157:0/2463380421 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440a5cf0 con 0x7f624c153d90 2023-10-14T09:17:02.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f625299d640 1 -- 172.21.15.157:0/2463380421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624c153d90 msgr2=0x7f624c1541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.497 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f625299d640 1 --2- 172.21.15.157:0/2463380421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624c153d90 0x7f624c1541a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f624c0c0710 tx=0x7f624401c940 comp rx=0 tx=0).stop 2023-10-14T09:17:02.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f625299d640 1 -- 172.21.15.157:0/2463380421 shutdown_connections 2023-10-14T09:17:02.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f625299d640 1 --2- 172.21.15.157:0/2463380421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624c153d90 0x7f624c1541a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f625299d640 1 --2- 172.21.15.157:0/2463380421 >> v2:172.21.15.78:3300/0 conn(0x7f624c0c4030 0x7f624c0c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f625299d640 1 -- 172.21.15.157:0/2463380421 >> 172.21.15.157:0/2463380421 conn(0x7f624c0ab240 msgr2=0x7f624c0ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:02.498 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f625299d640 1 -- 172.21.15.157:0/2463380421 shutdown_connections 2023-10-14T09:17:02.499 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.492+0000 7f625299d640 1 -- 172.21.15.157:0/2463380421 wait complete. 2023-10-14T09:17:02.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f625299d640 1 Processor -- start 2023-10-14T09:17:02.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f625299d640 1 -- start start 2023-10-14T09:17:02.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f625299d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624c06cc50 0x7f624c1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.501 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f625299d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f624c0c4030 0x7f624c14a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f625299d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f624c153d90 0x7f624c14aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f625299d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1ec6c0 con 0x7f624c153d90 2023-10-14T09:17:02.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f625299d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1ec9a0 con 0x7f624c06cc50 2023-10-14T09:17:02.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f625299d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1ecc80 con 0x7f624c0c4030 2023-10-14T09:17:02.502 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f624bfff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624c06cc50 0x7f624c1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f624b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f624c0c4030 0x7f624c14a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f624bfff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624c06cc50 0x7f624c1553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52290/0 (socket says 172.21.15.157:52290) 2023-10-14T09:17:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f624bfff640 1 -- 172.21.15.157:0/354355557 learned_addr learned my addr 172.21.15.157:0/354355557 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f6250f3a640 1 --2- 172.21.15.157:0/354355557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f624c153d90 0x7f624c14aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f624bfff640 1 -- 172.21.15.157:0/354355557 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f624c0c4030 msgr2=0x7f624c14a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f624bfff640 1 --2- 172.21.15.157:0/354355557 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f624c0c4030 0x7f624c14a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f624bfff640 1 -- 172.21.15.157:0/354355557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f624c153d90 msgr2=0x7f624c14aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f624bfff640 1 --2- 172.21.15.157:0/354355557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f624c153d90 0x7f624c14aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f624bfff640 1 -- 172.21.15.157:0/354355557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6244009b30 con 0x7f624c06cc50 2023-10-14T09:17:02.504 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f624bfff640 1 --2- 172.21.15.157:0/354355557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624c06cc50 0x7f624c1553e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f623c00e930 tx=0x7f623c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:02.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f6248ff9640 1 -- 172.21.15.157:0/354355557 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c009690 con 0x7f624c06cc50 2023-10-14T09:17:02.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f6248ff9640 1 -- 172.21.15.157:0/354355557 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c00ca00 con 0x7f624c06cc50 2023-10-14T09:17:02.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f6248ff9640 1 -- 172.21.15.157:0/354355557 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00cd70 con 0x7f624c06cc50 2023-10-14T09:17:02.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f625299d640 1 -- 172.21.15.157:0/354355557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c1ecf60 con 0x7f624c06cc50 2023-10-14T09:17:02.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f625299d640 1 -- 172.21.15.157:0/354355557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c155920 con 0x7f624c06cc50 2023-10-14T09:17:02.505 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f6248ff9640 1 -- 172.21.15.157:0/354355557 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f623c005ca0 con 0x7f624c06cc50 2023-10-14T09:17:02.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.496+0000 7f6248ff9640 1 -- 172.21.15.157:0/354355557 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f623c013470 con 0x7f624c06cc50 2023-10-14T09:17:02.506 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.500+0000 7f625299d640 1 -- 172.21.15.157:0/354355557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c074110 con 0x7f624c06cc50 2023-10-14T09:17:02.507 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.500+0000 7f6248ff9640 1 -- 172.21.15.157:0/354355557 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f623c021060 con 0x7f624c06cc50 2023-10-14T09:17:02.517 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:02.512+0000 7fcb5d603180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T09:17:02.541 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:02.539+0000 7fcc85e46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T09:17:02.570 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.568+0000 7f625299d640 1 -- 172.21.15.157:0/354355557 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2e85be6-a9ed-4e64-bcb1-186878103a71", "id": 6} v 0) v1 -- 0x7f624c0c7040 con 0x7f624c06cc50 2023-10-14T09:17:02.575 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.572+0000 7f6248ff9640 1 -- 172.21.15.157:0/354355557 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2e85be6-a9ed-4e64-bcb1-186878103a71", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f623c029020 con 0x7f624c06cc50 2023-10-14T09:17:02.575 INFO:teuthology.orchestra.run.smithi157.stdout:6 2023-10-14T09:17:02.576 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.572+0000 7f625299d640 1 -- 172.21.15.157:0/354355557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624c06cc50 msgr2=0x7f624c1553e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.572+0000 7f625299d640 1 --2- 172.21.15.157:0/354355557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624c06cc50 0x7f624c1553e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f623c00e930 tx=0x7f623c00edf0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.572+0000 7f625299d640 1 -- 172.21.15.157:0/354355557 shutdown_connections 2023-10-14T09:17:02.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.572+0000 7f625299d640 1 --2- 172.21.15.157:0/354355557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f624c153d90 0x7f624c14aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.572+0000 7f625299d640 1 --2- 172.21.15.157:0/354355557 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f624c0c4030 0x7f624c14a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.572+0000 7f625299d640 1 --2- 172.21.15.157:0/354355557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624c06cc50 0x7f624c1553e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.577 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.572+0000 7f625299d640 1 -- 172.21.15.157:0/354355557 >> 172.21.15.157:0/354355557 conn(0x7f624c0ab240 msgr2=0x7f624c0c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:02.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.572+0000 7f625299d640 1 -- 172.21.15.157:0/354355557 shutdown_connections 2023-10-14T09:17:02.578 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.572+0000 7f625299d640 1 -- 172.21.15.157:0/354355557 wait complete. 2023-10-14T09:17:02.587 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:02.584+0000 7fcb5d603180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T09:17:02.594 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 0627beaf-ae5b-42df-a6a6-9090c3ee77c4 7 2023-10-14T09:17:02.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.728+0000 7f61b8646640 1 Processor -- start 2023-10-14T09:17:02.732 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.728+0000 7f61b8646640 1 -- start start 2023-10-14T09:17:02.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.728+0000 7f61b8646640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b00c52f0 0x7f61b0154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.728+0000 7f61b8646640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61b0157da0 0x7f61b0151070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.728+0000 7f61b8646640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b006b240 con 0x7f61b006ad40 2023-10-14T09:17:02.734 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.728+0000 7f61b8646640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b006c050 con 0x7f61b0157da0 2023-10-14T09:17:02.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.728+0000 7f61b8646640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00c7c10 con 0x7f61b00c52f0 2023-10-14T09:17:02.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.728+0000 7f61b63e2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b00c52f0 0x7f61b0154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.728+0000 7f61b63e2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b00c52f0 0x7f61b0154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:60984/0 (socket says 172.21.15.157:60984) 2023-10-14T09:17:02.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.728+0000 7f61b63e2640 1 -- 172.21.15.157:0/1195808503 learned_addr learned my addr 172.21.15.157:0/1195808503 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:02.735 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.728+0000 7f61b6be3640 1 --2- 172.21.15.157:0/1195808503 >> v2:172.21.15.78:3300/0 conn(0x7f61b0157da0 0x7f61b0151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.732+0000 7f61b63e2640 1 -- 172.21.15.157:0/1195808503 >> v2:172.21.15.78:3300/0 conn(0x7f61b0157da0 msgr2=0x7f61b0151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:02.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.732+0000 7f61b63e2640 1 --2- 172.21.15.157:0/1195808503 >> v2:172.21.15.78:3300/0 conn(0x7f61b0157da0 0x7f61b0151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.732+0000 7f61b63e2640 1 -- 172.21.15.157:0/1195808503 >> v1:172.21.15.78:6789/0 conn(0x7f61b006ad40 legacy=0x7f61b00c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.736 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.732+0000 7f61b63e2640 1 -- 172.21.15.157:0/1195808503 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b01544a0 con 0x7f61b00c52f0 2023-10-14T09:17:02.737 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.732+0000 7f61b63e2640 1 --2- 172.21.15.157:0/1195808503 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b00c52f0 0x7f61b0154930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009870 tx=0x7f61ac01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e02cdc77c1ce231 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:02.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.732+0000 7f61b53e0640 1 -- 172.21.15.157:0/1195808503 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0ac600 con 0x7f61b00c52f0 2023-10-14T09:17:02.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.732+0000 7f61b53e0640 1 -- 172.21.15.157:0/1195808503 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac0a8050 con 0x7f61b00c52f0 2023-10-14T09:17:02.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.732+0000 7f61b53e0640 1 -- 172.21.15.157:0/1195808503 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0ac980 con 0x7f61b00c52f0 2023-10-14T09:17:02.738 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 -- 172.21.15.157:0/1195808503 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b00c52f0 msgr2=0x7f61b0154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 --2- 172.21.15.157:0/1195808503 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b00c52f0 0x7f61b0154930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f61ac009870 tx=0x7f61ac01c4b0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.739 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 -- 172.21.15.157:0/1195808503 shutdown_connections 2023-10-14T09:17:02.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 --2- 172.21.15.157:0/1195808503 >> v2:172.21.15.78:3300/0 conn(0x7f61b0157da0 0x7f61b0151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 --2- 172.21.15.157:0/1195808503 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b00c52f0 0x7f61b0154930 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 -- 172.21.15.157:0/1195808503 >> 172.21.15.157:0/1195808503 conn(0x7f61b00ab0f0 msgr2=0x7f61b00ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:02.740 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 -- 172.21.15.157:0/1195808503 shutdown_connections 2023-10-14T09:17:02.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 -- 172.21.15.157:0/1195808503 wait complete. 2023-10-14T09:17:02.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 Processor -- start 2023-10-14T09:17:02.741 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 -- start start 2023-10-14T09:17:02.743 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b006ad40 0x7f61b01561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61b00c52f0 0x7f61b01566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b0157da0 0x7f61b014f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:02.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b014e0d0 con 0x7f61b00c52f0 2023-10-14T09:17:02.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0150a30 con 0x7f61b006ad40 2023-10-14T09:17:02.744 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b8646640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0150750 con 0x7f61b0157da0 2023-10-14T09:17:02.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b6be3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b0157da0 0x7f61b014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b63e2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b006ad40 0x7f61b01561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b63e2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b006ad40 0x7f61b01561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:52292/0 (socket says 172.21.15.157:52292) 2023-10-14T09:17:02.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b63e2640 1 -- 172.21.15.157:0/40780632 learned_addr learned my addr 172.21.15.157:0/40780632 (peer_addr_for_me v2:172.21.15.157:0/0) 2023-10-14T09:17:02.745 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b5be1640 1 --2- 172.21.15.157:0/40780632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61b00c52f0 0x7f61b01566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:02.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b6be3640 1 -- 172.21.15.157:0/40780632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b006ad40 msgr2=0x7f61b01561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b6be3640 1 --2- 172.21.15.157:0/40780632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b006ad40 0x7f61b01561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b6be3640 1 -- 172.21.15.157:0/40780632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61b00c52f0 msgr2=0x7f61b01566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b6be3640 1 --2- 172.21.15.157:0/40780632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61b00c52f0 0x7f61b01566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.746 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b6be3640 1 -- 172.21.15.157:0/40780632 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac0094d0 con 0x7f61b0157da0 2023-10-14T09:17:02.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.736+0000 7f61b63e2640 1 --2- 172.21.15.157:0/40780632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b006ad40 0x7f61b01561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:02.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.740+0000 7f61b6be3640 1 --2- 172.21.15.157:0/40780632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b0157da0 0x7f61b014f350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f61a800eba0 tx=0x7f61a800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:02.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.740+0000 7f61a6ffd640 1 -- 172.21.15.157:0/40780632 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a800cd20 con 0x7f61b0157da0 2023-10-14T09:17:02.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.740+0000 7f61a6ffd640 1 -- 172.21.15.157:0/40780632 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a800f040 con 0x7f61b0157da0 2023-10-14T09:17:02.747 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.740+0000 7f61a6ffd640 1 -- 172.21.15.157:0/40780632 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80146c0 con 0x7f61b0157da0 2023-10-14T09:17:02.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.740+0000 7f61b8646640 1 -- 172.21.15.157:0/40780632 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b00aa530 con 0x7f61b0157da0 2023-10-14T09:17:02.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.740+0000 7f61b8646640 1 -- 172.21.15.157:0/40780632 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b00aaaf0 con 0x7f61b0157da0 2023-10-14T09:17:02.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.740+0000 7f61a6ffd640 1 -- 172.21.15.157:0/40780632 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f61a8014b20 con 0x7f61b0157da0 2023-10-14T09:17:02.748 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.740+0000 7f61a6ffd640 1 -- 172.21.15.157:0/40780632 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f61a8014dd0 con 0x7f61b0157da0 2023-10-14T09:17:02.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.740+0000 7f61b8646640 1 -- 172.21.15.157:0/40780632 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b0067250 con 0x7f61b0157da0 2023-10-14T09:17:02.749 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.740+0000 7f61a6ffd640 1 -- 172.21.15.157:0/40780632 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f61a803bb40 con 0x7f61b0157da0 2023-10-14T09:17:02.811 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.808+0000 7f61b8646640 1 -- 172.21.15.157:0/40780632 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0627beaf-ae5b-42df-a6a6-9090c3ee77c4", "id": 7} v 0) v1 -- 0x7f61b014e360 con 0x7f61b0157da0 2023-10-14T09:17:02.815 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.812+0000 7f61a6ffd640 1 -- 172.21.15.157:0/40780632 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0627beaf-ae5b-42df-a6a6-9090c3ee77c4", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f61a802a070 con 0x7f61b0157da0 2023-10-14T09:17:02.815 INFO:teuthology.orchestra.run.smithi157.stdout:7 2023-10-14T09:17:02.816 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.812+0000 7f61b8646640 1 -- 172.21.15.157:0/40780632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b0157da0 msgr2=0x7f61b014f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:02.817 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.812+0000 7f61b8646640 1 --2- 172.21.15.157:0/40780632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b0157da0 0x7f61b014f350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f61a800eba0 tx=0x7f61a800c490 comp rx=0 tx=0).stop 2023-10-14T09:17:02.817 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.812+0000 7f61b8646640 1 -- 172.21.15.157:0/40780632 shutdown_connections 2023-10-14T09:17:02.817 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.812+0000 7f61b8646640 1 --2- 172.21.15.157:0/40780632 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f61b0157da0 0x7f61b014f350 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.817 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.812+0000 7f61b8646640 1 --2- 172.21.15.157:0/40780632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61b00c52f0 0x7f61b01566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.817 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.812+0000 7f61b8646640 1 --2- 172.21.15.157:0/40780632 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61b006ad40 0x7f61b01561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:02.818 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.812+0000 7f61b8646640 1 -- 172.21.15.157:0/40780632 >> 172.21.15.157:0/40780632 conn(0x7f61b00ab0f0 msgr2=0x7f61b0072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:02.818 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.812+0000 7f61b8646640 1 -- 172.21.15.157:0/40780632 shutdown_connections 2023-10-14T09:17:02.818 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:02.812+0000 7f61b8646640 1 -- 172.21.15.157:0/40780632 wait complete. 2023-10-14T09:17:02.834 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T09:17:02.835 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T09:17:02.838 INFO:tasks.ceph.osd.0:Started 2023-10-14T09:17:02.839 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T09:17:02.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T09:17:02.844 INFO:tasks.ceph.osd.1:Started 2023-10-14T09:17:02.845 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T09:17:02.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T09:17:02.855 INFO:tasks.ceph.osd.2:Started 2023-10-14T09:17:02.855 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-14T09:17:02.855 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-14T09:17:02.869 INFO:tasks.ceph.osd.3:Started 2023-10-14T09:17:02.870 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-14T09:17:02.870 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-14T09:17:02.874 INFO:tasks.ceph.osd.4:Started 2023-10-14T09:17:02.874 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-14T09:17:02.875 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-14T09:17:02.878 INFO:tasks.ceph.osd.5:Started 2023-10-14T09:17:02.879 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-14T09:17:02.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-14T09:17:02.894 INFO:tasks.ceph.osd.6:Started 2023-10-14T09:17:02.894 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-14T09:17:02.895 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-14T09:17:02.906 INFO:tasks.ceph.osd.7:Started 2023-10-14T09:17:02.907 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:03.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.087+0000 7fcd43c46640 1 Processor -- start 2023-10-14T09:17:03.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.087+0000 7fcd43c46640 1 -- start start 2023-10-14T09:17:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd43c46640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd3c0c7780 0x7fcd3c0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd43c46640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c0c7020 con 0x7fcd3c14ddb0 2023-10-14T09:17:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd43c46640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c06c470 con 0x7fcd3c153e80 2023-10-14T09:17:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd43c46640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0c64f0 con 0x7fcd3c0c7780 2023-10-14T09:17:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd419e2640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcd3c14ddb0 0x7fcd3c06bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42368/0 (socket says 172.21.15.78:42368) 2023-10-14T09:17:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd419e2640 1 -- 172.21.15.78:0/3361924468 learned_addr learned my addr 172.21.15.78:0/3361924468 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd421e3640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd3c0c7780 0x7fcd3c0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:03.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001646314 0 0) 0x7fcd3c0c7020 con 0x7fcd3c14ddb0 2023-10-14T09:17:03.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd28003530 con 0x7fcd3c14ddb0 2023-10-14T09:17:03.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527681415 0 0) 0x7fcd3c06c470 con 0x7fcd3c153e80 2023-10-14T09:17:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd3c0c7020 con 0x7fcd3c153e80 2023-10-14T09:17:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357365315 0 0) 0x7fcd28003530 con 0x7fcd3c14ddb0 2023-10-14T09:17:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd3c0c7780 msgr2=0x7fcd3c0c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd3c0c7780 0x7fcd3c0c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 >> v1:172.21.15.157:6789/0 conn(0x7fcd3c153e80 legacy=0x7fcd3c0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c06c750 con 0x7fcd3c14ddb0 2023-10-14T09:17:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7fcd38001680 con 0x7fcd3c14ddb0 2023-10-14T09:17:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 >> v1:172.21.15.78:6789/0 conn(0x7fcd3c14ddb0 legacy=0x7fcd3c06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28003b40 0x7fcd28003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd3c0c7780 0x7fcd280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd28004d10 0x7fcd28005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0c64f0 con 0x7fcd28004d10 2023-10-14T09:17:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2800bb50 con 0x7fcd28003b40 2023-10-14T09:17:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2800bd10 con 0x7fcd3c0c7780 2023-10-14T09:17:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd421e3640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd28004d10 0x7fcd28005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd419e2640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28003b40 0x7fcd28003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd411e1640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd3c0c7780 0x7fcd280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd421e3640 1 -- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd3c0c7780 msgr2=0x7fcd280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd421e3640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd3c0c7780 0x7fcd280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd421e3640 1 -- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28003b40 msgr2=0x7fcd28003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd421e3640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28003b40 0x7fcd28003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd421e3640 1 -- 172.21.15.78:0/3361924468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28003530 con 0x7fcd28004d10 2023-10-14T09:17:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.091+0000 7fcd419e2640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd28003b40 0x7fcd28003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd421e3640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd28004d10 0x7fcd28005190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009fc0 tx=0x7fcd3401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566a0160b95a6847 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340a5850 con 0x7fcd28004d10 2023-10-14T09:17:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3400f040 con 0x7fcd28004d10 2023-10-14T09:17:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd409e0640 1 -- 172.21.15.78:0/3361924468 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340a5bf0 con 0x7fcd28004d10 2023-10-14T09:17:03.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd43c46640 1 -- 172.21.15.78:0/3361924468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd28004d10 msgr2=0x7fcd28005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:03.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd43c46640 1 --2- 172.21.15.78:0/3361924468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd28004d10 0x7fcd28005190 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009fc0 tx=0x7fcd3401cc60 comp rx=0 tx=0).stop 2023-10-14T09:17:03.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd421e3640 1 -- 172.21.15.78:0/3361924468 reap_dead start 2023-10-14T09:17:03.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd43c46640 1 -- 172.21.15.78:0/3361924468 shutdown_connections 2023-10-14T09:17:03.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd43c46640 1 -- 172.21.15.78:0/3361924468 >> 172.21.15.78:0/3361924468 conn(0x7fcd3c0ab1f0 msgr2=0x7fcd3c0ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:03.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd43c46640 1 -- 172.21.15.78:0/3361924468 shutdown_connections 2023-10-14T09:17:03.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd43c46640 1 -- 172.21.15.78:0/3361924468 wait complete. 2023-10-14T09:17:03.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd43c46640 1 Processor -- start 2023-10-14T09:17:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.095+0000 7fcd43c46640 1 -- start start 2023-10-14T09:17:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd43c46640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd28004d10 0x7fcd3c0c15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd43c46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd3c1572b0 0x7fcd3c1ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd43c46640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd3c1ef880 0x7fcd3c1ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd43c46640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0c08d0 con 0x7fcd3c1572b0 2023-10-14T09:17:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd43c46640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c156ab0 con 0x7fcd3c1ef880 2023-10-14T09:17:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd43c46640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c156d90 con 0x7fcd28004d10 2023-10-14T09:17:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd411e1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd3c1572b0 0x7fcd3c1ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd419e2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd28004d10 0x7fcd3c0c15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd419e2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd28004d10 0x7fcd3c0c15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:39556/0 (socket says 172.21.15.78:39556) 2023-10-14T09:17:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd411e1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd3c1572b0 0x7fcd3c1ef340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38630/0 (socket says 172.21.15.78:38630) 2023-10-14T09:17:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd419e2640 1 -- 172.21.15.78:0/3327028599 learned_addr learned my addr 172.21.15.78:0/3327028599 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd421e3640 1 --2- 172.21.15.78:0/3327028599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd3c1ef880 0x7fcd3c1ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd411e1640 1 -- 172.21.15.78:0/3327028599 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd28004d10 msgr2=0x7fcd3c0c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd411e1640 1 --2- 172.21.15.78:0/3327028599 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd28004d10 0x7fcd3c0c15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd411e1640 1 -- 172.21.15.78:0/3327028599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd3c1ef880 msgr2=0x7fcd3c1ebb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd411e1640 1 --2- 172.21.15.78:0/3327028599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd3c1ef880 0x7fcd3c1ebb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd411e1640 1 -- 172.21.15.78:0/3327028599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0c0bb0 con 0x7fcd3c1572b0 2023-10-14T09:17:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd411e1640 1 --2- 172.21.15.78:0/3327028599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd3c1572b0 0x7fcd3c1ef340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00f770 tx=0x7fcd2c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd327fc640 1 -- 172.21.15.78:0/3327028599 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c005110 con 0x7fcd3c1572b0 2023-10-14T09:17:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd327fc640 1 -- 172.21.15.78:0/3327028599 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c005290 con 0x7fcd3c1572b0 2023-10-14T09:17:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd43c46640 1 -- 172.21.15.78:0/3327028599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c0c8650 con 0x7fcd3c1572b0 2023-10-14T09:17:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd327fc640 1 -- 172.21.15.78:0/3327028599 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0067e0 con 0x7fcd3c1572b0 2023-10-14T09:17:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd43c46640 1 -- 172.21.15.78:0/3327028599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c157900 con 0x7fcd3c1572b0 2023-10-14T09:17:03.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd327fc640 1 -- 172.21.15.78:0/3327028599 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcd2c006c40 con 0x7fcd3c1572b0 2023-10-14T09:17:03.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd327fc640 1 -- 172.21.15.78:0/3327028599 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcd2c00de00 con 0x7fcd3c1572b0 2023-10-14T09:17:03.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.099+0000 7fcd43c46640 1 -- 172.21.15.78:0/3327028599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c1efc60 con 0x7fcd3c1572b0 2023-10-14T09:17:03.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.103+0000 7fcd327fc640 1 -- 172.21.15.78:0/3327028599 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fcd2c01a070 con 0x7fcd3c1572b0 2023-10-14T09:17:03.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.167+0000 7fcd43c46640 1 -- 172.21.15.78:0/3327028599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd3c074180 con 0x7fcd3c1572b0 2023-10-14T09:17:03.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.167+0000 7fcd327fc640 1 -- 172.21.15.78:0/3327028599 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fcd2c007050 con 0x7fcd3c1572b0 2023-10-14T09:17:03.170 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:03.171 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:02.813622+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:03.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.167+0000 7fcd43c46640 1 -- 172.21.15.78:0/3327028599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd3c1572b0 msgr2=0x7fcd3c1ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:03.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.167+0000 7fcd43c46640 1 --2- 172.21.15.78:0/3327028599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd3c1572b0 0x7fcd3c1ef340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00f770 tx=0x7fcd2c00fc30 comp rx=0 tx=0).stop 2023-10-14T09:17:03.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.167+0000 7fcd43c46640 1 -- 172.21.15.78:0/3327028599 shutdown_connections 2023-10-14T09:17:03.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.167+0000 7fcd43c46640 1 --2- 172.21.15.78:0/3327028599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd3c1ef880 0x7fcd3c1ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:03.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.167+0000 7fcd43c46640 1 --2- 172.21.15.78:0/3327028599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd3c1572b0 0x7fcd3c1ef340 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.167+0000 7fcd43c46640 1 --2- 172.21.15.78:0/3327028599 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd28004d10 0x7fcd3c0c15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.167+0000 7fcd43c46640 1 -- 172.21.15.78:0/3327028599 >> 172.21.15.78:0/3327028599 conn(0x7fcd3c0ab1f0 msgr2=0x7fcd3c153620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.167+0000 7fcd43c46640 1 -- 172.21.15.78:0/3327028599 shutdown_connections 2023-10-14T09:17:03.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:03.167+0000 7fcd43c46640 1 -- 172.21.15.78:0/3327028599 wait complete. 2023-10-14T09:17:03.189 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T09:17:03.190 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T09:17:03.200 INFO:tasks.ceph.mgr.y.smithi078.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-14T09:17:03.200 INFO:tasks.ceph.mgr.y.smithi078.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-14T09:17:03.200 INFO:tasks.ceph.mgr.y.smithi078.stderr: from numpy import show_config as show_numpy_config 2023-10-14T09:17:03.223 INFO:tasks.ceph.mgr.x.smithi157.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-14T09:17:03.224 INFO:tasks.ceph.mgr.x.smithi157.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-14T09:17:03.224 INFO:tasks.ceph.mgr.x.smithi157.stderr: from numpy import show_config as show_numpy_config 2023-10-14T09:17:03.239 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:03.239+0000 7fcc85e46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T09:17:03.262 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:03.260+0000 7fcb5d603180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T09:17:03.375 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:03.371+0000 7fcc85e46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T09:17:03.399 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:03.396+0000 7fcb5d603180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T09:17:03.532 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-10-14T09:17:03.531+0000 7f69b1907640 -1 Falling back to public interface 2023-10-14T09:17:03.548 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-10-14T09:17:03.547+0000 7fd1eacde640 -1 Falling back to public interface 2023-10-14T09:17:03.558 INFO:tasks.ceph.osd.5.smithi157.stderr:2023-10-14T09:17:03.556+0000 7fa9d788c640 -1 Falling back to public interface 2023-10-14T09:17:03.561 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-10-14T09:17:03.559+0000 7ffba382e640 -1 Falling back to public interface 2023-10-14T09:17:03.561 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-10-14T09:17:03.559+0000 7ff60c50b640 -1 Falling back to public interface 2023-10-14T09:17:03.562 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:03.559+0000 7fcc85e46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T09:17:03.562 INFO:tasks.ceph.osd.6.smithi157.stderr:2023-10-14T09:17:03.560+0000 7fd881fad640 -1 Falling back to public interface 2023-10-14T09:17:03.582 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:03.580+0000 7fcb5d603180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T09:17:03.594 INFO:tasks.ceph.osd.4.smithi157.stderr:2023-10-14T09:17:03.592+0000 7ff42d0f0640 -1 Falling back to public interface 2023-10-14T09:17:03.614 INFO:tasks.ceph.osd.7.smithi157.stderr:2023-10-14T09:17:03.612+0000 7fb069895640 -1 Falling back to public interface 2023-10-14T09:17:03.635 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:03.631+0000 7fcc85e46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T09:17:03.655 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:03.652+0000 7fcb5d603180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T09:17:03.770 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:03.767+0000 7fcc85e46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T09:17:03.793 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:03.788+0000 7fcb5d603180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T09:17:03.996 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:04.124 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5533ad6640 1 Processor -- start 2023-10-14T09:17:04.124 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5533ad6640 1 -- start start 2023-10-14T09:17:04.125 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5533ad6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f552c0aedd0 0x7f552c154850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:04.126 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5533ad6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f552c0c77b0 0x7f552c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:04.126 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5533ad6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c0c4230 con 0x7f552c0ca150 2023-10-14T09:17:04.126 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5533ad6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0c5340 con 0x7f552c0c77b0 2023-10-14T09:17:04.127 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5533ad6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c151ab0 con 0x7f552c0aedd0 2023-10-14T09:17:04.127 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5532073640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f552c0ca150 0x7f552c0c5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42370/0 (socket says 172.21.15.78:42370) 2023-10-14T09:17:04.127 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5532073640 1 -- 172.21.15.78:0/1692948459 learned_addr learned my addr 172.21.15.78:0/1692948459 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:04.127 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5531071640 1 --2- 172.21.15.78:0/1692948459 >> v2:172.21.15.157:3300/0 conn(0x7f552c0c77b0 0x7f552c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:04.128 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5531872640 1 --2- 172.21.15.78:0/1692948459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f552c0aedd0 0x7f552c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:04.128 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5530870640 1 -- 172.21.15.78:0/1692948459 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715265619 0 0) 0x7f552c0c4230 con 0x7f552c0ca150 2023-10-14T09:17:04.129 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5530870640 1 -- 172.21.15.78:0/1692948459 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5518003530 con 0x7f552c0ca150 2023-10-14T09:17:04.129 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5531071640 1 -- 172.21.15.78:0/1692948459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f552c0aedd0 msgr2=0x7f552c154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:04.129 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5531071640 1 --2- 172.21.15.78:0/1692948459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f552c0aedd0 0x7f552c154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:04.129 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5531071640 1 -- 172.21.15.78:0/1692948459 >> v1:172.21.15.78:6789/0 conn(0x7f552c0ca150 legacy=0x7f552c0c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:04.129 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.123+0000 7f5531071640 1 -- 172.21.15.78:0/1692948459 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c06c760 con 0x7f552c0c77b0 2023-10-14T09:17:04.131 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.127+0000 7f5531071640 1 --2- 172.21.15.78:0/1692948459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f552c0c77b0 0x7f552c0c9c10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f551c0097c0 tx=0x7f551c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec842c1600c7c51a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:04.131 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5530870640 1 -- 172.21.15.78:0/1692948459 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0ab600 con 0x7f552c0c77b0 2023-10-14T09:17:04.132 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5530870640 1 -- 172.21.15.78:0/1692948459 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c0a7050 con 0x7f552c0c77b0 2023-10-14T09:17:04.132 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5530870640 1 -- 172.21.15.78:0/1692948459 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0ab980 con 0x7f552c0c77b0 2023-10-14T09:17:04.133 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 -- 172.21.15.78:0/1692948459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f552c0c77b0 msgr2=0x7f552c0c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:04.133 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 --2- 172.21.15.78:0/1692948459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f552c0c77b0 0x7f552c0c9c10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f551c0097c0 tx=0x7f551c01c3f0 comp rx=0 tx=0).stop 2023-10-14T09:17:04.133 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 -- 172.21.15.78:0/1692948459 shutdown_connections 2023-10-14T09:17:04.133 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 --2- 172.21.15.78:0/1692948459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f552c0c77b0 0x7f552c0c9c10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:04.134 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 --2- 172.21.15.78:0/1692948459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f552c0aedd0 0x7f552c154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:04.134 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 -- 172.21.15.78:0/1692948459 >> 172.21.15.78:0/1692948459 conn(0x7f552c071790 msgr2=0x7f552c071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:04.134 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 -- 172.21.15.78:0/1692948459 shutdown_connections 2023-10-14T09:17:04.135 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 -- 172.21.15.78:0/1692948459 wait complete. 2023-10-14T09:17:04.139 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 Processor -- start 2023-10-14T09:17:04.139 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 -- start start 2023-10-14T09:17:04.139 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f552c0aedd0 0x7f552c14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:04.140 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f552c0c77b0 0x7f552c149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:04.140 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f552c0ca150 0x7f552c1499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:04.140 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0c1450 con 0x7f552c0c77b0 2023-10-14T09:17:04.141 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0c2ab0 con 0x7f552c0ca150 2023-10-14T09:17:04.141 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.131+0000 7f5533ad6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c149ee0 con 0x7f552c0aedd0 2023-10-14T09:17:04.141 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5531071640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f552c0c77b0 0x7f552c149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:04.141 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5531071640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f552c0c77b0 0x7f552c149460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38634/0 (socket says 172.21.15.78:38634) 2023-10-14T09:17:04.142 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5531071640 1 -- 172.21.15.78:0/668016355 learned_addr learned my addr 172.21.15.78:0/668016355 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:04.142 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5531872640 1 --2- 172.21.15.78:0/668016355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f552c0aedd0 0x7f552c14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:04.143 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5532073640 1 --2- 172.21.15.78:0/668016355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f552c0ca150 0x7f552c1499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:04.143 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5531071640 1 -- 172.21.15.78:0/668016355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f552c0aedd0 msgr2=0x7f552c14f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:04.143 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5531071640 1 --2- 172.21.15.78:0/668016355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f552c0aedd0 0x7f552c14f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:04.143 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5531071640 1 -- 172.21.15.78:0/668016355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f552c0ca150 msgr2=0x7f552c1499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:04.144 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5531071640 1 --2- 172.21.15.78:0/668016355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f552c0ca150 0x7f552c1499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:04.144 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5531071640 1 -- 172.21.15.78:0/668016355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c009420 con 0x7f552c0c77b0 2023-10-14T09:17:04.144 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5531071640 1 --2- 172.21.15.78:0/668016355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f552c0c77b0 0x7f552c149460 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f551c01a020 tx=0x7f551c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:04.145 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f55227fc640 1 -- 172.21.15.78:0/668016355 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0b4430 con 0x7f552c0c77b0 2023-10-14T09:17:04.145 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f55227fc640 1 -- 172.21.15.78:0/668016355 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c0b45b0 con 0x7f552c0c77b0 2023-10-14T09:17:04.145 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f55227fc640 1 -- 172.21.15.78:0/668016355 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0b4960 con 0x7f552c0c77b0 2023-10-14T09:17:04.145 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5533ad6640 1 -- 172.21.15.78:0/668016355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c0c18e0 con 0x7f552c0c77b0 2023-10-14T09:17:04.146 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5533ad6640 1 -- 172.21.15.78:0/668016355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c0c0b20 con 0x7f552c0c77b0 2023-10-14T09:17:04.146 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f55227fc640 1 -- 172.21.15.78:0/668016355 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f551c0b2040 con 0x7f552c0c77b0 2023-10-14T09:17:04.146 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f55227fc640 1 -- 172.21.15.78:0/668016355 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f551c0b4dc0 con 0x7f552c0c77b0 2023-10-14T09:17:04.146 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.135+0000 7f5533ad6640 1 -- 172.21.15.78:0/668016355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c0c1600 con 0x7f552c0c77b0 2023-10-14T09:17:04.147 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.139+0000 7f55227fc640 1 -- 172.21.15.78:0/668016355 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f552c0c1600 con 0x7f552c0c77b0 2023-10-14T09:17:04.198 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.195+0000 7f5533ad6640 1 -- 172.21.15.78:0/668016355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f552c074140 con 0x7f552c0c77b0 2023-10-14T09:17:04.199 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.195+0000 7f55227fc640 1 -- 172.21.15.78:0/668016355 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f551c0b0070 con 0x7f552c0c77b0 2023-10-14T09:17:04.199 INFO:teuthology.misc.health.smithi078.stdout: 2023-10-14T09:17:04.200 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:02.813622+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:04.201 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.199+0000 7f5533ad6640 1 -- 172.21.15.78:0/668016355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f552c0c77b0 msgr2=0x7f552c149460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:04.201 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.199+0000 7f5533ad6640 1 --2- 172.21.15.78:0/668016355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f552c0c77b0 0x7f552c149460 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f551c01a020 tx=0x7f551c019190 comp rx=0 tx=0).stop 2023-10-14T09:17:04.201 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.199+0000 7f5533ad6640 1 -- 172.21.15.78:0/668016355 shutdown_connections 2023-10-14T09:17:04.201 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.199+0000 7f5533ad6640 1 --2- 172.21.15.78:0/668016355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f552c0ca150 0x7f552c1499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:04.201 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.199+0000 7f5533ad6640 1 --2- 172.21.15.78:0/668016355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f552c0c77b0 0x7f552c149460 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:04.202 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.199+0000 7f5533ad6640 1 --2- 172.21.15.78:0/668016355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f552c0aedd0 0x7f552c14f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:04.202 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.199+0000 7f5533ad6640 1 -- 172.21.15.78:0/668016355 >> 172.21.15.78:0/668016355 conn(0x7f552c071790 msgr2=0x7f552c153b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:04.202 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.199+0000 7f5533ad6640 1 -- 172.21.15.78:0/668016355 shutdown_connections 2023-10-14T09:17:04.202 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:04.199+0000 7f5533ad6640 1 -- 172.21.15.78:0/668016355 wait complete. 2023-10-14T09:17:04.216 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T09:17:04.452 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:04.451+0000 7fcc85e46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T09:17:04.466 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:04.464+0000 7fcb5d603180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T09:17:04.539 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:04.535+0000 7fcc85e46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T09:17:04.553 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:04.548+0000 7fcb5d603180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T09:17:04.727 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:04.727+0000 7fcc85e46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T09:17:04.741 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:04.740+0000 7fcb5d603180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T09:17:04.812 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:04.811+0000 7fcc85e46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T09:17:04.827 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:04.824+0000 7fcb5d603180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T09:17:05.137 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:05.135+0000 7fcc85e46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T09:17:05.155 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:05.152+0000 7fcb5d603180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T09:17:05.206 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:05.203+0000 7fcc85e46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T09:17:05.226 INFO:tasks.ceph.mgr.x.smithi157.stderr:2023-10-14T09:17:05.224+0000 7fcb5d603180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T09:17:06.230 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:06.227+0000 7fcc2ca56640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-14T09:17:06.232 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-10-14T09:17:06.231+0000 7fcc2ca56640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-14T09:17:07.346 INFO:tasks.ceph.osd.6.smithi157.stderr:2023-10-14T09:17:07.344+0000 7fd881fad640 -1 osd.6 0 log_to_monitors true 2023-10-14T09:17:07.369 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-10-14T09:17:07.367+0000 7f69b1907640 -1 osd.0 0 log_to_monitors true 2023-10-14T09:17:07.438 INFO:tasks.ceph.osd.5.smithi157.stderr:2023-10-14T09:17:07.436+0000 7fa9d788c640 -1 osd.5 0 log_to_monitors true 2023-10-14T09:17:07.464 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-10-14T09:17:07.463+0000 7fd1eacde640 -1 osd.2 0 log_to_monitors true 2023-10-14T09:17:07.586 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-10-14T09:17:07.583+0000 7ff60c50b640 -1 osd.3 0 log_to_monitors true 2023-10-14T09:17:07.597 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-10-14T09:17:07.595+0000 7ffba382e640 -1 osd.1 0 log_to_monitors true 2023-10-14T09:17:07.745 INFO:tasks.ceph.osd.7.smithi157.stderr:2023-10-14T09:17:07.740+0000 7fb069895640 -1 osd.7 0 log_to_monitors true 2023-10-14T09:17:07.760 INFO:tasks.ceph.osd.4.smithi157.stderr:2023-10-14T09:17:07.756+0000 7ff42d0f0640 -1 osd.4 0 log_to_monitors true 2023-10-14T09:17:10.752 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-10-14T09:17:10.750+0000 7ff6084b5640 -1 osd.3 0 waiting for initial osdmap 2023-10-14T09:17:10.785 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-10-14T09:17:10.782+0000 7ff6002ea640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:17:10.795 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-10-14T09:17:10.794+0000 7fd1e6c86640 -1 osd.2 0 waiting for initial osdmap 2023-10-14T09:17:10.799 INFO:tasks.ceph.osd.7.smithi157.stderr:2023-10-14T09:17:10.792+0000 7fb066053640 -1 osd.7 0 waiting for initial osdmap 2023-10-14T09:17:10.801 INFO:tasks.ceph.osd.6.smithi157.stderr:2023-10-14T09:17:10.796+0000 7fd87df55640 -1 osd.6 0 waiting for initial osdmap 2023-10-14T09:17:10.823 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-10-14T09:17:10.818+0000 7ffb9f636640 -1 osd.1 0 waiting for initial osdmap 2023-10-14T09:17:10.828 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-10-14T09:17:10.826+0000 7fd1deabb640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:17:10.837 INFO:tasks.ceph.osd.5.smithi157.stderr:2023-10-14T09:17:10.832+0000 7fa9d3834640 -1 osd.5 0 waiting for initial osdmap 2023-10-14T09:17:10.838 INFO:tasks.ceph.osd.6.smithi157.stderr:2023-10-14T09:17:10.836+0000 7fd875d8a640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:17:10.843 INFO:tasks.ceph.osd.7.smithi157.stderr:2023-10-14T09:17:10.840+0000 7fb05d674640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:17:10.856 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-10-14T09:17:10.854+0000 7ffb96c57640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:17:10.869 INFO:tasks.ceph.osd.4.smithi157.stderr:2023-10-14T09:17:10.864+0000 7ff4298ac640 -1 osd.4 0 waiting for initial osdmap 2023-10-14T09:17:10.882 INFO:tasks.ceph.osd.5.smithi157.stderr:2023-10-14T09:17:10.880+0000 7fa9cb669640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:17:10.894 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-10-14T09:17:10.890+0000 7f69ad8af640 -1 osd.0 0 waiting for initial osdmap 2023-10-14T09:17:10.902 INFO:tasks.ceph.osd.4.smithi157.stderr:2023-10-14T09:17:10.900+0000 7ff420ecd640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:17:10.912 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-10-14T09:17:10.910+0000 7f69a56e4640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T09:17:11.023 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:11.151 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.146+0000 7f36c2f80640 1 Processor -- start 2023-10-14T09:17:11.151 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.146+0000 7f36c2f80640 1 -- start start 2023-10-14T09:17:11.153 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c2f80640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36bc069e90 0x7f36bc0c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:11.153 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c2f80640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36bc139a60 0x7f36bc06a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:11.153 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c2f80640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36bc0722b0 con 0x7f36bc1514f0 2023-10-14T09:17:11.153 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c2f80640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36bc0c0320 con 0x7f36bc069e90 2023-10-14T09:17:11.153 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c2f80640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc13a2b0 con 0x7f36bc139a60 2023-10-14T09:17:11.154 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c0d1c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36bc069e90 0x7f36bc0c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:11.154 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c0d1c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36bc069e90 0x7f36bc0c07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39348/0 (socket says 172.21.15.78:39348) 2023-10-14T09:17:11.154 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c0d1c640 1 -- 172.21.15.78:0/1998001362 learned_addr learned my addr 172.21.15.78:0/1998001362 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:11.154 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36bbfff640 1 --2- 172.21.15.78:0/1998001362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36bc139a60 0x7f36bc06a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:11.154 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c0d1c640 1 -- 172.21.15.78:0/1998001362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36bc139a60 msgr2=0x7f36bc06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:11.155 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c0d1c640 1 --2- 172.21.15.78:0/1998001362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36bc139a60 0x7f36bc06a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:11.155 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c0d1c640 1 -- 172.21.15.78:0/1998001362 >> v1:172.21.15.157:6789/0 conn(0x7f36bc1514f0 legacy=0x7f36bc151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:11.155 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.150+0000 7f36c0d1c640 1 -- 172.21.15.78:0/1998001362 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc139fd0 con 0x7f36bc069e90 2023-10-14T09:17:11.156 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c0d1c640 1 --2- 172.21.15.78:0/1998001362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36bc069e90 0x7f36bc0c07b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009870 tx=0x7f36b001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446dbac96e4e6789 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:11.156 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36bb7fe640 1 -- 172.21.15.78:0/1998001362 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b00ac600 con 0x7f36bc069e90 2023-10-14T09:17:11.157 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36bb7fe640 1 -- 172.21.15.78:0/1998001362 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b00a8050 con 0x7f36bc069e90 2023-10-14T09:17:11.157 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36bb7fe640 1 -- 172.21.15.78:0/1998001362 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b00ac980 con 0x7f36bc069e90 2023-10-14T09:17:11.157 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 -- 172.21.15.78:0/1998001362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36bc069e90 msgr2=0x7f36bc0c07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:11.157 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 --2- 172.21.15.78:0/1998001362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36bc069e90 0x7f36bc0c07b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009870 tx=0x7f36b001c4b0 comp rx=0 tx=0).stop 2023-10-14T09:17:11.157 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 -- 172.21.15.78:0/1998001362 shutdown_connections 2023-10-14T09:17:11.158 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 --2- 172.21.15.78:0/1998001362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36bc139a60 0x7f36bc06a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:11.158 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 --2- 172.21.15.78:0/1998001362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36bc069e90 0x7f36bc0c07b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:11.158 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 -- 172.21.15.78:0/1998001362 >> 172.21.15.78:0/1998001362 conn(0x7f36bc0c52b0 msgr2=0x7f36bc0c56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:11.158 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 -- 172.21.15.78:0/1998001362 shutdown_connections 2023-10-14T09:17:11.159 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 -- 172.21.15.78:0/1998001362 wait complete. 2023-10-14T09:17:11.161 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 Processor -- start 2023-10-14T09:17:11.161 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 -- start start 2023-10-14T09:17:11.161 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36bc069e90 0x7f36bc0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:11.161 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36bc139a60 0x7f36bc134700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:11.161 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36bc1514f0 0x7f36bc15c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:11.162 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0a91c0 con 0x7f36bc069e90 2023-10-14T09:17:11.162 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0c4c80 con 0x7f36bc1514f0 2023-10-14T09:17:11.162 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c2f80640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc15c4e0 con 0x7f36bc139a60 2023-10-14T09:17:11.162 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c0d1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36bc069e90 0x7f36bc0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:11.163 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c0d1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36bc069e90 0x7f36bc0c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39352/0 (socket says 172.21.15.78:39352) 2023-10-14T09:17:11.163 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.154+0000 7f36c0d1c640 1 -- 172.21.15.78:0/2201958141 learned_addr learned my addr 172.21.15.78:0/2201958141 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:11.163 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36bbfff640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36bc139a60 0x7f36bc134700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:11.163 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36c151d640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36bc1514f0 0x7f36bc15c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:11.163 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36c0d1c640 1 -- 172.21.15.78:0/2201958141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36bc139a60 msgr2=0x7f36bc134700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:11.164 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36c0d1c640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36bc139a60 0x7f36bc134700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:11.164 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36c0d1c640 1 -- 172.21.15.78:0/2201958141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36bc1514f0 msgr2=0x7f36bc15c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:11.164 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36c0d1c640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36bc1514f0 0x7f36bc15c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:11.164 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36c0d1c640 1 -- 172.21.15.78:0/2201958141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b00094d0 con 0x7f36bc069e90 2023-10-14T09:17:11.164 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36c0d1c640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36bc069e90 0x7f36bc0c4740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f36b001ab60 tx=0x7f36b001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:11.164 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36b97fa640 1 -- 172.21.15.78:0/2201958141 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b00b7620 con 0x7f36bc069e90 2023-10-14T09:17:11.165 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36b97fa640 1 -- 172.21.15.78:0/2201958141 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b00ace90 con 0x7f36bc069e90 2023-10-14T09:17:11.165 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36c2f80640 1 -- 172.21.15.78:0/2201958141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36bc0c3150 con 0x7f36bc069e90 2023-10-14T09:17:11.165 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36b97fa640 1 -- 172.21.15.78:0/2201958141 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b00b79e0 con 0x7f36bc069e90 2023-10-14T09:17:11.165 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36c2f80640 1 -- 172.21.15.78:0/2201958141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36bc0c36d0 con 0x7f36bc069e90 2023-10-14T09:17:11.166 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36c2f80640 1 -- 172.21.15.78:0/2201958141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36bc074140 con 0x7f36bc069e90 2023-10-14T09:17:11.166 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36b97fa640 1 -- 172.21.15.78:0/2201958141 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7f36b00b3040 con 0x7f36bc069e90 2023-10-14T09:17:11.167 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36b97fa640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a0066410 0x7f36a00688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:11.167 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.158+0000 7f36b97fa640 1 -- 172.21.15.78:0/2201958141 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f36b011d3b0 con 0x7f36bc069e90 2023-10-14T09:17:11.167 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.162+0000 7f36bbfff640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a0066410 0x7f36a00688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:11.167 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.162+0000 7f36bbfff640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a0066410 0x7f36a00688d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f36bc15a660 tx=0x7f36a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:11.168 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.166+0000 7f36b97fa640 1 -- 172.21.15.78:0/2201958141 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f36b00eb7e0 con 0x7f36bc069e90 2023-10-14T09:17:11.325 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.322+0000 7f36c2f80640 1 -- 172.21.15.78:0/2201958141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36bc06aeb0 con 0x7f36bc069e90 2023-10-14T09:17:11.326 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.322+0000 7f36b97fa640 1 -- 172.21.15.78:0/2201958141 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f36b00eee00 con 0x7f36bc069e90 2023-10-14T09:17:11.327 INFO:teuthology.misc.health.smithi078.stdout: 2023-10-14T09:17:11.327 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":12,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:09.231592+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:11.328 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 -- 172.21.15.78:0/2201958141 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a0066410 msgr2=0x7f36a00688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:11.328 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a0066410 0x7f36a00688d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f36bc15a660 tx=0x7f36a8008040 comp rx=0 tx=0).stop 2023-10-14T09:17:11.329 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 -- 172.21.15.78:0/2201958141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36bc069e90 msgr2=0x7f36bc0c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:11.329 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36bc069e90 0x7f36bc0c4740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f36b001ab60 tx=0x7f36b001acf0 comp rx=0 tx=0).stop 2023-10-14T09:17:11.329 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 -- 172.21.15.78:0/2201958141 shutdown_connections 2023-10-14T09:17:11.329 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36bc1514f0 0x7f36bc15c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:11.329 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a0066410 0x7f36a00688d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:11.330 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36bc139a60 0x7f36bc134700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:11.330 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 --2- 172.21.15.78:0/2201958141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36bc069e90 0x7f36bc0c4740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:11.330 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 -- 172.21.15.78:0/2201958141 >> 172.21.15.78:0/2201958141 conn(0x7f36bc0c52b0 msgr2=0x7f36bc137cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:11.330 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 -- 172.21.15.78:0/2201958141 shutdown_connections 2023-10-14T09:17:11.330 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:11.326+0000 7f36c2f80640 1 -- 172.21.15.78:0/2201958141 wait complete. 2023-10-14T09:17:11.345 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T09:17:18.152 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:18.287 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.282+0000 7f725d565640 1 Processor -- start 2023-10-14T09:17:18.287 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.282+0000 7f725d565640 1 -- start start 2023-10-14T09:17:18.289 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f725d565640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f72581514b0 0x7f72580be960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.289 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f725d565640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f72580c5660 0x7f7258157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.290 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f725d565640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7258154720 0x7f72580c0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.290 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f725d565640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72581582c0 con 0x7f72581514b0 2023-10-14T09:17:18.290 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f725d565640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72580c6130 con 0x7f72580c5660 2023-10-14T09:17:18.290 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f725d565640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580c5b70 con 0x7f7258154720 2023-10-14T09:17:18.291 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f7256ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f72581514b0 0x7f72580be960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.291 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f7256ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f72581514b0 0x7f72580be960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35108/0 (socket says 172.21.15.78:35108) 2023-10-14T09:17:18.291 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f7256ffd640 1 -- 172.21.15.78:0/3580341797 learned_addr learned my addr 172.21.15.78:0/3580341797 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:18.291 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f72577fe640 1 --2- 172.21.15.78:0/3580341797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7258154720 0x7f72580c0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.291 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f72567fc640 1 --2- 172.21.15.78:0/3580341797 >> v2:172.21.15.157:3300/0 conn(0x7f72580c5660 0x7f7258157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.292 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f7256ffd640 1 -- 172.21.15.78:0/3580341797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7258154720 msgr2=0x7f72580c0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:18.292 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f7256ffd640 1 --2- 172.21.15.78:0/3580341797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7258154720 0x7f72580c0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.292 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f7256ffd640 1 -- 172.21.15.78:0/3580341797 >> v2:172.21.15.157:3300/0 conn(0x7f72580c5660 msgr2=0x7f7258157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:18.292 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f7256ffd640 1 --2- 172.21.15.78:0/3580341797 >> v2:172.21.15.157:3300/0 conn(0x7f72580c5660 0x7f7258157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.292 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f7256ffd640 1 -- 172.21.15.78:0/3580341797 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72580c5e50 con 0x7f72581514b0 2023-10-14T09:17:18.293 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f72577fe640 1 --2- 172.21.15.78:0/3580341797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7258154720 0x7f72580c0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:18.293 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f72567fc640 1 --2- 172.21.15.78:0/3580341797 >> v2:172.21.15.157:3300/0 conn(0x7f72580c5660 0x7f7258157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:18.294 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f7256ffd640 1 --2- 172.21.15.78:0/3580341797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72581514b0 0x7f72580be960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f72580a8190 tx=0x7f724801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b65079c1e19a67e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:18.294 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.286+0000 7f7255ffb640 1 -- 172.21.15.78:0/3580341797 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480ab650 con 0x7f72581514b0 2023-10-14T09:17:18.295 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f7255ffb640 1 -- 172.21.15.78:0/3580341797 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72480ab7b0 con 0x7f72581514b0 2023-10-14T09:17:18.295 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f7255ffb640 1 -- 172.21.15.78:0/3580341797 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480abb40 con 0x7f72581514b0 2023-10-14T09:17:18.295 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 -- 172.21.15.78:0/3580341797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72581514b0 msgr2=0x7f72580be960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.295 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 --2- 172.21.15.78:0/3580341797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72581514b0 0x7f72580be960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f72580a8190 tx=0x7f724801c470 comp rx=0 tx=0).stop 2023-10-14T09:17:18.295 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 -- 172.21.15.78:0/3580341797 shutdown_connections 2023-10-14T09:17:18.296 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 --2- 172.21.15.78:0/3580341797 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7258154720 0x7f72580c0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.296 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 --2- 172.21.15.78:0/3580341797 >> v2:172.21.15.157:3300/0 conn(0x7f72580c5660 0x7f7258157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.296 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 --2- 172.21.15.78:0/3580341797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72581514b0 0x7f72580be960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.296 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 -- 172.21.15.78:0/3580341797 >> 172.21.15.78:0/3580341797 conn(0x7f72580661f0 msgr2=0x7f72580a7440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:18.296 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 -- 172.21.15.78:0/3580341797 shutdown_connections 2023-10-14T09:17:18.297 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 -- 172.21.15.78:0/3580341797 wait complete. 2023-10-14T09:17:18.297 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 Processor -- start 2023-10-14T09:17:18.297 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 -- start start 2023-10-14T09:17:18.299 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72580c5660 0x7f725814a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.300 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72581514b0 0x7f72581ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.300 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7258154720 0x7f72580a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.300 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7258157f00 con 0x7f72580c5660 2023-10-14T09:17:18.300 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72581ed920 con 0x7f7258154720 2023-10-14T09:17:18.300 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f725d565640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72581f0270 con 0x7f72581514b0 2023-10-14T09:17:18.301 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f7256ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72580c5660 0x7f725814a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.301 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f7256ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72580c5660 0x7f725814a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35118/0 (socket says 172.21.15.78:35118) 2023-10-14T09:17:18.301 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.290+0000 7f7256ffd640 1 -- 172.21.15.78:0/965596514 learned_addr learned my addr 172.21.15.78:0/965596514 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:18.301 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f72567fc640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72581514b0 0x7f72581ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.301 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f72577fe640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7258154720 0x7f72580a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.302 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f7256ffd640 1 -- 172.21.15.78:0/965596514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72581514b0 msgr2=0x7f72581ed3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.302 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f7256ffd640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72581514b0 0x7f72581ed3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.302 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f7256ffd640 1 -- 172.21.15.78:0/965596514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7258154720 msgr2=0x7f72580a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.302 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f7256ffd640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7258154720 0x7f72580a9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.302 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f7256ffd640 1 -- 172.21.15.78:0/965596514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72480094d0 con 0x7f72580c5660 2023-10-14T09:17:18.303 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f72567fc640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72581514b0 0x7f72581ed3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:18.303 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f72577fe640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7258154720 0x7f72580a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:18.303 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f7256ffd640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72580c5660 0x7f725814a230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f724801ab20 tx=0x7f724801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:18.303 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f723f7fe640 1 -- 172.21.15.78:0/965596514 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480b4800 con 0x7f72580c5660 2023-10-14T09:17:18.303 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f723f7fe640 1 -- 172.21.15.78:0/965596514 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72480b4980 con 0x7f72580c5660 2023-10-14T09:17:18.304 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f725d565640 1 -- 172.21.15.78:0/965596514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72581eff70 con 0x7f72580c5660 2023-10-14T09:17:18.304 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f723f7fe640 1 -- 172.21.15.78:0/965596514 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480b4d30 con 0x7f72580c5660 2023-10-14T09:17:18.304 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f725d565640 1 -- 172.21.15.78:0/965596514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7258071cf0 con 0x7f72580c5660 2023-10-14T09:17:18.304 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f725d565640 1 -- 172.21.15.78:0/965596514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7258074140 con 0x7f72580c5660 2023-10-14T09:17:18.305 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f723f7fe640 1 -- 172.21.15.78:0/965596514 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f72480c7440 con 0x7f72580c5660 2023-10-14T09:17:18.305 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f723f7fe640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f72440664a0 0x7f7244068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.305 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f723f7fe640 1 -- 172.21.15.78:0/965596514 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f724811e810 con 0x7f72580c5660 2023-10-14T09:17:18.305 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.294+0000 7f72567fc640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f72440664a0 0x7f7244068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.306 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.298+0000 7f72567fc640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f72440664a0 0x7f7244068960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7258071510 tx=0x7f724c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:18.306 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.302+0000 7f723f7fe640 1 -- 172.21.15.78:0/965596514 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f72480ec0f0 con 0x7f72580c5660 2023-10-14T09:17:18.457 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.454+0000 7f725d565640 1 -- 172.21.15.78:0/965596514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f725806d430 con 0x7f72580c5660 2023-10-14T09:17:18.458 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.454+0000 7f723f7fe640 1 -- 172.21.15.78:0/965596514 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f72480ef710 con 0x7f72580c5660 2023-10-14T09:17:18.458 INFO:teuthology.misc.health.smithi078.stdout: 2023-10-14T09:17:18.459 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":16,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:15.304320+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:18.461 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 -- 172.21.15.78:0/965596514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f72440664a0 msgr2=0x7f7244068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.461 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f72440664a0 0x7f7244068960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7258071510 tx=0x7f724c008040 comp rx=0 tx=0).stop 2023-10-14T09:17:18.461 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 -- 172.21.15.78:0/965596514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72580c5660 msgr2=0x7f725814a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.461 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72580c5660 0x7f725814a230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f724801ab20 tx=0x7f724801acb0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.461 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 -- 172.21.15.78:0/965596514 shutdown_connections 2023-10-14T09:17:18.462 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7258154720 0x7f72580a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.462 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f72440664a0 0x7f7244068960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.462 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f72581514b0 0x7f72581ed3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.462 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 --2- 172.21.15.78:0/965596514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72580c5660 0x7f725814a230 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.462 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 -- 172.21.15.78:0/965596514 >> 172.21.15.78:0/965596514 conn(0x7f72580661f0 msgr2=0x7f72580c4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:18.463 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 -- 172.21.15.78:0/965596514 shutdown_connections 2023-10-14T09:17:18.463 INFO:teuthology.misc.health.smithi078.stderr:2023-10-14T09:17:18.458+0000 7f725d565640 1 -- 172.21.15.78:0/965596514 wait complete. 2023-10-14T09:17:18.478 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-14T09:17:18.478 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T09:17:18.478 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T09:17:18.479 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T09:17:18.482 INFO:tasks.ceph.mds.a:Started 2023-10-14T09:17:18.483 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T09:17:18.483 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T09:17:18.486 INFO:tasks.ceph.mds.c:Started 2023-10-14T09:17:18.487 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T09:17:18.487 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T09:17:18.491 INFO:tasks.ceph.mds.b:Started 2023-10-14T09:17:18.492 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T09:17:18.492 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T09:17:18.495 INFO:tasks.ceph.mds.d:Started 2023-10-14T09:17:18.498 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-14T09:17:18.499 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:18.579 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-10-14T09:17:18.580 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-10-14T09:17:18.582 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-10-14T09:17:18.578+0000 7fbca9c96640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6835/0: (98) Address already in use 2023-10-14T09:17:18.604 INFO:tasks.ceph.mds.d.smithi157.stdout:starting mds.d at 2023-10-14T09:17:18.605 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2023-10-14T09:17:18.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f7580646640 1 Processor -- start 2023-10-14T09:17:18.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f7580646640 1 -- start start 2023-10-14T09:17:18.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f7580646640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75780c7780 0x7f75780c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f7580646640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75780c7020 con 0x7f757814ddb0 2023-10-14T09:17:18.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f7580646640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757806c470 con 0x7f7578153e80 2023-10-14T09:17:18.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f7580646640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75780c64f0 con 0x7f75780c7780 2023-10-14T09:17:18.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757e3e2640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f757814ddb0 0x7f757806bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49888/0 (socket says 172.21.15.78:49888) 2023-10-14T09:17:18.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757e3e2640 1 -- 172.21.15.78:0/4193688241 learned_addr learned my addr 172.21.15.78:0/4193688241 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:18.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757ebe3640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75780c7780 0x7f75780c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119487170 0 0) 0x7f75780c7020 con 0x7f757814ddb0 2023-10-14T09:17:18.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7564003530 con 0x7f757814ddb0 2023-10-14T09:17:18.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2186954140 0 0) 0x7f7564003530 con 0x7f757814ddb0 2023-10-14T09:17:18.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75780c7780 msgr2=0x7f75780c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75780c7780 0x7f75780c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 >> v1:172.21.15.157:6789/0 conn(0x7f7578153e80 legacy=0x7f75780c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757806c750 con 0x7f757814ddb0 2023-10-14T09:17:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f7574001680 con 0x7f757814ddb0 2023-10-14T09:17:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 >> v1:172.21.15.78:6789/0 conn(0x7f757814ddb0 legacy=0x7f757806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75780c7780 0x7f75640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7564003f30 0x7f75640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7564004d10 0x7f7564005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75780c64f0 con 0x7f7564004d10 2023-10-14T09:17:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756400bbd0 con 0x7f7564003f30 2023-10-14T09:17:18.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756400bd90 con 0x7f75780c7780 2023-10-14T09:17:18.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757ebe3640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7564004d10 0x7f7564005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757dbe1640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7564003f30 0x7f75640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757e3e2640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75780c7780 0x7f75640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757ebe3640 1 -- 172.21.15.78:0/4193688241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75780c7780 msgr2=0x7f75640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:18.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757ebe3640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f75780c7780 0x7f75640039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757ebe3640 1 -- 172.21.15.78:0/4193688241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7564003f30 msgr2=0x7f75640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:18.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757ebe3640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7564003f30 0x7f75640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.646+0000 7f757ebe3640 1 -- 172.21.15.78:0/4193688241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7564003530 con 0x7f7564004d10 2023-10-14T09:17:18.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.650+0000 7f757ebe3640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7564004d10 0x7f7564005190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7570009fc0 tx=0x7f757001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1060c0d43ee2dc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:18.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.650+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75700a5850 con 0x7f7564004d10 2023-10-14T09:17:18.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.650+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757000f040 con 0x7f7564004d10 2023-10-14T09:17:18.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.650+0000 7f757d3e0640 1 -- 172.21.15.78:0/4193688241 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75700a5bf0 con 0x7f7564004d10 2023-10-14T09:17:18.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.650+0000 7f7580646640 1 -- 172.21.15.78:0/4193688241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7564004d10 msgr2=0x7f7564005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.650+0000 7f7580646640 1 --2- 172.21.15.78:0/4193688241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7564004d10 0x7f7564005190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7570009fc0 tx=0x7f757001cc60 comp rx=0 tx=0).stop 2023-10-14T09:17:18.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.650+0000 7f757ebe3640 1 -- 172.21.15.78:0/4193688241 reap_dead start 2023-10-14T09:17:18.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.650+0000 7f7580646640 1 -- 172.21.15.78:0/4193688241 shutdown_connections 2023-10-14T09:17:18.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.650+0000 7f7580646640 1 -- 172.21.15.78:0/4193688241 >> 172.21.15.78:0/4193688241 conn(0x7f75780ab1f0 msgr2=0x7f75780ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:18.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.650+0000 7f7580646640 1 -- 172.21.15.78:0/4193688241 shutdown_connections 2023-10-14T09:17:18.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.650+0000 7f7580646640 1 -- 172.21.15.78:0/4193688241 wait complete. 2023-10-14T09:17:18.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f7580646640 1 Processor -- start 2023-10-14T09:17:18.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f7580646640 1 -- start start 2023-10-14T09:17:18.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f7580646640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7564004d10 0x7f7578153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f7580646640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75781439e0 0x7f7578145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f7580646640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75781eeca0 0x7f75781ef100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f7580646640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7578144670 con 0x7f75781eeca0 2023-10-14T09:17:18.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f7580646640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75781ef750 con 0x7f75781439e0 2023-10-14T09:17:18.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f7580646640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7578144110 con 0x7f7564004d10 2023-10-14T09:17:18.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757ebe3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75781eeca0 0x7f75781ef100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757ebe3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75781eeca0 0x7f75781ef100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35158/0 (socket says 172.21.15.78:35158) 2023-10-14T09:17:18.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757ebe3640 1 -- 172.21.15.78:0/3133314553 learned_addr learned my addr 172.21.15.78:0/3133314553 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:18.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757dbe1640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75781439e0 0x7f7578145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757e3e2640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7564004d10 0x7f7578153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757ebe3640 1 -- 172.21.15.78:0/3133314553 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7564004d10 msgr2=0x7f7578153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757ebe3640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7564004d10 0x7f7578153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757ebe3640 1 -- 172.21.15.78:0/3133314553 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75781439e0 msgr2=0x7f7578145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757ebe3640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75781439e0 0x7f7578145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757ebe3640 1 -- 172.21.15.78:0/3133314553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7578144950 con 0x7f75781eeca0 2023-10-14T09:17:18.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757e3e2640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7564004d10 0x7f7578153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:18.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f757ebe3640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75781eeca0 0x7f75781ef100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7570002240 tx=0x7f7570009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:18.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f756effd640 1 -- 172.21.15.78:0/3133314553 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75700039a0 con 0x7f75781eeca0 2023-10-14T09:17:18.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f756effd640 1 -- 172.21.15.78:0/3133314553 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7570003b00 con 0x7f75781eeca0 2023-10-14T09:17:18.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f7580646640 1 -- 172.21.15.78:0/3133314553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7578073430 con 0x7f75781eeca0 2023-10-14T09:17:18.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f756effd640 1 -- 172.21.15.78:0/3133314553 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570003e90 con 0x7f75781eeca0 2023-10-14T09:17:18.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.654+0000 7f7580646640 1 -- 172.21.15.78:0/3133314553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7578146620 con 0x7f75781eeca0 2023-10-14T09:17:18.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.658+0000 7f7580646640 1 -- 172.21.15.78:0/3133314553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7578153670 con 0x7f75781eeca0 2023-10-14T09:17:18.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.658+0000 7f756effd640 1 -- 172.21.15.78:0/3133314553 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f75700b4040 con 0x7f75781eeca0 2023-10-14T09:17:18.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.658+0000 7f756effd640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f755c0664d0 0x7f755c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.658+0000 7f756effd640 1 -- 172.21.15.78:0/3133314553 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f757011d640 con 0x7f75781eeca0 2023-10-14T09:17:18.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.658+0000 7f757e3e2640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f755c0664d0 0x7f755c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.658+0000 7f757e3e2640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f755c0664d0 0x7f755c068990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75780aae50 tx=0x7f7574009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:18.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.662+0000 7f756effd640 1 -- 172.21.15.78:0/3133314553 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f75700eaec0 con 0x7f75781eeca0 2023-10-14T09:17:18.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 -- 172.21.15.78:0/3133314553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75781447b0 con 0x7f75781eeca0 2023-10-14T09:17:18.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f756effd640 1 -- 172.21.15.78:0/3133314553 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f75781447b0 con 0x7f75781eeca0 2023-10-14T09:17:18.817 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:18.818 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:15.304320+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:18.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 -- 172.21.15.78:0/3133314553 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f755c0664d0 msgr2=0x7f755c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f755c0664d0 0x7f755c068990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75780aae50 tx=0x7f7574009040 comp rx=0 tx=0).stop 2023-10-14T09:17:18.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 -- 172.21.15.78:0/3133314553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75781eeca0 msgr2=0x7f75781ef100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75781eeca0 0x7f75781ef100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7570002240 tx=0x7f7570009750 comp rx=0 tx=0).stop 2023-10-14T09:17:18.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 -- 172.21.15.78:0/3133314553 shutdown_connections 2023-10-14T09:17:18.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75781eeca0 0x7f75781ef100 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f75781439e0 0x7f7578145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f755c0664d0 0x7f755c068990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 --2- 172.21.15.78:0/3133314553 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7564004d10 0x7f7578153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 -- 172.21.15.78:0/3133314553 >> 172.21.15.78:0/3133314553 conn(0x7f75780ab1f0 msgr2=0x7f75780aa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:18.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 -- 172.21.15.78:0/3133314553 shutdown_connections 2023-10-14T09:17:18.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.814+0000 7f7580646640 1 -- 172.21.15.78:0/3133314553 wait complete. 2023-10-14T09:17:18.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:18.838 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.974+0000 7fa1576d6640 1 Processor -- start 2023-10-14T09:17:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.974+0000 7fa1576d6640 1 -- start start 2023-10-14T09:17:18.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.974+0000 7fa1576d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa150150f40 0x7fa1501539d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.974+0000 7fa1576d6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa150151fd0 con 0x7fa150139dc0 2023-10-14T09:17:18.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.974+0000 7fa1576d6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1501513b0 con 0x7fa150150ac0 2023-10-14T09:17:18.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.974+0000 7fa1576d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1500702c0 con 0x7fa150150f40 2023-10-14T09:17:18.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.974+0000 7fa155472640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa150139dc0 0x7fa1500718a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49894/0 (socket says 172.21.15.78:49894) 2023-10-14T09:17:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.974+0000 7fa155472640 1 -- 172.21.15.78:0/41131628 learned_addr learned my addr 172.21.15.78:0/41131628 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.974+0000 7fa155c73640 1 --2- 172.21.15.78:0/41131628 >> v2:172.21.15.78:3300/0 conn(0x7fa150150f40 0x7fa1501539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa155c73640 1 -- 172.21.15.78:0/41131628 >> v1:172.21.15.157:6789/0 conn(0x7fa150150ac0 legacy=0x7fa1501532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa155c73640 1 -- 172.21.15.78:0/41131628 >> v1:172.21.15.78:6789/0 conn(0x7fa150139dc0 legacy=0x7fa1500718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa155c73640 1 -- 172.21.15.78:0/41131628 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa150152220 con 0x7fa150150f40 2023-10-14T09:17:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa147fff640 1 -- 172.21.15.78:0/41131628 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503592792 0 0) 0x7fa150151fd0 con 0x7fa150139dc0 2023-10-14T09:17:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa155c73640 1 --2- 172.21.15.78:0/41131628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa150150f40 0x7fa1501539d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa148009d90 tx=0x7fa14801ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecaab9c9c685a37 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:18.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa147fff640 1 -- 172.21.15.78:0/41131628 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480a78a0 con 0x7fa150150f40 2023-10-14T09:17:18.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa147fff640 1 -- 172.21.15.78:0/41131628 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1480a7a00 con 0x7fa150150f40 2023-10-14T09:17:18.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa147fff640 1 -- 172.21.15.78:0/41131628 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480a7d90 con 0x7fa150150f40 2023-10-14T09:17:18.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa1576d6640 1 -- 172.21.15.78:0/41131628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa150150f40 msgr2=0x7fa1501539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa1576d6640 1 --2- 172.21.15.78:0/41131628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa150150f40 0x7fa1501539d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa148009d90 tx=0x7fa14801ead0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa1576d6640 1 -- 172.21.15.78:0/41131628 shutdown_connections 2023-10-14T09:17:18.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa1576d6640 1 --2- 172.21.15.78:0/41131628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa150150f40 0x7fa1501539d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa1576d6640 1 -- 172.21.15.78:0/41131628 >> 172.21.15.78:0/41131628 conn(0x7fa1500c1d00 msgr2=0x7fa1500c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:18.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.978+0000 7fa1576d6640 1 -- 172.21.15.78:0/41131628 shutdown_connections 2023-10-14T09:17:18.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa1576d6640 1 -- 172.21.15.78:0/41131628 wait complete. 2023-10-14T09:17:18.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa1576d6640 1 Processor -- start 2023-10-14T09:17:18.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa1576d6640 1 -- start start 2023-10-14T09:17:18.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa1576d6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa150139dc0 0x7fa1500c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa1576d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa150150ac0 0x7fa1501ec080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa1576d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa150150f40 0x7fa150132150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa1576d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa150152ea0 con 0x7fa150150f40 2023-10-14T09:17:18.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa1576d6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501ec5c0 con 0x7fa150139dc0 2023-10-14T09:17:18.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa1576d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15006bc40 con 0x7fa150150ac0 2023-10-14T09:17:18.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa155c73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa150150f40 0x7fa150132150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa155c73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa150150f40 0x7fa150132150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35178/0 (socket says 172.21.15.78:35178) 2023-10-14T09:17:18.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa155c73640 1 -- 172.21.15.78:0/963944734 learned_addr learned my addr 172.21.15.78:0/963944734 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:18.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa155472640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa150139dc0 0x7fa1500c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa155c73640 1 -- 172.21.15.78:0/963944734 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa150150ac0 msgr2=0x7fa1501ec080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa154c71640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa150150ac0 0x7fa1501ec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa155c73640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa150150ac0 0x7fa1501ec080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa155c73640 1 -- 172.21.15.78:0/963944734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa150139dc0 msgr2=0x7fa1500c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:18.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa155c73640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa150139dc0 0x7fa1500c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:18.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa155c73640 1 -- 172.21.15.78:0/963944734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa148009a70 con 0x7fa150150f40 2023-10-14T09:17:18.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa155472640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa150139dc0 0x7fa1500c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:18.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa154c71640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa150150ac0 0x7fa1501ec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:18.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa155c73640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa150150f40 0x7fa150132150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa14801c700 tx=0x7fa14801b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:18.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa145ffb640 1 -- 172.21.15.78:0/963944734 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480af850 con 0x7fa150150f40 2023-10-14T09:17:18.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa145ffb640 1 -- 172.21.15.78:0/963944734 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1480af9b0 con 0x7fa150150f40 2023-10-14T09:17:18.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa1576d6640 1 -- 172.21.15.78:0/963944734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1500c43d0 con 0x7fa150150f40 2023-10-14T09:17:18.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.982+0000 7fa145ffb640 1 -- 172.21.15.78:0/963944734 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480afd40 con 0x7fa150150f40 2023-10-14T09:17:18.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.986+0000 7fa1576d6640 1 -- 172.21.15.78:0/963944734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1500c4990 con 0x7fa150150f40 2023-10-14T09:17:18.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.986+0000 7fa1576d6640 1 -- 172.21.15.78:0/963944734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa150074110 con 0x7fa150150f40 2023-10-14T09:17:18.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.986+0000 7fa145ffb640 1 -- 172.21.15.78:0/963944734 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa1480b6070 con 0x7fa150150f40 2023-10-14T09:17:18.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.986+0000 7fa145ffb640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1340664a0 0x7fa134068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:18.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.986+0000 7fa145ffb640 1 -- 172.21.15.78:0/963944734 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa14811e520 con 0x7fa150150f40 2023-10-14T09:17:18.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.986+0000 7fa155472640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1340664a0 0x7fa134068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:18.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.986+0000 7fa155472640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1340664a0 0x7fa134068960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa14c000f70 tx=0x7fa14c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:18.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:18.990+0000 7fa145ffb640 1 -- 172.21.15.78:0/963944734 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa1480ebc50 con 0x7fa150150f40 2023-10-14T09:17:19.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.138+0000 7fa1576d6640 1 -- 172.21.15.78:0/963944734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1500c0030 con 0x7fa150150f40 2023-10-14T09:17:19.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.138+0000 7fa145ffb640 1 -- 172.21.15.78:0/963944734 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1480ef270 con 0x7fa150150f40 2023-10-14T09:17:19.144 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:19.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 -- 172.21.15.78:0/963944734 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1340664a0 msgr2=0x7fa134068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:19.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1340664a0 0x7fa134068960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa14c000f70 tx=0x7fa14c009040 comp rx=0 tx=0).stop 2023-10-14T09:17:19.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 -- 172.21.15.78:0/963944734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa150150f40 msgr2=0x7fa150132150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:19.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa150150f40 0x7fa150132150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa14801c700 tx=0x7fa14801b870 comp rx=0 tx=0).stop 2023-10-14T09:17:19.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 -- 172.21.15.78:0/963944734 shutdown_connections 2023-10-14T09:17:19.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa150150f40 0x7fa150132150 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1340664a0 0x7fa134068960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa150150ac0 0x7fa1501ec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 --2- 172.21.15.78:0/963944734 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa150139dc0 0x7fa1500c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 -- 172.21.15.78:0/963944734 >> 172.21.15.78:0/963944734 conn(0x7fa1500c1d00 msgr2=0x7fa15015ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:19.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 -- 172.21.15.78:0/963944734 shutdown_connections 2023-10-14T09:17:19.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.142+0000 7fa1576d6640 1 -- 172.21.15.78:0/963944734 wait complete. 2023-10-14T09:17:19.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:17:19.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.298+0000 7f4747a54640 1 Processor -- start 2023-10-14T09:17:19.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.298+0000 7f4747a54640 1 -- start start 2023-10-14T09:17:19.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4747a54640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4740070110 0x7f4740071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:19.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4747a54640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f474006d640 0x7f4740155500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:19.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4747a54640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4740158980 con 0x7f4740158e10 2023-10-14T09:17:19.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4747a54640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47401580b0 con 0x7f474006d640 2023-10-14T09:17:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4747a54640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474006db40 con 0x7f4740070110 2023-10-14T09:17:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4744fef640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f474006d640 0x7f4740155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f47457f0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4740070110 0x7f4740071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4744fef640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f474006d640 0x7f4740155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:44460/0 (socket says 172.21.15.78:44460) 2023-10-14T09:17:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4744fef640 1 -- 172.21.15.78:0/2208490439 learned_addr learned my addr 172.21.15.78:0/2208490439 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:19.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4744fef640 1 -- 172.21.15.78:0/2208490439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4740070110 msgr2=0x7f4740071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:19.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4744fef640 1 --2- 172.21.15.78:0/2208490439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4740070110 0x7f4740071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4744fef640 1 -- 172.21.15.78:0/2208490439 >> v1:172.21.15.157:6789/0 conn(0x7f4740158e10 legacy=0x7f47400bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:19.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f4744fef640 1 -- 172.21.15.78:0/2208490439 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4740158330 con 0x7f474006d640 2023-10-14T09:17:19.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.302+0000 7f47457f0640 1 --2- 172.21.15.78:0/2208490439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4740070110 0x7f4740071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:19.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4744fef640 1 --2- 172.21.15.78:0/2208490439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f474006d640 0x7f4740155500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4730009870 tx=0x7f473001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe947bc092436010 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:19.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4737fff640 1 -- 172.21.15.78:0/2208490439 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300a95f0 con 0x7f474006d640 2023-10-14T09:17:19.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4737fff640 1 -- 172.21.15.78:0/2208490439 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47300a9750 con 0x7f474006d640 2023-10-14T09:17:19.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4737fff640 1 -- 172.21.15.78:0/2208490439 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300a9ae0 con 0x7f474006d640 2023-10-14T09:17:19.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4747a54640 1 -- 172.21.15.78:0/2208490439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f474006d640 msgr2=0x7f4740155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:19.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4747a54640 1 --2- 172.21.15.78:0/2208490439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f474006d640 0x7f4740155500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4730009870 tx=0x7f473001c510 comp rx=0 tx=0).stop 2023-10-14T09:17:19.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4747a54640 1 -- 172.21.15.78:0/2208490439 shutdown_connections 2023-10-14T09:17:19.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4747a54640 1 --2- 172.21.15.78:0/2208490439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f474006d640 0x7f4740155500 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4747a54640 1 --2- 172.21.15.78:0/2208490439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4740070110 0x7f4740071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4747a54640 1 -- 172.21.15.78:0/2208490439 >> 172.21.15.78:0/2208490439 conn(0x7f47400c1cc0 msgr2=0x7f47400c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:19.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4747a54640 1 -- 172.21.15.78:0/2208490439 shutdown_connections 2023-10-14T09:17:19.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4747a54640 1 -- 172.21.15.78:0/2208490439 wait complete. 2023-10-14T09:17:19.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4747a54640 1 Processor -- start 2023-10-14T09:17:19.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.306+0000 7f4747a54640 1 -- start start 2023-10-14T09:17:19.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4747a54640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f474006d640 0x7f4740154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:19.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4747a54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4740070110 0x7f47401f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:19.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4747a54640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4740158e10 0x7f47401f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4747a54640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47400c42d0 con 0x7f4740070110 2023-10-14T09:17:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4747a54640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47400c32f0 con 0x7f4740158e10 2023-10-14T09:17:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4747a54640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47401f3970 con 0x7f474006d640 2023-10-14T09:17:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4744fef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4740070110 0x7f47401f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4744fef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4740070110 0x7f47401f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35182/0 (socket says 172.21.15.78:35182) 2023-10-14T09:17:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4744fef640 1 -- 172.21.15.78:0/363337384 learned_addr learned my addr 172.21.15.78:0/363337384 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f47457f0640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f474006d640 0x7f4740154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4745ff1640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4740158e10 0x7f47401f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4744fef640 1 -- 172.21.15.78:0/363337384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f474006d640 msgr2=0x7f4740154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4744fef640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f474006d640 0x7f4740154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4744fef640 1 -- 172.21.15.78:0/363337384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4740158e10 msgr2=0x7f47401f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4744fef640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4740158e10 0x7f47401f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4744fef640 1 -- 172.21.15.78:0/363337384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c009420 con 0x7f4740070110 2023-10-14T09:17:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4744fef640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4740070110 0x7f47401f3e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f473001abc0 tx=0x7f47300192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4735ffb640 1 -- 172.21.15.78:0/363337384 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300b9630 con 0x7f4740070110 2023-10-14T09:17:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4735ffb640 1 -- 172.21.15.78:0/363337384 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47300b9790 con 0x7f4740070110 2023-10-14T09:17:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4735ffb640 1 -- 172.21.15.78:0/363337384 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300b9b20 con 0x7f4740070110 2023-10-14T09:17:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4747a54640 1 -- 172.21.15.78:0/363337384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47300094d0 con 0x7f4740070110 2023-10-14T09:17:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4747a54640 1 -- 172.21.15.78:0/363337384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47400c3540 con 0x7f4740070110 2023-10-14T09:17:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4747a54640 1 -- 172.21.15.78:0/363337384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47401f3b20 con 0x7f4740070110 2023-10-14T09:17:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.310+0000 7f4735ffb640 1 -- 172.21.15.78:0/363337384 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f47300b9c80 con 0x7f4740070110 2023-10-14T09:17:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.314+0000 7f4735ffb640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f47240664a0 0x7f4724068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.314+0000 7f4735ffb640 1 -- 172.21.15.78:0/363337384 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f473011db20 con 0x7f4740070110 2023-10-14T09:17:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.314+0000 7f47457f0640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f47240664a0 0x7f4724068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.314+0000 7f47457f0640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f47240664a0 0x7f4724068960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f473c009c50 tx=0x7f473c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.318+0000 7f4735ffb640 1 -- 172.21.15.78:0/363337384 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f47401f3b20 con 0x7f4740070110 2023-10-14T09:17:19.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.498+0000 7f4747a54640 1 -- 172.21.15.78:0/363337384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47401f3ae0 con 0x7f4740070110 2023-10-14T09:17:19.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.498+0000 7f4735ffb640 1 -- 172.21.15.78:0/363337384 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1318 (secure 0 0 0) 0x7f47300eb430 con 0x7f4740070110 2023-10-14T09:17:19.502 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:19.503 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/20028755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":20028755},{"type":"v1","addr":"172.21.15.78:6836","nonce":20028755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-14T09:17:19.503 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 2 2023-10-14T09:17:19.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.498+0000 7f4747a54640 1 -- 172.21.15.78:0/363337384 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f47240664a0 msgr2=0x7f4724068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:19.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.498+0000 7f4747a54640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f47240664a0 0x7f4724068960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f473c009c50 tx=0x7f473c009190 comp rx=0 tx=0).stop 2023-10-14T09:17:19.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.498+0000 7f4747a54640 1 -- 172.21.15.78:0/363337384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4740070110 msgr2=0x7f47401f3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:19.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.498+0000 7f4747a54640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4740070110 0x7f47401f3e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f473001abc0 tx=0x7f47300192b0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.498+0000 7f4747a54640 1 -- 172.21.15.78:0/363337384 shutdown_connections 2023-10-14T09:17:19.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.498+0000 7f4747a54640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4740158e10 0x7f47401f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.502+0000 7f4747a54640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4740070110 0x7f47401f3e00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.502+0000 7f4747a54640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f47240664a0 0x7f4724068960 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.502+0000 7f4747a54640 1 --2- 172.21.15.78:0/363337384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f474006d640 0x7f4740154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.502+0000 7f4747a54640 1 -- 172.21.15.78:0/363337384 >> 172.21.15.78:0/363337384 conn(0x7f47400c1cc0 msgr2=0x7f474014ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.502+0000 7f4747a54640 1 -- 172.21.15.78:0/363337384 shutdown_connections 2023-10-14T09:17:19.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:19.502+0000 7f4747a54640 1 -- 172.21.15.78:0/363337384 wait complete. 2023-10-14T09:17:21.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:17:21.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b55405640 1 Processor -- start 2023-10-14T09:17:21.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b55405640 1 -- start start 2023-10-14T09:17:21.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b55405640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b5014ddb0 0x7f8b500c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:21.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b55405640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8b500c6910 0x7f8b500c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b55405640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5006c470 con 0x7f8b50153e80 2023-10-14T09:17:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b55405640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b500c64f0 con 0x7f8b5014ddb0 2023-10-14T09:17:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b55405640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b500c5300 con 0x7f8b500c6910 2023-10-14T09:17:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b4effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b5014ddb0 0x7f8b500c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b4e7fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8b50153e80 0x7f8b5006bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49898/0 (socket says 172.21.15.78:49898) 2023-10-14T09:17:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b4e7fc640 1 -- 172.21.15.78:0/2556710374 learned_addr learned my addr 172.21.15.78:0/2556710374 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b4f7fe640 1 --2- 172.21.15.78:0/2556710374 >> v2:172.21.15.157:3300/0 conn(0x7f8b500c6910 0x7f8b500c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b4effd640 1 -- 172.21.15.78:0/2556710374 >> v2:172.21.15.157:3300/0 conn(0x7f8b500c6910 msgr2=0x7f8b500c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b4effd640 1 --2- 172.21.15.78:0/2556710374 >> v2:172.21.15.157:3300/0 conn(0x7f8b500c6910 0x7f8b500c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b4effd640 1 -- 172.21.15.78:0/2556710374 >> v1:172.21.15.78:6789/0 conn(0x7f8b50153e80 legacy=0x7f8b5006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:21.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b4effd640 1 -- 172.21.15.78:0/2556710374 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5006c750 con 0x7f8b5014ddb0 2023-10-14T09:17:21.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b4f7fe640 1 --2- 172.21.15.78:0/2556710374 >> v2:172.21.15.157:3300/0 conn(0x7f8b500c6910 0x7f8b500c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:21.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.670+0000 7f8b4dffb640 1 -- 172.21.15.78:0/2556710374 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412085398 0 0) 0x7f8b5006c470 con 0x7f8b50153e80 2023-10-14T09:17:21.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b4effd640 1 --2- 172.21.15.78:0/2556710374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5014ddb0 0x7f8b500c7780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b500abec0 tx=0x7f8b4001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dd20aacda5bc38 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:21.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b4dffb640 1 -- 172.21.15.78:0/2556710374 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400ab600 con 0x7f8b5014ddb0 2023-10-14T09:17:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b4dffb640 1 -- 172.21.15.78:0/2556710374 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b400a7050 con 0x7f8b5014ddb0 2023-10-14T09:17:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b4dffb640 1 -- 172.21.15.78:0/2556710374 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400ab980 con 0x7f8b5014ddb0 2023-10-14T09:17:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b55405640 1 -- 172.21.15.78:0/2556710374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5014ddb0 msgr2=0x7f8b500c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b55405640 1 --2- 172.21.15.78:0/2556710374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5014ddb0 0x7f8b500c7780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b500abec0 tx=0x7f8b4001c340 comp rx=0 tx=0).stop 2023-10-14T09:17:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b55405640 1 -- 172.21.15.78:0/2556710374 shutdown_connections 2023-10-14T09:17:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b55405640 1 --2- 172.21.15.78:0/2556710374 >> v2:172.21.15.157:3300/0 conn(0x7f8b500c6910 0x7f8b500c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b55405640 1 --2- 172.21.15.78:0/2556710374 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5014ddb0 0x7f8b500c7780 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b55405640 1 -- 172.21.15.78:0/2556710374 >> 172.21.15.78:0/2556710374 conn(0x7f8b500ab1f0 msgr2=0x7f8b500ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b55405640 1 -- 172.21.15.78:0/2556710374 shutdown_connections 2023-10-14T09:17:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b55405640 1 -- 172.21.15.78:0/2556710374 wait complete. 2023-10-14T09:17:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b55405640 1 Processor -- start 2023-10-14T09:17:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.674+0000 7f8b55405640 1 -- start start 2023-10-14T09:17:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b55405640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b500c6910 0x7f8b5014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b55405640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b5014ddb0 0x7f8b501f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b55405640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b50153e80 0x7f8b5014cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b55405640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50151170 con 0x7f8b500c6910 2023-10-14T09:17:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b55405640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501f05e0 con 0x7f8b50153e80 2023-10-14T09:17:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b55405640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501ec5a0 con 0x7f8b5014ddb0 2023-10-14T09:17:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b500c6910 0x7f8b5014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b500c6910 0x7f8b5014e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35210/0 (socket says 172.21.15.78:35210) 2023-10-14T09:17:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4effd640 1 -- 172.21.15.78:0/1477350675 learned_addr learned my addr 172.21.15.78:0/1477350675 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4f7fe640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b50153e80 0x7f8b5014cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4e7fc640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b5014ddb0 0x7f8b501f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4effd640 1 -- 172.21.15.78:0/1477350675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b5014ddb0 msgr2=0x7f8b501f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4effd640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b5014ddb0 0x7f8b501f00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4effd640 1 -- 172.21.15.78:0/1477350675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b50153e80 msgr2=0x7f8b5014cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4effd640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b50153e80 0x7f8b5014cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4effd640 1 -- 172.21.15.78:0/1477350675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40009420 con 0x7f8b500c6910 2023-10-14T09:17:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4f7fe640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b50153e80 0x7f8b5014cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4e7fc640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b5014ddb0 0x7f8b501f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b4effd640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b500c6910 0x7f8b5014e6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b400ae040 tx=0x7f8b400190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b377fe640 1 -- 172.21.15.78:0/1477350675 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400b4840 con 0x7f8b500c6910 2023-10-14T09:17:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b377fe640 1 -- 172.21.15.78:0/1477350675 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b400b49c0 con 0x7f8b500c6910 2023-10-14T09:17:21.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b377fe640 1 -- 172.21.15.78:0/1477350675 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400b4d70 con 0x7f8b500c6910 2023-10-14T09:17:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b55405640 1 -- 172.21.15.78:0/1477350675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b500c2970 con 0x7f8b500c6910 2023-10-14T09:17:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b55405640 1 -- 172.21.15.78:0/1477350675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b501ec230 con 0x7f8b500c6910 2023-10-14T09:17:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.678+0000 7f8b55405640 1 -- 172.21.15.78:0/1477350675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b50074180 con 0x7f8b500c6910 2023-10-14T09:17:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.682+0000 7f8b377fe640 1 -- 172.21.15.78:0/1477350675 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8b400b2040 con 0x7f8b500c6910 2023-10-14T09:17:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.682+0000 7f8b377fe640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b3c0664d0 0x7f8b3c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:21.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.682+0000 7f8b377fe640 1 -- 172.21.15.78:0/1477350675 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8b4011dfd0 con 0x7f8b500c6910 2023-10-14T09:17:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.682+0000 7f8b4e7fc640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b3c0664d0 0x7f8b3c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.682+0000 7f8b4e7fc640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b3c0664d0 0x7f8b3c068990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b44000f70 tx=0x7f8b44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.686+0000 7f8b377fe640 1 -- 172.21.15.78:0/1477350675 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8b400eb790 con 0x7f8b500c6910 2023-10-14T09:17:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.862+0000 7f8b55405640 1 -- 172.21.15.78:0/1477350675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b501ec3c0 con 0x7f8b500c6910 2023-10-14T09:17:21.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b377fe640 1 -- 172.21.15.78:0/1477350675 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f8b400b0e80 con 0x7f8b500c6910 2023-10-14T09:17:21.869 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:21.869 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1987032053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1987032053},{"type":"v1","addr":"172.21.15.157:6834","nonce":1987032053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/20028755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":20028755},{"type":"v1","addr":"172.21.15.78:6836","nonce":20028755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3671283338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3671283338},{"type":"v1","addr":"172.21.15.78:6837","nonce":3671283338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/3774780175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3774780175},{"type":"v1","addr":"172.21.15.157:6835","nonce":3774780175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-14T09:17:21.870 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2023-10-14T09:17:21.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 -- 172.21.15.78:0/1477350675 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b3c0664d0 msgr2=0x7f8b3c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:21.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b3c0664d0 0x7f8b3c068990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b44000f70 tx=0x7f8b44009040 comp rx=0 tx=0).stop 2023-10-14T09:17:21.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 -- 172.21.15.78:0/1477350675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b500c6910 msgr2=0x7f8b5014e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:21.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b500c6910 0x7f8b5014e6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b400ae040 tx=0x7f8b400190e0 comp rx=0 tx=0).stop 2023-10-14T09:17:21.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 -- 172.21.15.78:0/1477350675 shutdown_connections 2023-10-14T09:17:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b50153e80 0x7f8b5014cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b3c0664d0 0x7f8b3c068990 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b5014ddb0 0x7f8b501f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 --2- 172.21.15.78:0/1477350675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b500c6910 0x7f8b5014e6c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 -- 172.21.15.78:0/1477350675 >> 172.21.15.78:0/1477350675 conn(0x7f8b500ab1f0 msgr2=0x7f8b5015dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 -- 172.21.15.78:0/1477350675 shutdown_connections 2023-10-14T09:17:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:21.866+0000 7f8b55405640 1 -- 172.21.15.78:0/1477350675 wait complete. 2023-10-14T09:17:21.890 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:22.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.022+0000 7fa4b8d3e640 1 Processor -- start 2023-10-14T09:17:22.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.022+0000 7fa4b8d3e640 1 -- start start 2023-10-14T09:17:22.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b8d3e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4b414ed10 0x7fa4b414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b8d3e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4b414f700 0x7fa4b4150a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b8d3e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b41531d0 con 0x7fa4b414e0f0 2023-10-14T09:17:22.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b8d3e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b4153e50 con 0x7fa4b414f700 2023-10-14T09:17:22.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b8d3e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b41534b0 con 0x7fa4b414ed10 2023-10-14T09:17:22.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b2d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4b414f700 0x7fa4b4150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b2d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4b414f700 0x7fa4b4150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35222/0 (socket says 172.21.15.78:35222) 2023-10-14T09:17:22.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b2d9d640 1 -- 172.21.15.78:0/2692307996 learned_addr learned my addr 172.21.15.78:0/2692307996 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4a9d9b640 1 --2- 172.21.15.78:0/2692307996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4b414ed10 0x7fa4b414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b2d9d640 1 -- 172.21.15.78:0/2692307996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4b414ed10 msgr2=0x7fa4b414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b2d9d640 1 --2- 172.21.15.78:0/2692307996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4b414ed10 0x7fa4b414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b2d9d640 1 -- 172.21.15.78:0/2692307996 >> v1:172.21.15.157:6789/0 conn(0x7fa4b414e0f0 legacy=0x7fa4b4152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b2d9d640 1 -- 172.21.15.78:0/2692307996 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b4153790 con 0x7fa4b414f700 2023-10-14T09:17:22.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4a9d9b640 1 --2- 172.21.15.78:0/2692307996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4b414ed10 0x7fa4b414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:22.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.026+0000 7fa4b2d9d640 1 --2- 172.21.15.78:0/2692307996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4b414f700 0x7fa4b4150a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009e50 tx=0x7fa4ac01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1e36f116dce896 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:22.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b1d9b640 1 -- 172.21.15.78:0/2692307996 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac0a5690 con 0x7fa4b414f700 2023-10-14T09:17:22.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b1d9b640 1 -- 172.21.15.78:0/2692307996 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac0a57f0 con 0x7fa4b414f700 2023-10-14T09:17:22.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b1d9b640 1 -- 172.21.15.78:0/2692307996 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac0a5b80 con 0x7fa4b414f700 2023-10-14T09:17:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/2692307996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4b414f700 msgr2=0x7fa4b4150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 --2- 172.21.15.78:0/2692307996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4b414f700 0x7fa4b4150a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009e50 tx=0x7fa4ac01c940 comp rx=0 tx=0).stop 2023-10-14T09:17:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/2692307996 shutdown_connections 2023-10-14T09:17:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 --2- 172.21.15.78:0/2692307996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4b414f700 0x7fa4b4150a90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 --2- 172.21.15.78:0/2692307996 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4b414ed10 0x7fa4b414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/2692307996 >> 172.21.15.78:0/2692307996 conn(0x7fa4b40c1cc0 msgr2=0x7fa4b40c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/2692307996 shutdown_connections 2023-10-14T09:17:22.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/2692307996 wait complete. 2023-10-14T09:17:22.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 Processor -- start 2023-10-14T09:17:22.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 -- start start 2023-10-14T09:17:22.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4b414e0f0 0x7fa4b415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4b414ed10 0x7fa4b4159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4b414f700 0x7fa4b41ebad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b41ef0e0 con 0x7fa4b414e0f0 2023-10-14T09:17:22.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b41ef380 con 0x7fa4b414ed10 2023-10-14T09:17:22.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b8d3e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b41ef660 con 0x7fa4b414f700 2023-10-14T09:17:22.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4b414e0f0 0x7fa4b415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.030+0000 7fa4b259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4b414e0f0 0x7fa4b415e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35234/0 (socket says 172.21.15.78:35234) 2023-10-14T09:17:22.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4b259c640 1 -- 172.21.15.78:0/3170989343 learned_addr learned my addr 172.21.15.78:0/3170989343 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:22.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4b2d9d640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4b414f700 0x7fa4b41ebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4a9d9b640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4b414ed10 0x7fa4b4159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4b259c640 1 -- 172.21.15.78:0/3170989343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4b414f700 msgr2=0x7fa4b41ebad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4b259c640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4b414f700 0x7fa4b41ebad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4b259c640 1 -- 172.21.15.78:0/3170989343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4b414ed10 msgr2=0x7fa4b4159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4b259c640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4b414ed10 0x7fa4b4159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4b259c640 1 -- 172.21.15.78:0/3170989343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac009b30 con 0x7fa4b414e0f0 2023-10-14T09:17:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4b259c640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4b414e0f0 0x7fa4b415e0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400c450 tx=0x7fa4a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4ab7fe640 1 -- 172.21.15.78:0/3170989343 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4012830 con 0x7fa4b414e0f0 2023-10-14T09:17:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4ab7fe640 1 -- 172.21.15.78:0/3170989343 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a40129b0 con 0x7fa4b414e0f0 2023-10-14T09:17:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4ab7fe640 1 -- 172.21.15.78:0/3170989343 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4012d60 con 0x7fa4b414e0f0 2023-10-14T09:17:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/3170989343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b41ef940 con 0x7fa4b414e0f0 2023-10-14T09:17:22.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/3170989343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b41efe60 con 0x7fa4b414e0f0 2023-10-14T09:17:22.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/3170989343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b4074180 con 0x7fa4b414e0f0 2023-10-14T09:17:22.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4ab7fe640 1 -- 172.21.15.78:0/3170989343 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa4a401c460 con 0x7fa4b414e0f0 2023-10-14T09:17:22.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4ab7fe640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4940664d0 0x7fa494068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4ab7fe640 1 -- 172.21.15.78:0/3170989343 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa4a4083900 con 0x7fa4b414e0f0 2023-10-14T09:17:22.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.034+0000 7fa4a9d9b640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4940664d0 0x7fa494068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.038+0000 7fa4a9d9b640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4940664d0 0x7fa494068990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4b414f5b0 tx=0x7fa49c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:22.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.038+0000 7fa4ab7fe640 1 -- 172.21.15.78:0/3170989343 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa4a4051050 con 0x7fa4b414e0f0 2023-10-14T09:17:22.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.190+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/3170989343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4b40c13b0 con 0x7fa4b414e0f0 2023-10-14T09:17:22.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.190+0000 7fa4ab7fe640 1 -- 172.21.15.78:0/3170989343 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fa4a4054670 con 0x7fa4b414e0f0 2023-10-14T09:17:22.195 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:22.195 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:15.304320+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:22.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/3170989343 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4940664d0 msgr2=0x7fa494068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4940664d0 0x7fa494068990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4b414f5b0 tx=0x7fa49c008040 comp rx=0 tx=0).stop 2023-10-14T09:17:22.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/3170989343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4b414e0f0 msgr2=0x7fa4b415e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4b414e0f0 0x7fa4b415e0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400c450 tx=0x7fa4a400c910 comp rx=0 tx=0).stop 2023-10-14T09:17:22.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/3170989343 shutdown_connections 2023-10-14T09:17:22.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4940664d0 0x7fa494068990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa4b414f700 0x7fa4b41ebad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4b414ed10 0x7fa4b4159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 --2- 172.21.15.78:0/3170989343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4b414e0f0 0x7fa4b415e0c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/3170989343 >> 172.21.15.78:0/3170989343 conn(0x7fa4b40c1cc0 msgr2=0x7fa4b40c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:22.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/3170989343 shutdown_connections 2023-10-14T09:17:22.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.194+0000 7fa4b8d3e640 1 -- 172.21.15.78:0/3170989343 wait complete. 2023-10-14T09:17:22.216 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:22.217 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:22.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6badd0f640 1 Processor -- start 2023-10-14T09:17:22.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6badd0f640 1 -- start start 2023-10-14T09:17:22.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6badd0f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba80bbd90 0x7f6ba806bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6badd0f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba80c0310 con 0x7f6ba806c180 2023-10-14T09:17:22.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6badd0f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba8151c90 con 0x7f6ba813af90 2023-10-14T09:17:22.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6badd0f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80bc1f0 con 0x7f6ba80bbd90 2023-10-14T09:17:22.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6ba7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6ba806c180 0x7f6ba815c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49904/0 (socket says 172.21.15.78:49904) 2023-10-14T09:17:22.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6ba7fff640 1 -- 172.21.15.78:0/3190493093 learned_addr learned my addr 172.21.15.78:0/3190493093 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:22.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6ba6ffd640 1 --2- 172.21.15.78:0/3190493093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba80bbd90 0x7f6ba806bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6ba67fc640 1 -- 172.21.15.78:0/3190493093 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875440128 0 0) 0x7f6ba80c0310 con 0x7f6ba806c180 2023-10-14T09:17:22.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6ba67fc640 1 -- 172.21.15.78:0/3190493093 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b90003530 con 0x7f6ba806c180 2023-10-14T09:17:22.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6ba67fc640 1 -- 172.21.15.78:0/3190493093 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569278705 0 0) 0x7f6ba8151c90 con 0x7f6ba813af90 2023-10-14T09:17:22.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6ba67fc640 1 -- 172.21.15.78:0/3190493093 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba80c0310 con 0x7f6ba813af90 2023-10-14T09:17:22.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6ba6ffd640 1 -- 172.21.15.78:0/3190493093 >> v1:172.21.15.157:6789/0 conn(0x7f6ba813af90 legacy=0x7f6ba80bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6ba6ffd640 1 -- 172.21.15.78:0/3190493093 >> v1:172.21.15.78:6789/0 conn(0x7f6ba806c180 legacy=0x7f6ba815c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6ba67fc640 1 -- 172.21.15.78:0/3190493093 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4044351890 0 0) 0x7f6b90003530 con 0x7f6ba806c180 2023-10-14T09:17:22.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.353+0000 7f6ba6ffd640 1 -- 172.21.15.78:0/3190493093 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba80bafd0 con 0x7f6ba80bbd90 2023-10-14T09:17:22.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.357+0000 7f6ba6ffd640 1 --2- 172.21.15.78:0/3190493093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba80bbd90 0x7f6ba806bc40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0097f0 tx=0x7f6b9c01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=460741c174c054dd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:22.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.357+0000 7f6ba67fc640 1 -- 172.21.15.78:0/3190493093 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0001a00 con 0x7f6ba80bbd90 2023-10-14T09:17:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.357+0000 7f6ba67fc640 1 -- 172.21.15.78:0/3190493093 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c0a7050 con 0x7f6ba80bbd90 2023-10-14T09:17:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.357+0000 7f6ba67fc640 1 -- 172.21.15.78:0/3190493093 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0ab620 con 0x7f6ba80bbd90 2023-10-14T09:17:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.357+0000 7f6badd0f640 1 -- 172.21.15.78:0/3190493093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba80bbd90 msgr2=0x7f6ba806bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.357+0000 7f6badd0f640 1 --2- 172.21.15.78:0/3190493093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba80bbd90 0x7f6ba806bc40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0097f0 tx=0x7f6b9c01c350 comp rx=0 tx=0).stop 2023-10-14T09:17:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.357+0000 7f6badd0f640 1 -- 172.21.15.78:0/3190493093 shutdown_connections 2023-10-14T09:17:22.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.357+0000 7f6badd0f640 1 --2- 172.21.15.78:0/3190493093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba80bbd90 0x7f6ba806bc40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.357+0000 7f6badd0f640 1 -- 172.21.15.78:0/3190493093 >> 172.21.15.78:0/3190493093 conn(0x7f6ba80c1d00 msgr2=0x7f6ba80c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:22.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.357+0000 7f6badd0f640 1 -- 172.21.15.78:0/3190493093 shutdown_connections 2023-10-14T09:17:22.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.357+0000 7f6badd0f640 1 -- 172.21.15.78:0/3190493093 wait complete. 2023-10-14T09:17:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6badd0f640 1 Processor -- start 2023-10-14T09:17:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6badd0f640 1 -- start start 2023-10-14T09:17:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6badd0f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ba806c180 0x7f6ba812fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6badd0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ba80bbd90 0x7f6ba8150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6badd0f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba813af90 0x7f6ba8151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6badd0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba814f520 con 0x7f6ba80bbd90 2023-10-14T09:17:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6badd0f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80a84a0 con 0x7f6ba806c180 2023-10-14T09:17:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6badd0f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80a9130 con 0x7f6ba813af90 2023-10-14T09:17:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ba80bbd90 0x7f6ba8150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ba80bbd90 0x7f6ba8150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35244/0 (socket says 172.21.15.78:35244) 2023-10-14T09:17:22.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba6ffd640 1 -- 172.21.15.78:0/398647209 learned_addr learned my addr 172.21.15.78:0/398647209 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:22.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba77fe640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ba806c180 0x7f6ba812fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba7fff640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba813af90 0x7f6ba8151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba6ffd640 1 -- 172.21.15.78:0/398647209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba813af90 msgr2=0x7f6ba8151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba6ffd640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba813af90 0x7f6ba8151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba6ffd640 1 -- 172.21.15.78:0/398647209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ba806c180 msgr2=0x7f6ba812fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba6ffd640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ba806c180 0x7f6ba812fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba6ffd640 1 -- 172.21.15.78:0/398647209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c009420 con 0x7f6ba80bbd90 2023-10-14T09:17:22.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba7fff640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba813af90 0x7f6ba8151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6ba6ffd640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ba80bbd90 0x7f6ba8150ee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0097f0 tx=0x7f6b9c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6b8ffff640 1 -- 172.21.15.78:0/398647209 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c004020 con 0x7f6ba80bbd90 2023-10-14T09:17:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6b8ffff640 1 -- 172.21.15.78:0/398647209 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c004180 con 0x7f6ba80bbd90 2023-10-14T09:17:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6badd0f640 1 -- 172.21.15.78:0/398647209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba80a93d0 con 0x7f6ba80bbd90 2023-10-14T09:17:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6b8ffff640 1 -- 172.21.15.78:0/398647209 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0044f0 con 0x7f6ba80bbd90 2023-10-14T09:17:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.361+0000 7f6badd0f640 1 -- 172.21.15.78:0/398647209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba814f790 con 0x7f6ba80bbd90 2023-10-14T09:17:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.365+0000 7f6badd0f640 1 -- 172.21.15.78:0/398647209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba80a98f0 con 0x7f6ba80bbd90 2023-10-14T09:17:22.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.365+0000 7f6b8ffff640 1 -- 172.21.15.78:0/398647209 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6b9c0b2040 con 0x7f6ba80bbd90 2023-10-14T09:17:22.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.365+0000 7f6b8ffff640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6b940664a0 0x7f6b94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.365+0000 7f6b8ffff640 1 -- 172.21.15.78:0/398647209 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b9c11d990 con 0x7f6ba80bbd90 2023-10-14T09:17:22.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.365+0000 7f6ba77fe640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6b940664a0 0x7f6b94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.365+0000 7f6ba77fe640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6b940664a0 0x7f6b94068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b980011f0 tx=0x7f6b98009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:22.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.369+0000 7f6b8ffff640 1 -- 172.21.15.78:0/398647209 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ba80a98f0 con 0x7f6ba80bbd90 2023-10-14T09:17:22.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.517+0000 7f6badd0f640 1 -- 172.21.15.78:0/398647209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ba80a98f0 con 0x7f6ba80bbd90 2023-10-14T09:17:22.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.517+0000 7f6b8ffff640 1 -- 172.21.15.78:0/398647209 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ba80a98f0 con 0x7f6ba80bbd90 2023-10-14T09:17:22.524 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:22.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 -- 172.21.15.78:0/398647209 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6b940664a0 msgr2=0x7f6b94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6b940664a0 0x7f6b94068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b980011f0 tx=0x7f6b98009040 comp rx=0 tx=0).stop 2023-10-14T09:17:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 -- 172.21.15.78:0/398647209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ba80bbd90 msgr2=0x7f6ba8150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ba80bbd90 0x7f6ba8150ee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0097f0 tx=0x7f6b9c0190f0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 -- 172.21.15.78:0/398647209 shutdown_connections 2023-10-14T09:17:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6b940664a0 0x7f6b94068960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6ba813af90 0x7f6ba8151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ba80bbd90 0x7f6ba8150ee0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 --2- 172.21.15.78:0/398647209 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6ba806c180 0x7f6ba812fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 -- 172.21.15.78:0/398647209 >> 172.21.15.78:0/398647209 conn(0x7f6ba80c1d00 msgr2=0x7f6ba8139ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 -- 172.21.15.78:0/398647209 shutdown_connections 2023-10-14T09:17:22.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.521+0000 7f6badd0f640 1 -- 172.21.15.78:0/398647209 wait complete. 2023-10-14T09:17:22.544 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T09:17:22.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.677+0000 7f6517f35640 1 Processor -- start 2023-10-14T09:17:22.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.677+0000 7f6517f35640 1 -- start start 2023-10-14T09:17:22.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.677+0000 7f6517f35640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65100c1eb0 0x7f65100c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.677+0000 7f6517f35640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6510151810 con 0x7f6510151430 2023-10-14T09:17:22.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.677+0000 7f6517f35640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651006f760 con 0x7f65100c7d30 2023-10-14T09:17:22.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.677+0000 7f6517f35640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65100c27d0 con 0x7f65100c1eb0 2023-10-14T09:17:22.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.677+0000 7f65154d0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65100c1eb0 0x7f65100c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.677+0000 7f6515cd1640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6510151430 0x7f65101547e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49912/0 (socket says 172.21.15.78:49912) 2023-10-14T09:17:22.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.677+0000 7f6515cd1640 1 -- 172.21.15.78:0/4243209736 learned_addr learned my addr 172.21.15.78:0/4243209736 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:22.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f65154d0640 1 -- 172.21.15.78:0/4243209736 >> v1:172.21.15.157:6789/0 conn(0x7f65100c7d30 legacy=0x7f65100c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:22.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f6514ccf640 1 -- 172.21.15.78:0/4243209736 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085615644 0 0) 0x7f6510151810 con 0x7f6510151430 2023-10-14T09:17:22.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f65154d0640 1 -- 172.21.15.78:0/4243209736 >> v1:172.21.15.78:6789/0 conn(0x7f6510151430 legacy=0x7f65101547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f65154d0640 1 -- 172.21.15.78:0/4243209736 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651006fa00 con 0x7f65100c1eb0 2023-10-14T09:17:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f65154d0640 1 --2- 172.21.15.78:0/4243209736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65100c1eb0 0x7f65100c77f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f65000097c0 tx=0x7f650001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1093933f4f026183 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f6514ccf640 1 -- 172.21.15.78:0/4243209736 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65000ab600 con 0x7f65100c1eb0 2023-10-14T09:17:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f6514ccf640 1 -- 172.21.15.78:0/4243209736 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65000a7050 con 0x7f65100c1eb0 2023-10-14T09:17:22.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f6514ccf640 1 -- 172.21.15.78:0/4243209736 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65000ab980 con 0x7f65100c1eb0 2023-10-14T09:17:22.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f6517f35640 1 -- 172.21.15.78:0/4243209736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65100c1eb0 msgr2=0x7f65100c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f6517f35640 1 --2- 172.21.15.78:0/4243209736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65100c1eb0 0x7f65100c77f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f65000097c0 tx=0x7f650001c2f0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f6517f35640 1 -- 172.21.15.78:0/4243209736 shutdown_connections 2023-10-14T09:17:22.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f6517f35640 1 --2- 172.21.15.78:0/4243209736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65100c1eb0 0x7f65100c77f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.681+0000 7f6517f35640 1 -- 172.21.15.78:0/4243209736 >> 172.21.15.78:0/4243209736 conn(0x7f651006a060 msgr2=0x7f651006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:22.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 -- 172.21.15.78:0/4243209736 shutdown_connections 2023-10-14T09:17:22.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 -- 172.21.15.78:0/4243209736 wait complete. 2023-10-14T09:17:22.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 Processor -- start 2023-10-14T09:17:22.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 -- start start 2023-10-14T09:17:22.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65100c1eb0 0x7f651014d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65100c7d30 0x7f65100be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6510151430 0x7f65101564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651014d480 con 0x7f65100c1eb0 2023-10-14T09:17:22.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6510152d70 con 0x7f65100c7d30 2023-10-14T09:17:22.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651014c800 con 0x7f6510151430 2023-10-14T09:17:22.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6515cd1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65100c1eb0 0x7f651014d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6515cd1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65100c1eb0 0x7f651014d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35262/0 (socket says 172.21.15.78:35262) 2023-10-14T09:17:22.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6515cd1640 1 -- 172.21.15.78:0/3054032332 learned_addr learned my addr 172.21.15.78:0/3054032332 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:22.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f65154d0640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65100c7d30 0x7f65100be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f65164d2640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6510151430 0x7f65101564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6515cd1640 1 -- 172.21.15.78:0/3054032332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6510151430 msgr2=0x7f65101564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6515cd1640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6510151430 0x7f65101564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6515cd1640 1 -- 172.21.15.78:0/3054032332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65100c7d30 msgr2=0x7f65100be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6515cd1640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65100c7d30 0x7f65100be7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6515cd1640 1 -- 172.21.15.78:0/3054032332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500009420 con 0x7f65100c1eb0 2023-10-14T09:17:22.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f65164d2640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6510151430 0x7f65101564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:22.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6515cd1640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65100c1eb0 0x7f651014d8a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f650c0011f0 tx=0x7f650c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:22.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f65067fc640 1 -- 172.21.15.78:0/3054032332 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c0074e0 con 0x7f65100c1eb0 2023-10-14T09:17:22.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f65067fc640 1 -- 172.21.15.78:0/3054032332 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c007640 con 0x7f65100c1eb0 2023-10-14T09:17:22.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f65067fc640 1 -- 172.21.15.78:0/3054032332 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c004a10 con 0x7f65100c1eb0 2023-10-14T09:17:22.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 -- 172.21.15.78:0/3054032332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651014cae0 con 0x7f65100c1eb0 2023-10-14T09:17:22.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.685+0000 7f6517f35640 1 -- 172.21.15.78:0/3054032332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651014d0a0 con 0x7f65100c1eb0 2023-10-14T09:17:22.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.689+0000 7f6517f35640 1 -- 172.21.15.78:0/3054032332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6510074180 con 0x7f65100c1eb0 2023-10-14T09:17:22.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.689+0000 7f65067fc640 1 -- 172.21.15.78:0/3054032332 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f650c004b70 con 0x7f65100c1eb0 2023-10-14T09:17:22.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.689+0000 7f65067fc640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f64f40664d0 0x7f64f4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:22.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.689+0000 7f65067fc640 1 -- 172.21.15.78:0/3054032332 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f650c082ce0 con 0x7f65100c1eb0 2023-10-14T09:17:22.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.689+0000 7f65154d0640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f64f40664d0 0x7f64f4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:22.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.689+0000 7f65154d0640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f64f40664d0 0x7f64f4068990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f65000ad000 tx=0x7f65000a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:22.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.693+0000 7f65067fc640 1 -- 172.21.15.78:0/3054032332 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f650c0504a0 con 0x7f65100c1eb0 2023-10-14T09:17:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 -- 172.21.15.78:0/3054032332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6510152360 con 0x7f65100c1eb0 2023-10-14T09:17:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f65067fc640 1 -- 172.21.15.78:0/3054032332 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f650c018020 con 0x7f65100c1eb0 2023-10-14T09:17:22.850 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:22.851 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-10-14T09:17:22.851 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:17:22.851 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-10-14T09:17:22.851 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-10-14T09:17:22.851 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:17:22.852 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-10-14T09:17:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 -- 172.21.15.78:0/3054032332 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f64f40664d0 msgr2=0x7f64f4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f64f40664d0 0x7f64f4068990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f65000ad000 tx=0x7f65000a6000 comp rx=0 tx=0).stop 2023-10-14T09:17:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 -- 172.21.15.78:0/3054032332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65100c1eb0 msgr2=0x7f651014d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65100c1eb0 0x7f651014d8a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f650c0011f0 tx=0x7f650c00c9b0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 -- 172.21.15.78:0/3054032332 shutdown_connections 2023-10-14T09:17:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f64f40664d0 0x7f64f4068990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6510151430 0x7f65101564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65100c7d30 0x7f65100be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 --2- 172.21.15.78:0/3054032332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65100c1eb0 0x7f651014d8a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:22.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 -- 172.21.15.78:0/3054032332 >> 172.21.15.78:0/3054032332 conn(0x7f651006a060 msgr2=0x7f651014eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:22.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 -- 172.21.15.78:0/3054032332 shutdown_connections 2023-10-14T09:17:22.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:22.845+0000 7f6517f35640 1 -- 172.21.15.78:0/3054032332 wait complete. 2023-10-14T09:17:22.870 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T09:17:22.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T09:17:23.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb584617640 1 Processor -- start 2023-10-14T09:17:23.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb584617640 1 -- start start 2023-10-14T09:17:23.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb584617640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb57c0c0450 0x7fb57c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb584617640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb57c06d750 0x7fb57c0c0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb584617640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c06bcc0 con 0x7fb57c0c1230 2023-10-14T09:17:23.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb584617640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c06c340 con 0x7fb57c06d750 2023-10-14T09:17:23.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb584617640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c06ce70 con 0x7fb57c0c0450 2023-10-14T09:17:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb582bb4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb57c06d750 0x7fb57c0c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb582bb4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb57c06d750 0x7fb57c0c0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35272/0 (socket says 172.21.15.78:35272) 2023-10-14T09:17:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb582bb4640 1 -- 172.21.15.78:0/461693339 learned_addr learned my addr 172.21.15.78:0/461693339 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb5823b3640 1 --2- 172.21.15.78:0/461693339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb57c0c0450 0x7fb57c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb582bb4640 1 -- 172.21.15.78:0/461693339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb57c0c0450 msgr2=0x7fb57c06fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb582bb4640 1 --2- 172.21.15.78:0/461693339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb57c0c0450 0x7fb57c06fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb582bb4640 1 -- 172.21.15.78:0/461693339 >> v1:172.21.15.157:6789/0 conn(0x7fb57c0c1230 legacy=0x7fb57c06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.009+0000 7fb582bb4640 1 -- 172.21.15.78:0/461693339 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c150dd0 con 0x7fb57c06d750 2023-10-14T09:17:23.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb582bb4640 1 --2- 172.21.15.78:0/461693339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb57c06d750 0x7fb57c0c0830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb574009e80 tx=0x7fb57401d450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67a8e5bd649b77f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:23.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb5813b1640 1 -- 172.21.15.78:0/461693339 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740a5750 con 0x7fb57c06d750 2023-10-14T09:17:23.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb5813b1640 1 -- 172.21.15.78:0/461693339 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5740a58b0 con 0x7fb57c06d750 2023-10-14T09:17:23.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb5813b1640 1 -- 172.21.15.78:0/461693339 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740a5c40 con 0x7fb57c06d750 2023-10-14T09:17:23.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb584617640 1 -- 172.21.15.78:0/461693339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb57c06d750 msgr2=0x7fb57c0c0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:23.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb584617640 1 --2- 172.21.15.78:0/461693339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb57c06d750 0x7fb57c0c0830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb574009e80 tx=0x7fb57401d450 comp rx=0 tx=0).stop 2023-10-14T09:17:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb584617640 1 -- 172.21.15.78:0/461693339 shutdown_connections 2023-10-14T09:17:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb584617640 1 --2- 172.21.15.78:0/461693339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb57c06d750 0x7fb57c0c0830 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb584617640 1 --2- 172.21.15.78:0/461693339 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb57c0c0450 0x7fb57c06fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb584617640 1 -- 172.21.15.78:0/461693339 >> 172.21.15.78:0/461693339 conn(0x7fb57c0c1cc0 msgr2=0x7fb57c0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:23.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb584617640 1 -- 172.21.15.78:0/461693339 shutdown_connections 2023-10-14T09:17:23.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.013+0000 7fb584617640 1 -- 172.21.15.78:0/461693339 wait complete. 2023-10-14T09:17:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb584617640 1 Processor -- start 2023-10-14T09:17:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb584617640 1 -- start start 2023-10-14T09:17:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb584617640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb57c06d750 0x7fb57c147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb584617640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb57c0c0450 0x7fb57c13b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb584617640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb57c0c1230 0x7fb57c151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb584617640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1ef200 con 0x7fb57c0c1230 2023-10-14T09:17:23.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb584617640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1ef4e0 con 0x7fb57c0c0450 2023-10-14T09:17:23.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb584617640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1ef7c0 con 0x7fb57c06d750 2023-10-14T09:17:23.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb582bb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb57c0c1230 0x7fb57c151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb582bb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb57c0c1230 0x7fb57c151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35276/0 (socket says 172.21.15.78:35276) 2023-10-14T09:17:23.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb582bb4640 1 -- 172.21.15.78:0/3038239208 learned_addr learned my addr 172.21.15.78:0/3038239208 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:23.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb581bb2640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb57c0c0450 0x7fb57c13b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb5823b3640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb57c06d750 0x7fb57c147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb582bb4640 1 -- 172.21.15.78:0/3038239208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb57c06d750 msgr2=0x7fb57c147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:23.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb582bb4640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb57c06d750 0x7fb57c147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb582bb4640 1 -- 172.21.15.78:0/3038239208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb57c0c0450 msgr2=0x7fb57c13b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:23.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb582bb4640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb57c0c0450 0x7fb57c13b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb582bb4640 1 -- 172.21.15.78:0/3038239208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574009b30 con 0x7fb57c0c1230 2023-10-14T09:17:23.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb582bb4640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb57c0c1230 0x7fb57c151dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb5740af040 tx=0x7fb574019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:23.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb572ffd640 1 -- 172.21.15.78:0/3038239208 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574009510 con 0x7fb57c0c1230 2023-10-14T09:17:23.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb572ffd640 1 -- 172.21.15.78:0/3038239208 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5740b8470 con 0x7fb57c0c1230 2023-10-14T09:17:23.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb584617640 1 -- 172.21.15.78:0/3038239208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c1efaa0 con 0x7fb57c0c1230 2023-10-14T09:17:23.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb572ffd640 1 -- 172.21.15.78:0/3038239208 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740b8820 con 0x7fb57c0c1230 2023-10-14T09:17:23.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb584617640 1 -- 172.21.15.78:0/3038239208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c06fdd0 con 0x7fb57c0c1230 2023-10-14T09:17:23.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.017+0000 7fb584617640 1 -- 172.21.15.78:0/3038239208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c1effc0 con 0x7fb57c0c1230 2023-10-14T09:17:23.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.021+0000 7fb572ffd640 1 -- 172.21.15.78:0/3038239208 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb5740b8980 con 0x7fb57c0c1230 2023-10-14T09:17:23.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.021+0000 7fb572ffd640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb5600664a0 0x7fb560068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.021+0000 7fb572ffd640 1 -- 172.21.15.78:0/3038239208 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb57411e5a0 con 0x7fb57c0c1230 2023-10-14T09:17:23.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.021+0000 7fb5823b3640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb5600664a0 0x7fb560068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.021+0000 7fb5823b3640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb5600664a0 0x7fb560068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb578009ac0 tx=0x7fb578009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:23.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.025+0000 7fb572ffd640 1 -- 172.21.15.78:0/3038239208 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb57c1effc0 con 0x7fb57c0c1230 2023-10-14T09:17:23.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.173+0000 7fb584617640 1 -- 172.21.15.78:0/3038239208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb57c1effc0 con 0x7fb57c0c1230 2023-10-14T09:17:23.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.617+0000 7fb572ffd640 1 -- 172.21.15.78:0/3038239208 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb57c1effc0 con 0x7fb57c0c1230 2023-10-14T09:17:23.621 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-10-14T09:17:23.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.617+0000 7fb584617640 1 -- 172.21.15.78:0/3038239208 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb5600664a0 msgr2=0x7fb560068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:23.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.617+0000 7fb584617640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb5600664a0 0x7fb560068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb578009ac0 tx=0x7fb578009190 comp rx=0 tx=0).stop 2023-10-14T09:17:23.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.617+0000 7fb584617640 1 -- 172.21.15.78:0/3038239208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb57c0c1230 msgr2=0x7fb57c151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:23.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.617+0000 7fb584617640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb57c0c1230 0x7fb57c151dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb5740af040 tx=0x7fb574019790 comp rx=0 tx=0).stop 2023-10-14T09:17:23.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.617+0000 7fb584617640 1 -- 172.21.15.78:0/3038239208 shutdown_connections 2023-10-14T09:17:23.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.617+0000 7fb584617640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb57c0c1230 0x7fb57c151dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.617+0000 7fb584617640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb57c0c0450 0x7fb57c13b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.617+0000 7fb584617640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb5600664a0 0x7fb560068960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.617+0000 7fb584617640 1 --2- 172.21.15.78:0/3038239208 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb57c06d750 0x7fb57c147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.617+0000 7fb584617640 1 -- 172.21.15.78:0/3038239208 >> 172.21.15.78:0/3038239208 conn(0x7fb57c0c1cc0 msgr2=0x7fb57c070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:23.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.621+0000 7fb584617640 1 -- 172.21.15.78:0/3038239208 shutdown_connections 2023-10-14T09:17:23.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.621+0000 7fb584617640 1 -- 172.21.15.78:0/3038239208 wait complete. 2023-10-14T09:17:23.650 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T09:17:23.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa89050e640 1 Processor -- start 2023-10-14T09:17:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa89050e640 1 -- start start 2023-10-14T09:17:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa89050e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa8880bbd90 0x7fa88806bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa89050e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa88806c180 0x7fa88815c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa89050e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880bb900 con 0x7fa88813b090 2023-10-14T09:17:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa89050e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8880bc1f0 con 0x7fa8880bbd90 2023-10-14T09:17:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa89050e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88813b470 con 0x7fa88806c180 2023-10-14T09:17:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa88daa9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa8880bbd90 0x7fa88806bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa88daa9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa8880bbd90 0x7fa88806bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35290/0 (socket says 172.21.15.78:35290) 2023-10-14T09:17:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa88daa9640 1 -- 172.21.15.78:0/2739154995 learned_addr learned my addr 172.21.15.78:0/2739154995 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa88eaab640 1 --2- 172.21.15.78:0/2739154995 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa88806c180 0x7fa88815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa88daa9640 1 -- 172.21.15.78:0/2739154995 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa88806c180 msgr2=0x7fa88815c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa88daa9640 1 --2- 172.21.15.78:0/2739154995 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa88806c180 0x7fa88815c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa88daa9640 1 -- 172.21.15.78:0/2739154995 >> v1:172.21.15.157:6789/0 conn(0x7fa88813b090 legacy=0x7fa8880bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.793+0000 7fa88daa9640 1 -- 172.21.15.78:0/2739154995 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8880c0310 con 0x7fa8880bbd90 2023-10-14T09:17:23.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa88daa9640 1 --2- 172.21.15.78:0/2739154995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8880bbd90 0x7fa88806bc40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa878009870 tx=0x7fa87801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9345ce08ca9e8c36 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:23.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa88d2a8640 1 -- 172.21.15.78:0/2739154995 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780aa610 con 0x7fa8880bbd90 2023-10-14T09:17:23.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa88d2a8640 1 -- 172.21.15.78:0/2739154995 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8780a6040 con 0x7fa8880bbd90 2023-10-14T09:17:23.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa88d2a8640 1 -- 172.21.15.78:0/2739154995 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780aa990 con 0x7fa8880bbd90 2023-10-14T09:17:23.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa89050e640 1 -- 172.21.15.78:0/2739154995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8880bbd90 msgr2=0x7fa88806bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:23.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa89050e640 1 --2- 172.21.15.78:0/2739154995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8880bbd90 0x7fa88806bc40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa878009870 tx=0x7fa87801c4b0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa89050e640 1 -- 172.21.15.78:0/2739154995 shutdown_connections 2023-10-14T09:17:23.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa89050e640 1 --2- 172.21.15.78:0/2739154995 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa88806c180 0x7fa88815c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa89050e640 1 --2- 172.21.15.78:0/2739154995 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8880bbd90 0x7fa88806bc40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa89050e640 1 -- 172.21.15.78:0/2739154995 >> 172.21.15.78:0/2739154995 conn(0x7fa8880c1d00 msgr2=0x7fa8880c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:23.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa89050e640 1 -- 172.21.15.78:0/2739154995 shutdown_connections 2023-10-14T09:17:23.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa89050e640 1 -- 172.21.15.78:0/2739154995 wait complete. 2023-10-14T09:17:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa89050e640 1 Processor -- start 2023-10-14T09:17:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.797+0000 7fa89050e640 1 -- start start 2023-10-14T09:17:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa89050e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa88806c180 0x7fa888139250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa89050e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8880bbd90 0x7fa888135aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa89050e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88813b090 0x7fa88814e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa89050e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880716e0 con 0x7fa88813b090 2023-10-14T09:17:23.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa89050e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa888131b00 con 0x7fa8880bbd90 2023-10-14T09:17:23.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa89050e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880a9e70 con 0x7fa88806c180 2023-10-14T09:17:23.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88eaab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88813b090 0x7fa88814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88eaab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88813b090 0x7fa88814e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35294/0 (socket says 172.21.15.78:35294) 2023-10-14T09:17:23.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88eaab640 1 -- 172.21.15.78:0/2496353864 learned_addr learned my addr 172.21.15.78:0/2496353864 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:23.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88e2aa640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa88806c180 0x7fa888139250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88daa9640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8880bbd90 0x7fa888135aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88eaab640 1 -- 172.21.15.78:0/2496353864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa88806c180 msgr2=0x7fa888139250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:23.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88eaab640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa88806c180 0x7fa888139250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88eaab640 1 -- 172.21.15.78:0/2496353864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8880bbd90 msgr2=0x7fa888135aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:23.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88eaab640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8880bbd90 0x7fa888135aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:23.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88eaab640 1 -- 172.21.15.78:0/2496353864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780094d0 con 0x7fa88813b090 2023-10-14T09:17:23.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88daa9640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8880bbd90 0x7fa888135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:23.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa88eaab640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88813b090 0x7fa88814e990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa880007e60 tx=0x7fa88000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:23.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa87effd640 1 -- 172.21.15.78:0/2496353864 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880014420 con 0x7fa88813b090 2023-10-14T09:17:23.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa87effd640 1 -- 172.21.15.78:0/2496353864 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8800145a0 con 0x7fa88813b090 2023-10-14T09:17:23.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa89050e640 1 -- 172.21.15.78:0/2496353864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8880a9b90 con 0x7fa88813b090 2023-10-14T09:17:23.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa87effd640 1 -- 172.21.15.78:0/2496353864 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880014950 con 0x7fa88813b090 2023-10-14T09:17:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa89050e640 1 -- 172.21.15.78:0/2496353864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8880a90f0 con 0x7fa88813b090 2023-10-14T09:17:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa89050e640 1 -- 172.21.15.78:0/2496353864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa888131c70 con 0x7fa88813b090 2023-10-14T09:17:23.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.801+0000 7fa87effd640 1 -- 172.21.15.78:0/2496353864 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa880014ab0 con 0x7fa88813b090 2023-10-14T09:17:23.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.805+0000 7fa87effd640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa86c0664a0 0x7fa86c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:23.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.805+0000 7fa87effd640 1 -- 172.21.15.78:0/2496353864 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa8800845f0 con 0x7fa88813b090 2023-10-14T09:17:23.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.805+0000 7fa88e2aa640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa86c0664a0 0x7fa86c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:23.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.805+0000 7fa88e2aa640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa86c0664a0 0x7fa86c068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa884000f70 tx=0x7fa884009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:23.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.809+0000 7fa87effd640 1 -- 172.21.15.78:0/2496353864 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa888131c70 con 0x7fa88813b090 2023-10-14T09:17:23.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:23.957+0000 7fa89050e640 1 -- 172.21.15.78:0/2496353864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa888131c70 con 0x7fa88813b090 2023-10-14T09:17:24.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.617+0000 7fa87effd640 1 -- 172.21.15.78:0/2496353864 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa888131c70 con 0x7fa88813b090 2023-10-14T09:17:24.625 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-10-14T09:17:24.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 -- 172.21.15.78:0/2496353864 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa86c0664a0 msgr2=0x7fa86c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:24.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa86c0664a0 0x7fa86c068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa884000f70 tx=0x7fa884009040 comp rx=0 tx=0).stop 2023-10-14T09:17:24.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 -- 172.21.15.78:0/2496353864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88813b090 msgr2=0x7fa88814e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:24.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88813b090 0x7fa88814e990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa880007e60 tx=0x7fa88000e4b0 comp rx=0 tx=0).stop 2023-10-14T09:17:24.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 -- 172.21.15.78:0/2496353864 shutdown_connections 2023-10-14T09:17:24.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88813b090 0x7fa88814e990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:24.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8880bbd90 0x7fa888135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:24.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa86c0664a0 0x7fa86c068960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:24.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 --2- 172.21.15.78:0/2496353864 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa88806c180 0x7fa888139250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:24.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 -- 172.21.15.78:0/2496353864 >> 172.21.15.78:0/2496353864 conn(0x7fa8880c1d00 msgr2=0x7fa888151480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:24.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 -- 172.21.15.78:0/2496353864 shutdown_connections 2023-10-14T09:17:24.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.621+0000 7fa89050e640 1 -- 172.21.15.78:0/2496353864 wait complete. 2023-10-14T09:17:24.668 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T09:17:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa5719b8640 1 Processor -- start 2023-10-14T09:17:24.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa5719b8640 1 -- start start 2023-10-14T09:17:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa5719b8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa56c0c75b0 0x7fa56c1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa5719b8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56c157360 con 0x7fa56c0c4030 2023-10-14T09:17:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa5719b8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56c157ee0 con 0x7fa56c06cc50 2023-10-14T09:17:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa5719b8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c0c5300 con 0x7fa56c0c75b0 2023-10-14T09:17:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa56b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa56c0c75b0 0x7fa56c1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa56b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa56c0c75b0 0x7fa56c1544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35298/0 (socket says 172.21.15.78:35298) 2023-10-14T09:17:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa56b7fe640 1 -- 172.21.15.78:0/570710825 learned_addr learned my addr 172.21.15.78:0/570710825 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa56affd640 1 --1- 172.21.15.78:0/570710825 >> v1:172.21.15.78:6789/0 conn(0x7fa56c0c4030 0x7fa56c0c4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49928/0 (socket says 172.21.15.78:49928) 2023-10-14T09:17:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa56b7fe640 1 -- 172.21.15.78:0/570710825 >> v1:172.21.15.157:6789/0 conn(0x7fa56c06cc50 legacy=0x7fa56c153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa56b7fe640 1 -- 172.21.15.78:0/570710825 >> v1:172.21.15.78:6789/0 conn(0x7fa56c0c4030 legacy=0x7fa56c0c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa56b7fe640 1 -- 172.21.15.78:0/570710825 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c1549e0 con 0x7fa56c0c75b0 2023-10-14T09:17:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.805+0000 7fa569ffb640 1 -- 172.21.15.78:0/570710825 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794848382 0 0) 0x7fa56c157360 con 0x7fa56c0c4030 2023-10-14T09:17:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa56b7fe640 1 --2- 172.21.15.78:0/570710825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56c0c75b0 0x7fa56c1544a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa564009e50 tx=0x7fa56401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc647b2b20164fa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa569ffb640 1 -- 172.21.15.78:0/570710825 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640a5840 con 0x7fa56c0c75b0 2023-10-14T09:17:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa569ffb640 1 -- 172.21.15.78:0/570710825 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5640a59a0 con 0x7fa56c0c75b0 2023-10-14T09:17:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa569ffb640 1 -- 172.21.15.78:0/570710825 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640a5d30 con 0x7fa56c0c75b0 2023-10-14T09:17:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa5719b8640 1 -- 172.21.15.78:0/570710825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56c0c75b0 msgr2=0x7fa56c1544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa5719b8640 1 --2- 172.21.15.78:0/570710825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56c0c75b0 0x7fa56c1544a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa564009e50 tx=0x7fa56401c980 comp rx=0 tx=0).stop 2023-10-14T09:17:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa5719b8640 1 -- 172.21.15.78:0/570710825 shutdown_connections 2023-10-14T09:17:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa5719b8640 1 --2- 172.21.15.78:0/570710825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56c0c75b0 0x7fa56c1544a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa5719b8640 1 -- 172.21.15.78:0/570710825 >> 172.21.15.78:0/570710825 conn(0x7fa56c0ab240 msgr2=0x7fa56c0ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa5719b8640 1 -- 172.21.15.78:0/570710825 shutdown_connections 2023-10-14T09:17:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa5719b8640 1 -- 172.21.15.78:0/570710825 wait complete. 2023-10-14T09:17:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.809+0000 7fa5719b8640 1 Processor -- start 2023-10-14T09:17:24.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa5719b8640 1 -- start start 2023-10-14T09:17:24.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa5719b8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa56c06cc50 0x7fa56c1ebdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:24.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa5719b8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa56c0c4030 0x7fa56c0bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:24.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa5719b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56c0c75b0 0x7fa56c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:24.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa5719b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0bf670 con 0x7fa56c0c75b0 2023-10-14T09:17:24.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa5719b8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c150f20 con 0x7fa56c0c4030 2023-10-14T09:17:24.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa5719b8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0a9fb0 con 0x7fa56c06cc50 2023-10-14T09:17:24.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56c0c75b0 0x7fa56c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:24.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56c0c75b0 0x7fa56c1504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35308/0 (socket says 172.21.15.78:35308) 2023-10-14T09:17:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa56b7fe640 1 -- 172.21.15.78:0/2443253654 learned_addr learned my addr 172.21.15.78:0/2443253654 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa56a7fc640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa56c0c4030 0x7fa56c0bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa56affd640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa56c06cc50 0x7fa56c1ebdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa56b7fe640 1 -- 172.21.15.78:0/2443253654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa56c06cc50 msgr2=0x7fa56c1ebdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa56b7fe640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa56c06cc50 0x7fa56c1ebdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:24.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa56b7fe640 1 -- 172.21.15.78:0/2443253654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa56c0c4030 msgr2=0x7fa56c0bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:24.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa56b7fe640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa56c0c4030 0x7fa56c0bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:24.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa56b7fe640 1 -- 172.21.15.78:0/2443253654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa564009b30 con 0x7fa56c0c75b0 2023-10-14T09:17:24.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa56b7fe640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56c0c75b0 0x7fa56c1504e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa5640af040 tx=0x7fa564019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa553fff640 1 -- 172.21.15.78:0/2443253654 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640b8670 con 0x7fa56c0c75b0 2023-10-14T09:17:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa553fff640 1 -- 172.21.15.78:0/2443253654 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5640b87d0 con 0x7fa56c0c75b0 2023-10-14T09:17:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa5719b8640 1 -- 172.21.15.78:0/2443253654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c0bf8a0 con 0x7fa56c0c75b0 2023-10-14T09:17:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa553fff640 1 -- 172.21.15.78:0/2443253654 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640b8b60 con 0x7fa56c0c75b0 2023-10-14T09:17:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa5719b8640 1 -- 172.21.15.78:0/2443253654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c0c0300 con 0x7fa56c0c75b0 2023-10-14T09:17:24.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.813+0000 7fa5719b8640 1 -- 172.21.15.78:0/2443253654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c0a9e10 con 0x7fa56c0c75b0 2023-10-14T09:17:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.817+0000 7fa553fff640 1 -- 172.21.15.78:0/2443253654 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa5640b8cc0 con 0x7fa56c0c75b0 2023-10-14T09:17:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.817+0000 7fa553fff640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5580664a0 0x7fa558068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.817+0000 7fa553fff640 1 -- 172.21.15.78:0/2443253654 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa56411f3c0 con 0x7fa56c0c75b0 2023-10-14T09:17:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.817+0000 7fa56affd640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5580664a0 0x7fa558068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.817+0000 7fa56affd640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5580664a0 0x7fa558068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa55c007a90 tx=0x7fa55c0079e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:24.821+0000 7fa553fff640 1 -- 172.21.15.78:0/2443253654 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5640ecac0 con 0x7fa56c0c75b0 2023-10-14T09:17:25.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.001+0000 7fa5719b8640 1 -- 172.21.15.78:0/2443253654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa56c0a9e10 con 0x7fa56c0c75b0 2023-10-14T09:17:25.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:17:25.147 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:17:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.633+0000 7fa553fff640 1 -- 172.21.15.78:0/2443253654 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa56c0a9e10 con 0x7fa56c0c75b0 2023-10-14T09:17:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 2 and data pool 3 2023-10-14T09:17:25.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 -- 172.21.15.78:0/2443253654 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5580664a0 msgr2=0x7fa558068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:25.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5580664a0 0x7fa558068960 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa55c007a90 tx=0x7fa55c0079e0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 -- 172.21.15.78:0/2443253654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56c0c75b0 msgr2=0x7fa56c1504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:25.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56c0c75b0 0x7fa56c1504e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa5640af040 tx=0x7fa564019720 comp rx=0 tx=0).stop 2023-10-14T09:17:25.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 -- 172.21.15.78:0/2443253654 shutdown_connections 2023-10-14T09:17:25.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa56c0c75b0 0x7fa56c1504e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa56c0c4030 0x7fa56c0bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5580664a0 0x7fa558068960 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 --2- 172.21.15.78:0/2443253654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa56c06cc50 0x7fa56c1ebdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 -- 172.21.15.78:0/2443253654 >> 172.21.15.78:0/2443253654 conn(0x7fa56c0ab240 msgr2=0x7fa56c15eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 -- 172.21.15.78:0/2443253654 shutdown_connections 2023-10-14T09:17:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.637+0000 7fa5719b8640 1 -- 172.21.15.78:0/2443253654 wait complete. 2023-10-14T09:17:25.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:25.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.805+0000 7f5f06d2a640 1 Processor -- start 2023-10-14T09:17:25.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.805+0000 7f5f06d2a640 1 -- start start 2023-10-14T09:17:25.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.805+0000 7f5f06d2a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5f000c0450 0x7f5f0006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.805+0000 7f5f06d2a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f0006d750 0x7f5f000c0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.805+0000 7f5f06d2a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0006bcc0 con 0x7f5f000c1230 2023-10-14T09:17:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.805+0000 7f5f06d2a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0006c340 con 0x7f5f000c0450 2023-10-14T09:17:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.805+0000 7f5f06d2a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0006ce70 con 0x7f5f0006d750 2023-10-14T09:17:25.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.805+0000 7f5efffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5f000c1230 0x7f5f0006c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49934/0 (socket says 172.21.15.78:49934) 2023-10-14T09:17:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.805+0000 7f5efffff640 1 -- 172.21.15.78:0/1850567355 learned_addr learned my addr 172.21.15.78:0/1850567355 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5f04ac6640 1 --2- 172.21.15.78:0/1850567355 >> v2:172.21.15.157:3300/0 conn(0x7f5f000c0450 0x7f5f0006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5f052c7640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f0006d750 0x7f5f000c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379327821 0 0) 0x7f5f0006bcc0 con 0x7f5f000c1230 2023-10-14T09:17:25.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee8003530 con 0x7f5f000c1230 2023-10-14T09:17:25.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1301817721 0 0) 0x7f5ee8003530 con 0x7f5f000c1230 2023-10-14T09:17:25.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f0006d750 msgr2=0x7f5f000c0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:25.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f0006d750 0x7f5f000c0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 >> v2:172.21.15.157:3300/0 conn(0x7f5f000c0450 msgr2=0x7f5f0006fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:25.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 --2- 172.21.15.78:0/1850567355 >> v2:172.21.15.157:3300/0 conn(0x7f5f000c0450 0x7f5f0006fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f00150dd0 con 0x7f5f000c1230 2023-10-14T09:17:25.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f5ef4001680 con 0x7f5f000c1230 2023-10-14T09:17:25.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 >> v1:172.21.15.78:6789/0 conn(0x7f5f000c1230 legacy=0x7f5f0006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:25.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ee80039b0 0x7f5ee8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:25.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ee80047d0 0x7f5ee8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:25.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f0006d750 0x7f5ee8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:25.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0006c340 con 0x7f5ee80039b0 2023-10-14T09:17:25.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0006ce70 con 0x7f5ee80047d0 2023-10-14T09:17:25.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee800b990 con 0x7f5f0006d750 2023-10-14T09:17:25.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5f04ac6640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ee80039b0 0x7f5ee8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5f052c7640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f0006d750 0x7f5ee8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5efffff640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ee80047d0 0x7f5ee8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5f04ac6640 1 -- 172.21.15.78:0/1850567355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f0006d750 msgr2=0x7f5ee8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5f04ac6640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f0006d750 0x7f5ee8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5f04ac6640 1 -- 172.21.15.78:0/1850567355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ee80047d0 msgr2=0x7f5ee8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:25.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5f04ac6640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5ee80047d0 0x7f5ee8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.809+0000 7f5f04ac6640 1 -- 172.21.15.78:0/1850567355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8003530 con 0x7f5ee80039b0 2023-10-14T09:17:25.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5f04ac6640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ee80039b0 0x7f5ee8003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009ae0 tx=0x7f5ef001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a0b1ec8380c5fc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:25.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00a6420 con 0x7f5ee80039b0 2023-10-14T09:17:25.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef00a6580 con 0x7f5ee80039b0 2023-10-14T09:17:25.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5eff7fe640 1 -- 172.21.15.78:0/1850567355 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00a6930 con 0x7f5ee80039b0 2023-10-14T09:17:25.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5f06d2a640 1 -- 172.21.15.78:0/1850567355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ee80039b0 msgr2=0x7f5ee8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:25.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5f06d2a640 1 --2- 172.21.15.78:0/1850567355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ee80039b0 0x7f5ee8003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009ae0 tx=0x7f5ef001ca90 comp rx=0 tx=0).stop 2023-10-14T09:17:25.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5f052c7640 1 -- 172.21.15.78:0/1850567355 reap_dead start 2023-10-14T09:17:25.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5f06d2a640 1 -- 172.21.15.78:0/1850567355 shutdown_connections 2023-10-14T09:17:25.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5f06d2a640 1 -- 172.21.15.78:0/1850567355 >> 172.21.15.78:0/1850567355 conn(0x7f5f000c1cc0 msgr2=0x7f5f000c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:25.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5f06d2a640 1 -- 172.21.15.78:0/1850567355 shutdown_connections 2023-10-14T09:17:25.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5f06d2a640 1 -- 172.21.15.78:0/1850567355 wait complete. 2023-10-14T09:17:25.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5f06d2a640 1 Processor -- start 2023-10-14T09:17:25.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.813+0000 7f5f06d2a640 1 -- start start 2023-10-14T09:17:25.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f06d2a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5ee80039b0 0x7f5f000be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:25.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f06d2a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f00145500 0x7f5f001ec6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:25.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f06d2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f001f00c0 0x7f5f001ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:25.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f06d2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f00147fd0 con 0x7f5f001f00c0 2023-10-14T09:17:25.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f06d2a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f001f0660 con 0x7f5f00145500 2023-10-14T09:17:25.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f06d2a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000aa6f0 con 0x7f5ee80039b0 2023-10-14T09:17:25.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f052c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f001f00c0 0x7f5f001ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:25.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f052c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f001f00c0 0x7f5f001ecc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35336/0 (socket says 172.21.15.78:35336) 2023-10-14T09:17:25.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f052c7640 1 -- 172.21.15.78:0/2114742048 learned_addr learned my addr 172.21.15.78:0/2114742048 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:25.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f04ac6640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5ee80039b0 0x7f5f000be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:25.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5efffff640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f00145500 0x7f5f001ec6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:25.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f052c7640 1 -- 172.21.15.78:0/2114742048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5ee80039b0 msgr2=0x7f5f000be7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:25.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f052c7640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5ee80039b0 0x7f5f000be7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f052c7640 1 -- 172.21.15.78:0/2114742048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f00145500 msgr2=0x7f5f001ec6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:25.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f052c7640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f00145500 0x7f5f001ec6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f052c7640 1 -- 172.21.15.78:0/2114742048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000aa9d0 con 0x7f5f001f00c0 2023-10-14T09:17:25.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f04ac6640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5ee80039b0 0x7f5f000be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:25.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5efffff640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f00145500 0x7f5f001ec6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:25.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f052c7640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f001f00c0 0x7f5f001ecc10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5f000c2a60 tx=0x7f5ef800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:25.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5efd7fa640 1 -- 172.21.15.78:0/2114742048 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800e040 con 0x7f5f001f00c0 2023-10-14T09:17:25.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5efd7fa640 1 -- 172.21.15.78:0/2114742048 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef800f040 con 0x7f5f001f00c0 2023-10-14T09:17:25.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f06d2a640 1 -- 172.21.15.78:0/2114742048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f000aacb0 con 0x7f5f001f00c0 2023-10-14T09:17:25.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5efd7fa640 1 -- 172.21.15.78:0/2114742048 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8015430 con 0x7f5f001f00c0 2023-10-14T09:17:25.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f06d2a640 1 -- 172.21.15.78:0/2114742048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f001ec140 con 0x7f5f001f00c0 2023-10-14T09:17:25.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5f06d2a640 1 -- 172.21.15.78:0/2114742048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f001ec3c0 con 0x7f5f001f00c0 2023-10-14T09:17:25.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5efd7fa640 1 -- 172.21.15.78:0/2114742048 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5ef8015590 con 0x7f5f001f00c0 2023-10-14T09:17:25.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.817+0000 7f5efd7fa640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5eec0664a0 0x7f5eec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:25.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.821+0000 7f5efd7fa640 1 -- 172.21.15.78:0/2114742048 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ef8084690 con 0x7f5f001f00c0 2023-10-14T09:17:25.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.821+0000 7f5f04ac6640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5eec0664a0 0x7f5eec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:25.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.821+0000 7f5f04ac6640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5eec0664a0 0x7f5eec068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00ad000 tx=0x7f5ef00046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:25.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.825+0000 7f5efd7fa640 1 -- 172.21.15.78:0/2114742048 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5ef8051a70 con 0x7f5f001f00c0 2023-10-14T09:17:25.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.973+0000 7f5f06d2a640 1 -- 172.21.15.78:0/2114742048 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f00074180 con 0x7f5f001f00c0 2023-10-14T09:17:25.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.973+0000 7f5efd7fa640 1 -- 172.21.15.78:0/2114742048 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16518 (secure 0 0 0) 0x7f5ef8055090 con 0x7f5f001f00c0 2023-10-14T09:17:25.979 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:25.980 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:25.005826+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:25.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 -- 172.21.15.78:0/2114742048 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5eec0664a0 msgr2=0x7f5eec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:25.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5eec0664a0 0x7f5eec068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00ad000 tx=0x7f5ef00046d0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 -- 172.21.15.78:0/2114742048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f001f00c0 msgr2=0x7f5f001ecc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:25.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f001f00c0 0x7f5f001ecc10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5f000c2a60 tx=0x7f5ef800f580 comp rx=0 tx=0).stop 2023-10-14T09:17:25.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 -- 172.21.15.78:0/2114742048 shutdown_connections 2023-10-14T09:17:25.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f001f00c0 0x7f5f001ecc10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f00145500 0x7f5f001ec6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5eec0664a0 0x7f5eec068960 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 --2- 172.21.15.78:0/2114742048 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5ee80039b0 0x7f5f000be7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 -- 172.21.15.78:0/2114742048 >> 172.21.15.78:0/2114742048 conn(0x7f5f000c1cc0 msgr2=0x7f5f000c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 -- 172.21.15.78:0/2114742048 shutdown_connections 2023-10-14T09:17:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:25.977+0000 7f5f06d2a640 1 -- 172.21.15.78:0/2114742048 wait complete. 2023-10-14T09:17:26.001 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:26.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.133+0000 7f8ac2ad6640 1 Processor -- start 2023-10-14T09:17:26.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.133+0000 7f8ac2ad6640 1 -- start start 2023-10-14T09:17:26.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.133+0000 7f8ac2ad6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8abc14ddb0 0x7f8abc0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:26.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.133+0000 7f8ac2ad6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc06c470 con 0x7f8abc0c6910 2023-10-14T09:17:26.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.133+0000 7f8ac2ad6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc06c750 con 0x7f8abc153e80 2023-10-14T09:17:26.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.133+0000 7f8ac2ad6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc0c64f0 con 0x7f8abc14ddb0 2023-10-14T09:17:26.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ac1073640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8abc0c6910 0x7f8abc0c3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:49936/0 (socket says 172.21.15.78:49936) 2023-10-14T09:17:26.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ac1073640 1 -- 172.21.15.78:0/1493264327 learned_addr learned my addr 172.21.15.78:0/1493264327 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:26.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ac0872640 1 --2- 172.21.15.78:0/1493264327 >> v2:172.21.15.157:3300/0 conn(0x7f8abc14ddb0 0x7f8abc0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:26.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ab37fe640 1 -- 172.21.15.78:0/1493264327 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210660265 0 0) 0x7f8abc06c470 con 0x7f8abc0c6910 2023-10-14T09:17:26.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ab37fe640 1 -- 172.21.15.78:0/1493264327 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa4003530 con 0x7f8abc0c6910 2023-10-14T09:17:26.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ac0872640 1 -- 172.21.15.78:0/1493264327 >> v1:172.21.15.157:6789/0 conn(0x7f8abc153e80 legacy=0x7f8abc06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:26.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ac0872640 1 -- 172.21.15.78:0/1493264327 >> v1:172.21.15.78:6789/0 conn(0x7f8abc0c6910 legacy=0x7f8abc0c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:26.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ac0872640 1 -- 172.21.15.78:0/1493264327 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc06ca30 con 0x7f8abc14ddb0 2023-10-14T09:17:26.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ac0872640 1 --2- 172.21.15.78:0/1493264327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8abc14ddb0 0x7f8abc0c7780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80097c0 tx=0x7f8ab801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=184356d5f8e6f666 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:26.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ab37fe640 1 -- 172.21.15.78:0/1493264327 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80ab600 con 0x7f8abc14ddb0 2023-10-14T09:17:26.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ab37fe640 1 -- 172.21.15.78:0/1493264327 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab80a7050 con 0x7f8abc14ddb0 2023-10-14T09:17:26.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.137+0000 7f8ab37fe640 1 -- 172.21.15.78:0/1493264327 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80ab980 con 0x7f8abc14ddb0 2023-10-14T09:17:26.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.141+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/1493264327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8abc14ddb0 msgr2=0x7f8abc0c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:26.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.141+0000 7f8ac2ad6640 1 --2- 172.21.15.78:0/1493264327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8abc14ddb0 0x7f8abc0c7780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80097c0 tx=0x7f8ab801c360 comp rx=0 tx=0).stop 2023-10-14T09:17:26.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.141+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/1493264327 shutdown_connections 2023-10-14T09:17:26.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.141+0000 7f8ac2ad6640 1 --2- 172.21.15.78:0/1493264327 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8abc14ddb0 0x7f8abc0c7780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.141+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/1493264327 >> 172.21.15.78:0/1493264327 conn(0x7f8abc0ab1f0 msgr2=0x7f8abc0ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:26.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.141+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/1493264327 shutdown_connections 2023-10-14T09:17:26.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.141+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/1493264327 wait complete. 2023-10-14T09:17:26.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.141+0000 7f8ac2ad6640 1 Processor -- start 2023-10-14T09:17:26.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.141+0000 7f8ac2ad6640 1 -- start start 2023-10-14T09:17:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac2ad6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc0c6910 0x7f8abc156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac2ad6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8abc14ddb0 0x7f8abc1ec070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac2ad6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8abc153e80 0x7f8abc1ec5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac2ad6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc1f05a0 con 0x7f8abc0c6910 2023-10-14T09:17:26.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac2ad6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c28e0 con 0x7f8abc14ddb0 2023-10-14T09:17:26.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac2ad6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc155be0 con 0x7f8abc153e80 2023-10-14T09:17:26.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac0872640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc0c6910 0x7f8abc156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:26.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac0872640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc0c6910 0x7f8abc156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35338/0 (socket says 172.21.15.78:35338) 2023-10-14T09:17:26.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac0872640 1 -- 172.21.15.78:0/792703295 learned_addr learned my addr 172.21.15.78:0/792703295 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:26.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ab3fff640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8abc14ddb0 0x7f8abc1ec070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac1073640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8abc153e80 0x7f8abc1ec5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac0872640 1 -- 172.21.15.78:0/792703295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8abc153e80 msgr2=0x7f8abc1ec5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac0872640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8abc153e80 0x7f8abc1ec5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac0872640 1 -- 172.21.15.78:0/792703295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8abc14ddb0 msgr2=0x7f8abc1ec070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac0872640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8abc14ddb0 0x7f8abc1ec070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac0872640 1 -- 172.21.15.78:0/792703295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8009420 con 0x7f8abc0c6910 2023-10-14T09:17:26.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac1073640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8abc153e80 0x7f8abc1ec5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:26.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac0872640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc0c6910 0x7f8abc156070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8018f70 tx=0x7f8ab8019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:26.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ab17fa640 1 -- 172.21.15.78:0/792703295 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80abdd0 con 0x7f8abc0c6910 2023-10-14T09:17:26.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ab17fa640 1 -- 172.21.15.78:0/792703295 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab80b4410 con 0x7f8abc0c6910 2023-10-14T09:17:26.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/792703295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc157b80 con 0x7f8abc0c6910 2023-10-14T09:17:26.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ab17fa640 1 -- 172.21.15.78:0/792703295 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80b47c0 con 0x7f8abc0c6910 2023-10-14T09:17:26.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/792703295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc1578a0 con 0x7f8abc0c6910 2023-10-14T09:17:26.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.145+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/792703295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc074180 con 0x7f8abc0c6910 2023-10-14T09:17:26.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.149+0000 7f8ab17fa640 1 -- 172.21.15.78:0/792703295 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8ab80b2040 con 0x7f8abc0c6910 2023-10-14T09:17:26.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.149+0000 7f8ab17fa640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8aa80664a0 0x7f8aa8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:26.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.149+0000 7f8ab17fa640 1 -- 172.21.15.78:0/792703295 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ab811dbc0 con 0x7f8abc0c6910 2023-10-14T09:17:26.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.149+0000 7f8ab3fff640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8aa80664a0 0x7f8aa8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:26.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.149+0000 7f8ab3fff640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8aa80664a0 0x7f8aa8068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0ab140 tx=0x7f8aac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:26.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.153+0000 7f8ab17fa640 1 -- 172.21.15.78:0/792703295 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ab80eb180 con 0x7f8abc0c6910 2023-10-14T09:17:26.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.301+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/792703295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8abc0c4440 con 0x7f8abc0c6910 2023-10-14T09:17:26.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.301+0000 7f8ab17fa640 1 -- 172.21.15.78:0/792703295 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f8ab80ee7a0 con 0x7f8abc0c6910 2023-10-14T09:17:26.308 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:26.308 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:26.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/792703295 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8aa80664a0 msgr2=0x7f8aa8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8aa80664a0 0x7f8aa8068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0ab140 tx=0x7f8aac009040 comp rx=0 tx=0).stop 2023-10-14T09:17:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/792703295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc0c6910 msgr2=0x7f8abc156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc0c6910 0x7f8abc156070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8018f70 tx=0x7f8ab8019100 comp rx=0 tx=0).stop 2023-10-14T09:17:26.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/792703295 shutdown_connections 2023-10-14T09:17:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8aa80664a0 0x7f8aa8068960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8abc153e80 0x7f8abc1ec5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8abc14ddb0 0x7f8abc1ec070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 --2- 172.21.15.78:0/792703295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8abc0c6910 0x7f8abc156070 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/792703295 >> 172.21.15.78:0/792703295 conn(0x7f8abc0ab1f0 msgr2=0x7f8abc0c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:26.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/792703295 shutdown_connections 2023-10-14T09:17:26.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.305+0000 7f8ac2ad6640 1 -- 172.21.15.78:0/792703295 wait complete. 2023-10-14T09:17:26.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T09:17:26.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.461+0000 7f98ee565640 1 Processor -- start 2023-10-14T09:17:26.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.461+0000 7f98ee565640 1 -- start start 2023-10-14T09:17:26.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ee565640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98e80ba160 0x7f98e806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:26.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ee565640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98e806c490 0x7f98e806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:26.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ee565640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e8154770 con 0x7f98e814d750 2023-10-14T09:17:26.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ee565640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e80ba5e0 con 0x7f98e806c490 2023-10-14T09:17:26.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ee565640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80bb990 con 0x7f98e80ba160 2023-10-14T09:17:26.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ecb02640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98e806c490 0x7f98e806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:26.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ecb02640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98e806c490 0x7f98e806c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35340/0 (socket says 172.21.15.78:35340) 2023-10-14T09:17:26.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ecb02640 1 -- 172.21.15.78:0/848726516 learned_addr learned my addr 172.21.15.78:0/848726516 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:26.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98e77fe640 1 --2- 172.21.15.78:0/848726516 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98e80ba160 0x7f98e806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:26.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ecb02640 1 -- 172.21.15.78:0/848726516 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98e80ba160 msgr2=0x7f98e806bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:26.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ecb02640 1 --2- 172.21.15.78:0/848726516 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98e80ba160 0x7f98e806bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ecb02640 1 -- 172.21.15.78:0/848726516 >> v1:172.21.15.157:6789/0 conn(0x7f98e814d750 legacy=0x7f98e8154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:26.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.465+0000 7f98ecb02640 1 -- 172.21.15.78:0/848726516 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80bbc70 con 0x7f98e806c490 2023-10-14T09:17:26.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98ecb02640 1 --2- 172.21.15.78:0/848726516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e806c490 0x7f98e806c950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009e50 tx=0x7f98e001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624233344758db1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:26.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98e6ffd640 1 -- 172.21.15.78:0/848726516 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00a5790 con 0x7f98e806c490 2023-10-14T09:17:26.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98e6ffd640 1 -- 172.21.15.78:0/848726516 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e00a58f0 con 0x7f98e806c490 2023-10-14T09:17:26.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98e6ffd640 1 -- 172.21.15.78:0/848726516 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00a5c80 con 0x7f98e806c490 2023-10-14T09:17:26.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98ee565640 1 -- 172.21.15.78:0/848726516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e806c490 msgr2=0x7f98e806c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:26.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98ee565640 1 --2- 172.21.15.78:0/848726516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e806c490 0x7f98e806c950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009e50 tx=0x7f98e001c950 comp rx=0 tx=0).stop 2023-10-14T09:17:26.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98ee565640 1 -- 172.21.15.78:0/848726516 shutdown_connections 2023-10-14T09:17:26.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98ee565640 1 --2- 172.21.15.78:0/848726516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e806c490 0x7f98e806c950 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98ee565640 1 --2- 172.21.15.78:0/848726516 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98e80ba160 0x7f98e806bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98ee565640 1 -- 172.21.15.78:0/848726516 >> 172.21.15.78:0/848726516 conn(0x7f98e80c1d00 msgr2=0x7f98e80c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:26.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98ee565640 1 -- 172.21.15.78:0/848726516 shutdown_connections 2023-10-14T09:17:26.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98ee565640 1 -- 172.21.15.78:0/848726516 wait complete. 2023-10-14T09:17:26.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98ee565640 1 Processor -- start 2023-10-14T09:17:26.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.469+0000 7f98ee565640 1 -- start start 2023-10-14T09:17:26.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98ee565640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98e806c490 0x7f98e814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:26.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98ee565640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e80ba160 0x7f98e813e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:26.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98ee565640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98e814d750 0x7f98e813e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:26.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98ee565640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8137460 con 0x7f98e80ba160 2023-10-14T09:17:26.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98ee565640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80c3850 con 0x7f98e806c490 2023-10-14T09:17:26.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98ee565640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8150180 con 0x7f98e814d750 2023-10-14T09:17:26.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e80ba160 0x7f98e813e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:26.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e80ba160 0x7f98e813e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35352/0 (socket says 172.21.15.78:35352) 2023-10-14T09:17:26.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e77fe640 1 -- 172.21.15.78:0/1620875211 learned_addr learned my addr 172.21.15.78:0/1620875211 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:26.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98ecb02640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98e814d750 0x7f98e813e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:26.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e7fff640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98e806c490 0x7f98e814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:26.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e77fe640 1 -- 172.21.15.78:0/1620875211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98e814d750 msgr2=0x7f98e813e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:26.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e77fe640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98e814d750 0x7f98e813e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e77fe640 1 -- 172.21.15.78:0/1620875211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98e806c490 msgr2=0x7f98e814cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:26.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e77fe640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98e806c490 0x7f98e814cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:26.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e77fe640 1 -- 172.21.15.78:0/1620875211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0009b30 con 0x7f98e80ba160 2023-10-14T09:17:26.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98ecb02640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98e814d750 0x7f98e813e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:26.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e7fff640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98e806c490 0x7f98e814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:26.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e77fe640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e80ba160 0x7f98e813e0d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00e870 tx=0x7f98dc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:26.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e4ff9640 1 -- 172.21.15.78:0/1620875211 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc009530 con 0x7f98e80ba160 2023-10-14T09:17:26.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e4ff9640 1 -- 172.21.15.78:0/1620875211 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc00c940 con 0x7f98e80ba160 2023-10-14T09:17:26.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98ee565640 1 -- 172.21.15.78:0/1620875211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e80c3200 con 0x7f98e80ba160 2023-10-14T09:17:26.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e4ff9640 1 -- 172.21.15.78:0/1620875211 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00ccd0 con 0x7f98e80ba160 2023-10-14T09:17:26.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98ee565640 1 -- 172.21.15.78:0/1620875211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e80c3ce0 con 0x7f98e80ba160 2023-10-14T09:17:26.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98ee565640 1 -- 172.21.15.78:0/1620875211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e80c3060 con 0x7f98e80ba160 2023-10-14T09:17:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.473+0000 7f98e4ff9640 1 -- 172.21.15.78:0/1620875211 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f98dc013470 con 0x7f98e80ba160 2023-10-14T09:17:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.477+0000 7f98e4ff9640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98d40664a0 0x7f98d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.477+0000 7f98e4ff9640 1 -- 172.21.15.78:0/1620875211 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98dc083fe0 con 0x7f98e80ba160 2023-10-14T09:17:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.477+0000 7f98e7fff640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98d40664a0 0x7f98d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:26.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.477+0000 7f98e7fff640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98d40664a0 0x7f98d4068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98d8000f70 tx=0x7f98d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:26.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.481+0000 7f98e4ff9640 1 -- 172.21.15.78:0/1620875211 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f98e80c3060 con 0x7f98e80ba160 2023-10-14T09:17:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:26.661+0000 7f98ee565640 1 -- 172.21.15.78:0/1620875211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f98e80c3060 con 0x7f98e80ba160 2023-10-14T09:17:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98e4ff9640 1 -- 172.21.15.78:0/1620875211 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f98e80c3060 con 0x7f98e80ba160 2023-10-14T09:17:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 -- 172.21.15.78:0/1620875211 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98d40664a0 msgr2=0x7f98d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98d40664a0 0x7f98d4068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f98d8000f70 tx=0x7f98d8009040 comp rx=0 tx=0).stop 2023-10-14T09:17:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 -- 172.21.15.78:0/1620875211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e80ba160 msgr2=0x7f98e813e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:27.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e80ba160 0x7f98e813e0d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00e870 tx=0x7f98dc00ed30 comp rx=0 tx=0).stop 2023-10-14T09:17:27.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 -- 172.21.15.78:0/1620875211 shutdown_connections 2023-10-14T09:17:27.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98d40664a0 0x7f98d4068960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:27.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98e814d750 0x7f98e813e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:27.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98e80ba160 0x7f98e813e0d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 --2- 172.21.15.78:0/1620875211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98e806c490 0x7f98e814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 -- 172.21.15.78:0/1620875211 >> 172.21.15.78:0/1620875211 conn(0x7f98e80c1d00 msgr2=0x7f98e80c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 -- 172.21.15.78:0/1620875211 shutdown_connections 2023-10-14T09:17:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.665+0000 7f98ee565640 1 -- 172.21.15.78:0/1620875211 wait complete. 2023-10-14T09:17:27.694 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T09:17:27.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T09:17:27.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e3870f640 1 Processor -- start 2023-10-14T09:17:27.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e3870f640 1 -- start start 2023-10-14T09:17:27.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e3870f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9e30139dc0 0x7f9e300718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:27.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e3870f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 0x7f9e30150f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:27.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e3870f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9e301532c0 0x7f9e30153750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:27.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e3870f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e300702c0 con 0x7f9e301532c0 2023-10-14T09:17:27.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e3870f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e30152ea0 con 0x7f9e30139dc0 2023-10-14T09:17:27.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e3870f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30151fd0 con 0x7f9e30150ac0 2023-10-14T09:17:27.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e36cac640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9e301532c0 0x7f9e30153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:27.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e36cac640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9e301532c0 0x7f9e30153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38882/0 (socket says 172.21.15.78:38882) 2023-10-14T09:17:27.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e36cac640 1 -- 172.21.15.78:0/1870620015 learned_addr learned my addr 172.21.15.78:0/1870620015 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:27.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e364ab640 1 --2- 172.21.15.78:0/1870620015 >> v2:172.21.15.157:3300/0 conn(0x7f9e30139dc0 0x7f9e300718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:27.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e35caa640 1 --2- 172.21.15.78:0/1870620015 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 0x7f9e30150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:27.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e36cac640 1 -- 172.21.15.78:0/1870620015 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 msgr2=0x7f9e30150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:27.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e36cac640 1 --2- 172.21.15.78:0/1870620015 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 0x7f9e30150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:27.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e36cac640 1 -- 172.21.15.78:0/1870620015 >> v2:172.21.15.157:3300/0 conn(0x7f9e30139dc0 msgr2=0x7f9e300718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:27.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e36cac640 1 --2- 172.21.15.78:0/1870620015 >> v2:172.21.15.157:3300/0 conn(0x7f9e30139dc0 0x7f9e300718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:27.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e36cac640 1 -- 172.21.15.78:0/1870620015 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e30152220 con 0x7f9e301532c0 2023-10-14T09:17:27.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.833+0000 7f9e35caa640 1 --2- 172.21.15.78:0/1870620015 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 0x7f9e30150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:27.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e36cac640 1 --2- 172.21.15.78:0/1870620015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e301532c0 0x7f9e30153750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e300c1730 tx=0x7f9e2801eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb8069576942fbe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:27.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e354a9640 1 -- 172.21.15.78:0/1870620015 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800b2d0 con 0x7f9e301532c0 2023-10-14T09:17:27.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e354a9640 1 -- 172.21.15.78:0/1870620015 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2800b430 con 0x7f9e301532c0 2023-10-14T09:17:27.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e354a9640 1 -- 172.21.15.78:0/1870620015 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280a7bc0 con 0x7f9e301532c0 2023-10-14T09:17:27.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e3870f640 1 -- 172.21.15.78:0/1870620015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e301532c0 msgr2=0x7f9e30153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:27.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e3870f640 1 --2- 172.21.15.78:0/1870620015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e301532c0 0x7f9e30153750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e300c1730 tx=0x7f9e2801eb10 comp rx=0 tx=0).stop 2023-10-14T09:17:27.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e3870f640 1 -- 172.21.15.78:0/1870620015 shutdown_connections 2023-10-14T09:17:27.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e3870f640 1 --2- 172.21.15.78:0/1870620015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e301532c0 0x7f9e30153750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:27.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e3870f640 1 --2- 172.21.15.78:0/1870620015 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 0x7f9e30150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:27.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e3870f640 1 --2- 172.21.15.78:0/1870620015 >> v2:172.21.15.157:3300/0 conn(0x7f9e30139dc0 0x7f9e300718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:27.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e3870f640 1 -- 172.21.15.78:0/1870620015 >> 172.21.15.78:0/1870620015 conn(0x7f9e300c1d00 msgr2=0x7f9e300c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:27.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e3870f640 1 -- 172.21.15.78:0/1870620015 shutdown_connections 2023-10-14T09:17:27.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.837+0000 7f9e3870f640 1 -- 172.21.15.78:0/1870620015 wait complete. 2023-10-14T09:17:27.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e3870f640 1 Processor -- start 2023-10-14T09:17:27.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e3870f640 1 -- start start 2023-10-14T09:17:27.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e3870f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e30139dc0 0x7f9e3015a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:27.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e3870f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 0x7f9e30136a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:27.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e3870f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e301532c0 0x7f9e30136f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e3870f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30159f50 con 0x7f9e30139dc0 2023-10-14T09:17:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e3870f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300c44c0 con 0x7f9e301532c0 2023-10-14T09:17:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e3870f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300c3c20 con 0x7f9e30150ac0 2023-10-14T09:17:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e364ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e30139dc0 0x7f9e3015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e364ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e30139dc0 0x7f9e3015a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38894/0 (socket says 172.21.15.78:38894) 2023-10-14T09:17:27.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e364ab640 1 -- 172.21.15.78:0/1823891448 learned_addr learned my addr 172.21.15.78:0/1823891448 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:27.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e35caa640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 0x7f9e30136a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:27.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e36cac640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e301532c0 0x7f9e30136f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:27.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e364ab640 1 -- 172.21.15.78:0/1823891448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 msgr2=0x7f9e30136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:27.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e364ab640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 0x7f9e30136a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:27.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e364ab640 1 -- 172.21.15.78:0/1823891448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e301532c0 msgr2=0x7f9e30136f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:27.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e364ab640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e301532c0 0x7f9e30136f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:27.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e364ab640 1 -- 172.21.15.78:0/1823891448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2800bd40 con 0x7f9e30139dc0 2023-10-14T09:17:27.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e35caa640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 0x7f9e30136a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:27.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e364ab640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e30139dc0 0x7f9e3015a920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00d800 tx=0x7f9e2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:27.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e26ffd640 1 -- 172.21.15.78:0/1823891448 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c0096a0 con 0x7f9e30139dc0 2023-10-14T09:17:27.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e26ffd640 1 -- 172.21.15.78:0/1823891448 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c009800 con 0x7f9e30139dc0 2023-10-14T09:17:27.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e26ffd640 1 -- 172.21.15.78:0/1823891448 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c009990 con 0x7f9e30139dc0 2023-10-14T09:17:27.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e3870f640 1 -- 172.21.15.78:0/1823891448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e300c3f00 con 0x7f9e30139dc0 2023-10-14T09:17:27.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.841+0000 7f9e3870f640 1 -- 172.21.15.78:0/1823891448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e30131b80 con 0x7f9e30139dc0 2023-10-14T09:17:27.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.845+0000 7f9e3870f640 1 -- 172.21.15.78:0/1823891448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e301319e0 con 0x7f9e30139dc0 2023-10-14T09:17:27.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.845+0000 7f9e26ffd640 1 -- 172.21.15.78:0/1823891448 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9e2c009af0 con 0x7f9e30139dc0 2023-10-14T09:17:27.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.845+0000 7f9e26ffd640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9e140664a0 0x7f9e14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:27.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.845+0000 7f9e26ffd640 1 -- 172.21.15.78:0/1823891448 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e2c0843d0 con 0x7f9e30139dc0 2023-10-14T09:17:27.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.845+0000 7f9e35caa640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9e140664a0 0x7f9e14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:27.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.845+0000 7f9e35caa640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9e140664a0 0x7f9e14068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e301350f0 tx=0x7f9e20008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:27.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:27.849+0000 7f9e26ffd640 1 -- 172.21.15.78:0/1823891448 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9e301319e0 con 0x7f9e30139dc0 2023-10-14T09:17:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.029+0000 7f9e3870f640 1 -- 172.21.15.78:0/1823891448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9e301319e0 con 0x7f9e30139dc0 2023-10-14T09:17:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.669+0000 7f9e26ffd640 1 -- 172.21.15.78:0/1823891448 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9e301319e0 con 0x7f9e30139dc0 2023-10-14T09:17:28.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 -- 172.21.15.78:0/1823891448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9e140664a0 msgr2=0x7f9e14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9e140664a0 0x7f9e14068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9e301350f0 tx=0x7f9e20008040 comp rx=0 tx=0).stop 2023-10-14T09:17:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 -- 172.21.15.78:0/1823891448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e30139dc0 msgr2=0x7f9e3015a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e30139dc0 0x7f9e3015a920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00d800 tx=0x7f9e2c00dcc0 comp rx=0 tx=0).stop 2023-10-14T09:17:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 -- 172.21.15.78:0/1823891448 shutdown_connections 2023-10-14T09:17:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9e301532c0 0x7f9e30136f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9e140664a0 0x7f9e14068960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9e30150ac0 0x7f9e30136a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 --2- 172.21.15.78:0/1823891448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e30139dc0 0x7f9e3015a920 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 -- 172.21.15.78:0/1823891448 >> 172.21.15.78:0/1823891448 conn(0x7f9e300c1d00 msgr2=0x7f9e300c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 -- 172.21.15.78:0/1823891448 shutdown_connections 2023-10-14T09:17:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.673+0000 7f9e3870f640 1 -- 172.21.15.78:0/1823891448 wait complete. 2023-10-14T09:17:28.698 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-14T09:17:28.699 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:17:28.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.833+0000 7fa747409640 1 Processor -- start 2023-10-14T09:17:28.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.833+0000 7fa747409640 1 -- start start 2023-10-14T09:17:28.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa747409640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa74014d920 0x7fa74006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:28.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa747409640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa7400c3a30 0x7fa740153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:28.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa747409640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7400c45d0 con 0x7fa74006dad0 2023-10-14T09:17:28.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa747409640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7400a4cb0 con 0x7fa74014d920 2023-10-14T09:17:28.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa747409640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7400a4ec0 con 0x7fa7400c3a30 2023-10-14T09:17:28.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa7451a5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa74014d920 0x7fa74006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:28.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa7451a5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa74014d920 0x7fa74006d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38902/0 (socket says 172.21.15.78:38902) 2023-10-14T09:17:28.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa7451a5640 1 -- 172.21.15.78:0/4080179145 learned_addr learned my addr 172.21.15.78:0/4080179145 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:28.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa7451a5640 1 -- 172.21.15.78:0/4080179145 >> v2:172.21.15.157:3300/0 conn(0x7fa7400c3a30 msgr2=0x7fa740153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:28.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa7451a5640 1 --2- 172.21.15.78:0/4080179145 >> v2:172.21.15.157:3300/0 conn(0x7fa7400c3a30 0x7fa740153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:28.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa7451a5640 1 -- 172.21.15.78:0/4080179145 >> v1:172.21.15.157:6789/0 conn(0x7fa74006dad0 legacy=0x7fa7400c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:28.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa7451a5640 1 -- 172.21.15.78:0/4080179145 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7401504c0 con 0x7fa74014d920 2023-10-14T09:17:28.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.837+0000 7fa7451a5640 1 --2- 172.21.15.78:0/4080179145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74014d920 0x7fa74006d590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7400a4df0 tx=0x7fa73c01d7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118db57316d09fe6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:28.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa737fff640 1 -- 172.21.15.78:0/4080179145 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0a6880 con 0x7fa74014d920 2023-10-14T09:17:28.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa737fff640 1 -- 172.21.15.78:0/4080179145 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c0a69e0 con 0x7fa74014d920 2023-10-14T09:17:28.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa737fff640 1 -- 172.21.15.78:0/4080179145 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0a6d70 con 0x7fa74014d920 2023-10-14T09:17:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 -- 172.21.15.78:0/4080179145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74014d920 msgr2=0x7fa74006d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 --2- 172.21.15.78:0/4080179145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74014d920 0x7fa74006d590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7400a4df0 tx=0x7fa73c01d7d0 comp rx=0 tx=0).stop 2023-10-14T09:17:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 -- 172.21.15.78:0/4080179145 shutdown_connections 2023-10-14T09:17:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 --2- 172.21.15.78:0/4080179145 >> v2:172.21.15.157:3300/0 conn(0x7fa7400c3a30 0x7fa740153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 --2- 172.21.15.78:0/4080179145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74014d920 0x7fa74006d590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:28.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 -- 172.21.15.78:0/4080179145 >> 172.21.15.78:0/4080179145 conn(0x7fa7400c25b0 msgr2=0x7fa7400c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:28.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 -- 172.21.15.78:0/4080179145 shutdown_connections 2023-10-14T09:17:28.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 -- 172.21.15.78:0/4080179145 wait complete. 2023-10-14T09:17:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 Processor -- start 2023-10-14T09:17:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 -- start start 2023-10-14T09:17:28.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa74006dad0 0x7fa740149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:28.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7400c3a30 0x7fa7400bbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:28.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa74014d920 0x7fa740151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:28.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7401ed910 con 0x7fa7400c3a30 2023-10-14T09:17:28.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa740146f20 con 0x7fa74014d920 2023-10-14T09:17:28.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa747409640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa740153000 con 0x7fa74006dad0 2023-10-14T09:17:28.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa7449a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7400c3a30 0x7fa7400bbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:28.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa7449a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7400c3a30 0x7fa7400bbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38906/0 (socket says 172.21.15.78:38906) 2023-10-14T09:17:28.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa7449a4640 1 -- 172.21.15.78:0/2356493241 learned_addr learned my addr 172.21.15.78:0/2356493241 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:28.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.841+0000 7fa7451a5640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa74006dad0 0x7fa740149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:28.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa7459a6640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa74014d920 0x7fa740151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:28.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa7449a4640 1 -- 172.21.15.78:0/2356493241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa74006dad0 msgr2=0x7fa740149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:28.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa7449a4640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa74006dad0 0x7fa740149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:28.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa7449a4640 1 -- 172.21.15.78:0/2356493241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa74014d920 msgr2=0x7fa740151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:28.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa7449a4640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa74014d920 0x7fa740151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa7449a4640 1 -- 172.21.15.78:0/2356493241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c00a670 con 0x7fa7400c3a30 2023-10-14T09:17:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa7449a4640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7400c3a30 0x7fa7400bbfe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa73000b4b0 tx=0x7fa73000b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa735ffb640 1 -- 172.21.15.78:0/2356493241 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730010610 con 0x7fa7400c3a30 2023-10-14T09:17:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa735ffb640 1 -- 172.21.15.78:0/2356493241 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa730010770 con 0x7fa7400c3a30 2023-10-14T09:17:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa747409640 1 -- 172.21.15.78:0/2356493241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7401eddd0 con 0x7fa7400c3a30 2023-10-14T09:17:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa735ffb640 1 -- 172.21.15.78:0/2356493241 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730010b20 con 0x7fa7400c3a30 2023-10-14T09:17:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa747409640 1 -- 172.21.15.78:0/2356493241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa740147210 con 0x7fa7400c3a30 2023-10-14T09:17:28.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa747409640 1 -- 172.21.15.78:0/2356493241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa740074180 con 0x7fa7400c3a30 2023-10-14T09:17:28.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.845+0000 7fa735ffb640 1 -- 172.21.15.78:0/2356493241 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa730010c80 con 0x7fa7400c3a30 2023-10-14T09:17:28.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.849+0000 7fa735ffb640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa7240664a0 0x7fa724068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:28.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.849+0000 7fa735ffb640 1 -- 172.21.15.78:0/2356493241 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7300838f0 con 0x7fa7400c3a30 2023-10-14T09:17:28.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.849+0000 7fa7451a5640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa7240664a0 0x7fa724068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:28.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.849+0000 7fa7451a5640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa7240664a0 0x7fa724068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0b0000 tx=0x7fa73c0a8070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:28.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:28.853+0000 7fa735ffb640 1 -- 172.21.15.78:0/2356493241 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa730050eb0 con 0x7fa7400c3a30 2023-10-14T09:17:29.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 -- 172.21.15.78:0/2356493241 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa74015acd0 con 0x7fa7400c3a30 2023-10-14T09:17:29.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa735ffb640 1 -- 172.21.15.78:0/2356493241 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fa730014090 con 0x7fa7400c3a30 2023-10-14T09:17:29.038 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:29.038 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1987032053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1987032053},{"type":"v1","addr":"172.21.15.157:6834","nonce":1987032053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/20028755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":20028755},{"type":"v1","addr":"172.21.15.78:6836","nonce":20028755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3671283338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3671283338},{"type":"v1","addr":"172.21.15.78:6837","nonce":3671283338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:17:25.006130+0000","modified":"2023-10-14T09:17:28.036173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/3774780175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3774780175},{"type":"v1","addr":"172.21.15.157:6835","nonce":3774780175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:17:29.038 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-10-14T09:17:29.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 -- 172.21.15.78:0/2356493241 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa7240664a0 msgr2=0x7fa724068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa7240664a0 0x7fa724068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0b0000 tx=0x7fa73c0a8070 comp rx=0 tx=0).stop 2023-10-14T09:17:29.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 -- 172.21.15.78:0/2356493241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7400c3a30 msgr2=0x7fa7400bbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7400c3a30 0x7fa7400bbfe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa73000b4b0 tx=0x7fa73000b970 comp rx=0 tx=0).stop 2023-10-14T09:17:29.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 -- 172.21.15.78:0/2356493241 shutdown_connections 2023-10-14T09:17:29.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa74014d920 0x7fa740151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7400c3a30 0x7fa7400bbfe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa7240664a0 0x7fa724068960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 --2- 172.21.15.78:0/2356493241 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa74006dad0 0x7fa740149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 -- 172.21.15.78:0/2356493241 >> 172.21.15.78:0/2356493241 conn(0x7fa7400c25b0 msgr2=0x7fa74014f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:29.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 -- 172.21.15.78:0/2356493241 shutdown_connections 2023-10-14T09:17:29.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.033+0000 7fa747409640 1 -- 172.21.15.78:0/2356493241 wait complete. 2023-10-14T09:17:29.058 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:29.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.189+0000 7f2f8c70f640 1 Processor -- start 2023-10-14T09:17:29.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.189+0000 7f2f8c70f640 1 -- start start 2023-10-14T09:17:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.189+0000 7f2f8c70f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f8414e0f0 0x7f2f84152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.189+0000 7f2f8c70f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f8414ed10 0x7f2f8414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.189+0000 7f2f8c70f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f841531d0 con 0x7f2f8414f700 2023-10-14T09:17:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.189+0000 7f2f8c70f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f84153e50 con 0x7f2f8414e0f0 2023-10-14T09:17:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.189+0000 7f2f8c70f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f841534b0 con 0x7f2f8414ed10 2023-10-14T09:17:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.189+0000 7f2f8a4ab640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f8414e0f0 0x7f2f84152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.189+0000 7f2f8acac640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2f8414f700 0x7f2f84150a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33840/0 (socket says 172.21.15.78:33840) 2023-10-14T09:17:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.189+0000 7f2f8acac640 1 -- 172.21.15.78:0/1569674603 learned_addr learned my addr 172.21.15.78:0/1569674603 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.189+0000 7f2f89caa640 1 --2- 172.21.15.78:0/1569674603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f8414ed10 0x7f2f8414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.193+0000 7f2f8a4ab640 1 -- 172.21.15.78:0/1569674603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f8414ed10 msgr2=0x7f2f8414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:29.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.193+0000 7f2f8a4ab640 1 --2- 172.21.15.78:0/1569674603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f8414ed10 0x7f2f8414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.193+0000 7f2f8a4ab640 1 -- 172.21.15.78:0/1569674603 >> v1:172.21.15.78:6789/0 conn(0x7f2f8414f700 legacy=0x7f2f84150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.193+0000 7f2f894a9640 1 -- 172.21.15.78:0/1569674603 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067725536 0 0) 0x7f2f841531d0 con 0x7f2f8414f700 2023-10-14T09:17:29.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.193+0000 7f2f8a4ab640 1 -- 172.21.15.78:0/1569674603 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84153790 con 0x7f2f8414e0f0 2023-10-14T09:17:29.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.193+0000 7f2f8a4ab640 1 --2- 172.21.15.78:0/1569674603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f8414e0f0 0x7f2f84152960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2f800097c0 tx=0x7f2f8001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec504c5f66a97f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.193+0000 7f2f894a9640 1 -- 172.21.15.78:0/1569674603 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800ab600 con 0x7f2f8414e0f0 2023-10-14T09:17:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.193+0000 7f2f894a9640 1 -- 172.21.15.78:0/1569674603 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f800a7050 con 0x7f2f8414e0f0 2023-10-14T09:17:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.193+0000 7f2f894a9640 1 -- 172.21.15.78:0/1569674603 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800ab980 con 0x7f2f8414e0f0 2023-10-14T09:17:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.193+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1569674603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f8414e0f0 msgr2=0x7f2f84152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.193+0000 7f2f8c70f640 1 --2- 172.21.15.78:0/1569674603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f8414e0f0 0x7f2f84152960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2f800097c0 tx=0x7f2f8001c3f0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1569674603 shutdown_connections 2023-10-14T09:17:29.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 --2- 172.21.15.78:0/1569674603 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f8414ed10 0x7f2f8414f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 --2- 172.21.15.78:0/1569674603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f8414e0f0 0x7f2f84152960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1569674603 >> 172.21.15.78:0/1569674603 conn(0x7f2f840c1cc0 msgr2=0x7f2f840c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:29.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1569674603 shutdown_connections 2023-10-14T09:17:29.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1569674603 wait complete. 2023-10-14T09:17:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 Processor -- start 2023-10-14T09:17:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 -- start start 2023-10-14T09:17:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f8414e0f0 0x7f2f840ba850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f8414ed10 0x7f2f8414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f8414f700 0x7f2f841ebff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840bb040 con 0x7f2f8414ed10 2023-10-14T09:17:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f841eff10 con 0x7f2f8414f700 2023-10-14T09:17:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840c4970 con 0x7f2f8414e0f0 2023-10-14T09:17:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f89caa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f8414ed10 0x7f2f8414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f89caa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f8414ed10 0x7f2f8414fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38920/0 (socket says 172.21.15.78:38920) 2023-10-14T09:17:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f89caa640 1 -- 172.21.15.78:0/1733225543 learned_addr learned my addr 172.21.15.78:0/1733225543 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8a4ab640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f8414e0f0 0x7f2f840ba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8acac640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f8414f700 0x7f2f841ebff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f89caa640 1 -- 172.21.15.78:0/1733225543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f8414e0f0 msgr2=0x7f2f840ba850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f89caa640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f8414e0f0 0x7f2f840ba850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f89caa640 1 -- 172.21.15.78:0/1733225543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f8414f700 msgr2=0x7f2f841ebff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f89caa640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f8414f700 0x7f2f841ebff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f89caa640 1 -- 172.21.15.78:0/1733225543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80009420 con 0x7f2f8414ed10 2023-10-14T09:17:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8a4ab640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f8414e0f0 0x7f2f840ba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8acac640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f8414f700 0x7f2f841ebff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f89caa640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f8414ed10 0x7f2f8414fe00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400d5f0 tx=0x7f2f7400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f7affd640 1 -- 172.21.15.78:0/1733225543 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f740125f0 con 0x7f2f8414ed10 2023-10-14T09:17:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f7affd640 1 -- 172.21.15.78:0/1733225543 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f74012750 con 0x7f2f8414ed10 2023-10-14T09:17:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f7affd640 1 -- 172.21.15.78:0/1733225543 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74012ae0 con 0x7f2f8414ed10 2023-10-14T09:17:29.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.197+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1733225543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f840c4c50 con 0x7f2f8414ed10 2023-10-14T09:17:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.201+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1733225543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f84150340 con 0x7f2f8414ed10 2023-10-14T09:17:29.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.201+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1733225543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f84074180 con 0x7f2f8414ed10 2023-10-14T09:17:29.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.201+0000 7f2f7affd640 1 -- 172.21.15.78:0/1733225543 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2f74012c40 con 0x7f2f8414ed10 2023-10-14T09:17:29.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.201+0000 7f2f7affd640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2f680664a0 0x7f2f68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.201+0000 7f2f7affd640 1 -- 172.21.15.78:0/1733225543 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f74084370 con 0x7f2f8414ed10 2023-10-14T09:17:29.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.201+0000 7f2f8a4ab640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2f680664a0 0x7f2f68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.201+0000 7f2f8a4ab640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2f680664a0 0x7f2f68068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2f800ad000 tx=0x7f2f80004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:29.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.205+0000 7f2f7affd640 1 -- 172.21.15.78:0/1733225543 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2f740517e0 con 0x7f2f8414ed10 2023-10-14T09:17:29.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.357+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1733225543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f8414f4e0 con 0x7f2f8414ed10 2023-10-14T09:17:29.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f7affd640 1 -- 172.21.15.78:0/1733225543 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f2f74007380 con 0x7f2f8414ed10 2023-10-14T09:17:29.365 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:29.366 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:29.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1733225543 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2f680664a0 msgr2=0x7f2f68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2f680664a0 0x7f2f68068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2f800ad000 tx=0x7f2f80004740 comp rx=0 tx=0).stop 2023-10-14T09:17:29.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1733225543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f8414ed10 msgr2=0x7f2f8414fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f8414ed10 0x7f2f8414fe00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400d5f0 tx=0x7f2f7400dab0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1733225543 shutdown_connections 2023-10-14T09:17:29.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f8414f700 0x7f2f841ebff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f8414ed10 0x7f2f8414fe00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2f680664a0 0x7f2f68068960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 --2- 172.21.15.78:0/1733225543 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f8414e0f0 0x7f2f840ba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1733225543 >> 172.21.15.78:0/1733225543 conn(0x7f2f840c1cc0 msgr2=0x7f2f840bfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:29.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1733225543 shutdown_connections 2023-10-14T09:17:29.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.361+0000 7f2f8c70f640 1 -- 172.21.15.78:0/1733225543 wait complete. 2023-10-14T09:17:29.386 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T09:17:29.387 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:17:29.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.517+0000 7fd2b6809640 1 Processor -- start 2023-10-14T09:17:29.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.517+0000 7fd2b6809640 1 -- start start 2023-10-14T09:17:29.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b6809640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b0151430 0x7fd2b01547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b6809640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd2b00c4180 0x7fd2b00c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b6809640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b0151810 con 0x7fd2b00c1eb0 2023-10-14T09:17:29.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b6809640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00c27d0 con 0x7fd2b00c4180 2023-10-14T09:17:29.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b6809640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b006f760 con 0x7fd2b0151430 2023-10-14T09:17:29.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b4da6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd2b00c4180 0x7fd2b00c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b4da6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd2b00c4180 0x7fd2b00c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38932/0 (socket says 172.21.15.78:38932) 2023-10-14T09:17:29.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b4da6640 1 -- 172.21.15.78:0/3198529676 learned_addr learned my addr 172.21.15.78:0/3198529676 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:29.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2affff640 1 --2- 172.21.15.78:0/3198529676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b0151430 0x7fd2b01547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b4da6640 1 -- 172.21.15.78:0/3198529676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b0151430 msgr2=0x7fd2b01547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:29.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b4da6640 1 --2- 172.21.15.78:0/3198529676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b0151430 0x7fd2b01547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b4da6640 1 -- 172.21.15.78:0/3198529676 >> v1:172.21.15.157:6789/0 conn(0x7fd2b00c1eb0 legacy=0x7fd2b00c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2b4da6640 1 -- 172.21.15.78:0/3198529676 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b0154d20 con 0x7fd2b00c4180 2023-10-14T09:17:29.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.521+0000 7fd2affff640 1 --2- 172.21.15.78:0/3198529676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b0151430 0x7fd2b01547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:29.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b4da6640 1 --2- 172.21.15.78:0/3198529676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b00c4180 0x7fd2b00c45d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009e50 tx=0x7fd2a801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d818e65c35175a64 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:29.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2aeffd640 1 -- 172.21.15.78:0/3198529676 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80a5780 con 0x7fd2b00c4180 2023-10-14T09:17:29.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2aeffd640 1 -- 172.21.15.78:0/3198529676 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a80a58e0 con 0x7fd2b00c4180 2023-10-14T09:17:29.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2aeffd640 1 -- 172.21.15.78:0/3198529676 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80a5c70 con 0x7fd2b00c4180 2023-10-14T09:17:29.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 -- 172.21.15.78:0/3198529676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b00c4180 msgr2=0x7fd2b00c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 --2- 172.21.15.78:0/3198529676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b00c4180 0x7fd2b00c45d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009e50 tx=0x7fd2a801c8c0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 -- 172.21.15.78:0/3198529676 shutdown_connections 2023-10-14T09:17:29.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 --2- 172.21.15.78:0/3198529676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b00c4180 0x7fd2b00c45d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 --2- 172.21.15.78:0/3198529676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b0151430 0x7fd2b01547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 -- 172.21.15.78:0/3198529676 >> 172.21.15.78:0/3198529676 conn(0x7fd2b006a060 msgr2=0x7fd2b006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:29.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 -- 172.21.15.78:0/3198529676 shutdown_connections 2023-10-14T09:17:29.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 -- 172.21.15.78:0/3198529676 wait complete. 2023-10-14T09:17:29.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 Processor -- start 2023-10-14T09:17:29.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 -- start start 2023-10-14T09:17:29.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b00c1eb0 0x7fd2b00beea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2b00c4180 0x7fd2b01ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b0151430 0x7fd2b01565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b01efe30 con 0x7fd2b0151430 2023-10-14T09:17:29.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00bf3e0 con 0x7fd2b00c4180 2023-10-14T09:17:29.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.525+0000 7fd2b6809640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b014f0a0 con 0x7fd2b00c1eb0 2023-10-14T09:17:29.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2b4da6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b0151430 0x7fd2b01565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2affff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b00c1eb0 0x7fd2b00beea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2affff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b00c1eb0 0x7fd2b00beea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37098/0 (socket says 172.21.15.78:37098) 2023-10-14T09:17:29.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2affff640 1 -- 172.21.15.78:0/2572312228 learned_addr learned my addr 172.21.15.78:0/2572312228 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:29.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2af7fe640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2b00c4180 0x7fd2b01ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2b4da6640 1 -- 172.21.15.78:0/2572312228 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b00c1eb0 msgr2=0x7fd2b00beea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2b4da6640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b00c1eb0 0x7fd2b00beea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2b4da6640 1 -- 172.21.15.78:0/2572312228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2b00c4180 msgr2=0x7fd2b01ef0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2b4da6640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2b00c4180 0x7fd2b01ef0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2b4da6640 1 -- 172.21.15.78:0/2572312228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a8009b30 con 0x7fd2b0151430 2023-10-14T09:17:29.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2b4da6640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b0151430 0x7fd2b01565b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80ab000 tx=0x7fd2a8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:29.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2acff9640 1 -- 172.21.15.78:0/2572312228 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80b8470 con 0x7fd2b0151430 2023-10-14T09:17:29.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2acff9640 1 -- 172.21.15.78:0/2572312228 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a80b85f0 con 0x7fd2b0151430 2023-10-14T09:17:29.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2acff9640 1 -- 172.21.15.78:0/2572312228 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80b89a0 con 0x7fd2b0151430 2023-10-14T09:17:29.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2b6809640 1 -- 172.21.15.78:0/2572312228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b01efb50 con 0x7fd2b0151430 2023-10-14T09:17:29.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2b6809640 1 -- 172.21.15.78:0/2572312228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b014ed30 con 0x7fd2b0151430 2023-10-14T09:17:29.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2b6809640 1 -- 172.21.15.78:0/2572312228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b014e8b0 con 0x7fd2b0151430 2023-10-14T09:17:29.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2acff9640 1 -- 172.21.15.78:0/2572312228 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd2a80b8b00 con 0x7fd2b0151430 2023-10-14T09:17:29.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2acff9640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd29c0664a0 0x7fd29c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.529+0000 7fd2acff9640 1 -- 172.21.15.78:0/2572312228 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2a811efa0 con 0x7fd2b0151430 2023-10-14T09:17:29.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.533+0000 7fd2affff640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd29c0664a0 0x7fd29c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.533+0000 7fd2affff640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd29c0664a0 0x7fd29c068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd2b015e070 tx=0x7fd2a0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:29.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.533+0000 7fd2acff9640 1 -- 172.21.15.78:0/2572312228 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd2b014e8b0 con 0x7fd2b0151430 2023-10-14T09:17:29.612 INFO:tasks.ceph.mds.b.smithi157.stderr:2023-10-14T09:17:29.607+0000 7fb283dc3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T09:17:29.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.681+0000 7fd2b6809640 1 -- 172.21.15.78:0/2572312228 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2b00c3c60 con 0x7fd29c0664a0 2023-10-14T09:17:29.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.693+0000 7fd2acff9640 1 -- 172.21.15.78:0/2572312228 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264744 (secure 0 0 0) 0x7fd2a0010990 con 0x7fd29c0664a0 2023-10-14T09:17:29.697 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-10-14T09:17:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.693+0000 7fd2b6809640 1 -- 172.21.15.78:0/2572312228 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd29c0664a0 msgr2=0x7fd29c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.693+0000 7fd2b6809640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd29c0664a0 0x7fd29c068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd2b015e070 tx=0x7fd2a0008040 comp rx=0 tx=0).stop 2023-10-14T09:17:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.697+0000 7fd2b6809640 1 -- 172.21.15.78:0/2572312228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b0151430 msgr2=0x7fd2b01565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.697+0000 7fd2b6809640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b0151430 0x7fd2b01565b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80ab000 tx=0x7fd2a8019660 comp rx=0 tx=0).stop 2023-10-14T09:17:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.697+0000 7fd2b6809640 1 -- 172.21.15.78:0/2572312228 shutdown_connections 2023-10-14T09:17:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.697+0000 7fd2b6809640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2b0151430 0x7fd2b01565b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.697+0000 7fd2b6809640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd2b00c4180 0x7fd2b01ef0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.697+0000 7fd2b6809640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd29c0664a0 0x7fd29c068960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.697+0000 7fd2b6809640 1 --2- 172.21.15.78:0/2572312228 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd2b00c1eb0 0x7fd2b00beea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.697+0000 7fd2b6809640 1 -- 172.21.15.78:0/2572312228 >> 172.21.15.78:0/2572312228 conn(0x7fd2b006a060 msgr2=0x7fd2b00c5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:29.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.697+0000 7fd2b6809640 1 -- 172.21.15.78:0/2572312228 shutdown_connections 2023-10-14T09:17:29.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.697+0000 7fd2b6809640 1 -- 172.21.15.78:0/2572312228 wait complete. 2023-10-14T09:17:29.720 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-14T09:17:29.226881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217980,"kb_used_data":1792,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756740,"statfs":{"total":773094113280,"available":772870901760,"internally_reserved":0,"allocated":1835008,"data_stored":1752740,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.604638"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147278+0000","last_change":"2023-10-14T09:17:25.079007+0000","last_active":"2023-10-14T09:17:26.147278+0000","last_peered":"2023-10-14T09:17:26.147278+0000","last_clean":"2023-10-14T09:17:26.147278+0000","last_became_active":"2023-10-14T09:17:25.078749+0000","last_became_peered":"2023-10-14T09:17:25.078749+0000","last_unstale":"2023-10-14T09:17:26.147278+0000","last_undegraded":"2023-10-14T09:17:26.147278+0000","last_fullsized":"2023-10-14T09:17:26.147278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057783+0000","last_change":"2023-10-14T09:17:25.065460+0000","last_active":"2023-10-14T09:17:26.057783+0000","last_peered":"2023-10-14T09:17:26.057783+0000","last_clean":"2023-10-14T09:17:26.057783+0000","last_became_active":"2023-10-14T09:17:25.065172+0000","last_became_peered":"2023-10-14T09:17:25.065172+0000","last_unstale":"2023-10-14T09:17:26.057783+0000","last_undegraded":"2023-10-14T09:17:26.057783+0000","last_fullsized":"2023-10-14T09:17:26.057783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148566+0000","last_change":"2023-10-14T09:17:25.070948+0000","last_active":"2023-10-14T09:17:26.148566+0000","last_peered":"2023-10-14T09:17:26.148566+0000","last_clean":"2023-10-14T09:17:26.148566+0000","last_became_active":"2023-10-14T09:17:25.070661+0000","last_became_peered":"2023-10-14T09:17:25.070661+0000","last_unstale":"2023-10-14T09:17:26.148566+0000","last_undegraded":"2023-10-14T09:17:26.148566+0000","last_fullsized":"2023-10-14T09:17:26.148566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:44.354756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057834+0000","last_change":"2023-10-14T09:17:25.072881+0000","last_active":"2023-10-14T09:17:26.057834+0000","last_peered":"2023-10-14T09:17:26.057834+0000","last_clean":"2023-10-14T09:17:26.057834+0000","last_became_active":"2023-10-14T09:17:25.072555+0000","last_became_peered":"2023-10-14T09:17:25.072555+0000","last_unstale":"2023-10-14T09:17:26.057834+0000","last_undegraded":"2023-10-14T09:17:26.057834+0000","last_fullsized":"2023-10-14T09:17:26.057834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147164+0000","last_change":"2023-10-14T09:17:25.083056+0000","last_active":"2023-10-14T09:17:26.147164+0000","last_peered":"2023-10-14T09:17:26.147164+0000","last_clean":"2023-10-14T09:17:26.147164+0000","last_became_active":"2023-10-14T09:17:25.077385+0000","last_became_peered":"2023-10-14T09:17:25.077385+0000","last_unstale":"2023-10-14T09:17:26.147164+0000","last_undegraded":"2023-10-14T09:17:26.147164+0000","last_fullsized":"2023-10-14T09:17:26.147164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057542+0000","last_change":"2023-10-14T09:17:25.063358+0000","last_active":"2023-10-14T09:17:26.057542+0000","last_peered":"2023-10-14T09:17:26.057542+0000","last_clean":"2023-10-14T09:17:26.057542+0000","last_became_active":"2023-10-14T09:17:25.063069+0000","last_became_peered":"2023-10-14T09:17:25.063069+0000","last_unstale":"2023-10-14T09:17:26.057542+0000","last_undegraded":"2023-10-14T09:17:26.057542+0000","last_fullsized":"2023-10-14T09:17:26.057542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:17.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147429+0000","last_change":"2023-10-14T09:17:25.074574+0000","last_active":"2023-10-14T09:17:26.147429+0000","last_peered":"2023-10-14T09:17:26.147429+0000","last_clean":"2023-10-14T09:17:26.147429+0000","last_became_active":"2023-10-14T09:17:25.074288+0000","last_became_peered":"2023-10-14T09:17:25.074288+0000","last_unstale":"2023-10-14T09:17:26.147429+0000","last_undegraded":"2023-10-14T09:17:26.147429+0000","last_fullsized":"2023-10-14T09:17:26.147429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:26.745591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148053+0000","last_change":"2023-10-14T09:17:25.071156+0000","last_active":"2023-10-14T09:17:26.148053+0000","last_peered":"2023-10-14T09:17:26.148053+0000","last_clean":"2023-10-14T09:17:26.148053+0000","last_became_active":"2023-10-14T09:17:25.070907+0000","last_became_peered":"2023-10-14T09:17:25.070907+0000","last_unstale":"2023-10-14T09:17:26.148053+0000","last_undegraded":"2023-10-14T09:17:26.148053+0000","last_fullsized":"2023-10-14T09:17:26.148053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147584+0000","last_change":"2023-10-14T09:17:25.083299+0000","last_active":"2023-10-14T09:17:26.147584+0000","last_peered":"2023-10-14T09:17:26.147584+0000","last_clean":"2023-10-14T09:17:26.147584+0000","last_became_active":"2023-10-14T09:17:25.082917+0000","last_became_peered":"2023-10-14T09:17:25.082917+0000","last_unstale":"2023-10-14T09:17:26.147584+0000","last_undegraded":"2023-10-14T09:17:26.147584+0000","last_fullsized":"2023-10-14T09:17:26.147584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:23.681006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147796+0000","last_change":"2023-10-14T09:17:25.079917+0000","last_active":"2023-10-14T09:17:26.147796+0000","last_peered":"2023-10-14T09:17:26.147796+0000","last_clean":"2023-10-14T09:17:26.147796+0000","last_became_active":"2023-10-14T09:17:25.079320+0000","last_became_peered":"2023-10-14T09:17:25.079320+0000","last_unstale":"2023-10-14T09:17:26.147796+0000","last_undegraded":"2023-10-14T09:17:26.147796+0000","last_fullsized":"2023-10-14T09:17:26.147796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147174+0000","last_change":"2023-10-14T09:17:25.090783+0000","last_active":"2023-10-14T09:17:26.147174+0000","last_peered":"2023-10-14T09:17:26.147174+0000","last_clean":"2023-10-14T09:17:26.147174+0000","last_became_active":"2023-10-14T09:17:25.090462+0000","last_became_peered":"2023-10-14T09:17:25.090462+0000","last_unstale":"2023-10-14T09:17:26.147174+0000","last_undegraded":"2023-10-14T09:17:26.147174+0000","last_fullsized":"2023-10-14T09:17:26.147174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057218+0000","last_change":"2023-10-14T09:17:25.072604+0000","last_active":"2023-10-14T09:17:26.057218+0000","last_peered":"2023-10-14T09:17:26.057218+0000","last_clean":"2023-10-14T09:17:26.057218+0000","last_became_active":"2023-10-14T09:17:25.072215+0000","last_became_peered":"2023-10-14T09:17:25.072215+0000","last_unstale":"2023-10-14T09:17:26.057218+0000","last_undegraded":"2023-10-14T09:17:26.057218+0000","last_fullsized":"2023-10-14T09:17:26.057218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:01.624510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149412+0000","last_change":"2023-10-14T09:17:25.074394+0000","last_active":"2023-10-14T09:17:26.149412+0000","last_peered":"2023-10-14T09:17:26.149412+0000","last_clean":"2023-10-14T09:17:26.149412+0000","last_became_active":"2023-10-14T09:17:25.074139+0000","last_became_peered":"2023-10-14T09:17:25.074139+0000","last_unstale":"2023-10-14T09:17:26.149412+0000","last_undegraded":"2023-10-14T09:17:26.149412+0000","last_fullsized":"2023-10-14T09:17:26.149412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148817+0000","last_change":"2023-10-14T09:17:25.066224+0000","last_active":"2023-10-14T09:17:26.148817+0000","last_peered":"2023-10-14T09:17:26.148817+0000","last_clean":"2023-10-14T09:17:26.148817+0000","last_became_active":"2023-10-14T09:17:25.065977+0000","last_became_peered":"2023-10-14T09:17:25.065977+0000","last_unstale":"2023-10-14T09:17:26.148817+0000","last_undegraded":"2023-10-14T09:17:26.148817+0000","last_fullsized":"2023-10-14T09:17:26.148817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057378+0000","last_change":"2023-10-14T09:17:25.065526+0000","last_active":"2023-10-14T09:17:26.057378+0000","last_peered":"2023-10-14T09:17:26.057378+0000","last_clean":"2023-10-14T09:17:26.057378+0000","last_became_active":"2023-10-14T09:17:25.065045+0000","last_became_peered":"2023-10-14T09:17:25.065045+0000","last_unstale":"2023-10-14T09:17:26.057378+0000","last_undegraded":"2023-10-14T09:17:26.057378+0000","last_fullsized":"2023-10-14T09:17:26.057378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057383+0000","last_change":"2023-10-14T09:17:25.068473+0000","last_active":"2023-10-14T09:17:26.057383+0000","last_peered":"2023-10-14T09:17:26.057383+0000","last_clean":"2023-10-14T09:17:26.057383+0000","last_became_active":"2023-10-14T09:17:25.065827+0000","last_became_peered":"2023-10-14T09:17:25.065827+0000","last_unstale":"2023-10-14T09:17:26.057383+0000","last_undegraded":"2023-10-14T09:17:26.057383+0000","last_fullsized":"2023-10-14T09:17:26.057383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058518+0000","last_change":"2023-10-14T09:17:25.080133+0000","last_active":"2023-10-14T09:17:26.058518+0000","last_peered":"2023-10-14T09:17:26.058518+0000","last_clean":"2023-10-14T09:17:26.058518+0000","last_became_active":"2023-10-14T09:17:25.079868+0000","last_became_peered":"2023-10-14T09:17:25.079868+0000","last_unstale":"2023-10-14T09:17:26.058518+0000","last_undegraded":"2023-10-14T09:17:26.058518+0000","last_fullsized":"2023-10-14T09:17:26.058518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:23.681006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149034+0000","last_change":"2023-10-14T09:17:25.072227+0000","last_active":"2023-10-14T09:17:26.149034+0000","last_peered":"2023-10-14T09:17:26.149034+0000","last_clean":"2023-10-14T09:17:26.149034+0000","last_became_active":"2023-10-14T09:17:25.071942+0000","last_became_peered":"2023-10-14T09:17:25.071942+0000","last_unstale":"2023-10-14T09:17:26.149034+0000","last_undegraded":"2023-10-14T09:17:26.149034+0000","last_fullsized":"2023-10-14T09:17:26.149034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:08.387279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148853+0000","last_change":"2023-10-14T09:17:25.086013+0000","last_active":"2023-10-14T09:17:26.148853+0000","last_peered":"2023-10-14T09:17:26.148853+0000","last_clean":"2023-10-14T09:17:26.148853+0000","last_became_active":"2023-10-14T09:17:25.085027+0000","last_became_peered":"2023-10-14T09:17:25.085027+0000","last_unstale":"2023-10-14T09:17:26.148853+0000","last_undegraded":"2023-10-14T09:17:26.148853+0000","last_fullsized":"2023-10-14T09:17:26.148853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:18.616879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146990+0000","last_change":"2023-10-14T09:17:25.076399+0000","last_active":"2023-10-14T09:17:26.146990+0000","last_peered":"2023-10-14T09:17:26.146990+0000","last_clean":"2023-10-14T09:17:26.146990+0000","last_became_active":"2023-10-14T09:17:25.076035+0000","last_became_peered":"2023-10-14T09:17:25.076035+0000","last_unstale":"2023-10-14T09:17:26.146990+0000","last_undegraded":"2023-10-14T09:17:26.146990+0000","last_fullsized":"2023-10-14T09:17:26.146990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148535+0000","last_change":"2023-10-14T09:17:25.073762+0000","last_active":"2023-10-14T09:17:26.148535+0000","last_peered":"2023-10-14T09:17:26.148535+0000","last_clean":"2023-10-14T09:17:26.148535+0000","last_became_active":"2023-10-14T09:17:25.073517+0000","last_became_peered":"2023-10-14T09:17:25.073517+0000","last_unstale":"2023-10-14T09:17:26.148535+0000","last_undegraded":"2023-10-14T09:17:26.148535+0000","last_fullsized":"2023-10-14T09:17:26.148535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:54.504717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057667+0000","last_change":"2023-10-14T09:17:25.085256+0000","last_active":"2023-10-14T09:17:26.057667+0000","last_peered":"2023-10-14T09:17:26.057667+0000","last_clean":"2023-10-14T09:17:26.057667+0000","last_became_active":"2023-10-14T09:17:25.077345+0000","last_became_peered":"2023-10-14T09:17:25.077345+0000","last_unstale":"2023-10-14T09:17:26.057667+0000","last_undegraded":"2023-10-14T09:17:26.057667+0000","last_fullsized":"2023-10-14T09:17:26.057667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148088+0000","last_change":"2023-10-14T09:17:25.069064+0000","last_active":"2023-10-14T09:17:26.148088+0000","last_peered":"2023-10-14T09:17:26.148088+0000","last_clean":"2023-10-14T09:17:26.148088+0000","last_became_active":"2023-10-14T09:17:25.068801+0000","last_became_peered":"2023-10-14T09:17:25.068801+0000","last_unstale":"2023-10-14T09:17:26.148088+0000","last_undegraded":"2023-10-14T09:17:26.148088+0000","last_fullsized":"2023-10-14T09:17:26.148088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057463+0000","last_change":"2023-10-14T09:17:25.069195+0000","last_active":"2023-10-14T09:17:26.057463+0000","last_peered":"2023-10-14T09:17:26.057463+0000","last_clean":"2023-10-14T09:17:26.057463+0000","last_became_active":"2023-10-14T09:17:25.068765+0000","last_became_peered":"2023-10-14T09:17:25.068765+0000","last_unstale":"2023-10-14T09:17:26.057463+0000","last_undegraded":"2023-10-14T09:17:26.057463+0000","last_fullsized":"2023-10-14T09:17:26.057463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149566+0000","last_change":"2023-10-14T09:17:25.082506+0000","last_active":"2023-10-14T09:17:26.149566+0000","last_peered":"2023-10-14T09:17:26.149566+0000","last_clean":"2023-10-14T09:17:26.149566+0000","last_became_active":"2023-10-14T09:17:25.082192+0000","last_became_peered":"2023-10-14T09:17:25.082192+0000","last_unstale":"2023-10-14T09:17:26.149566+0000","last_undegraded":"2023-10-14T09:17:26.149566+0000","last_fullsized":"2023-10-14T09:17:26.149566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147790+0000","last_change":"2023-10-14T09:17:25.076265+0000","last_active":"2023-10-14T09:17:26.147790+0000","last_peered":"2023-10-14T09:17:26.147790+0000","last_clean":"2023-10-14T09:17:26.147790+0000","last_became_active":"2023-10-14T09:17:25.075674+0000","last_became_peered":"2023-10-14T09:17:25.075674+0000","last_unstale":"2023-10-14T09:17:26.147790+0000","last_undegraded":"2023-10-14T09:17:26.147790+0000","last_fullsized":"2023-10-14T09:17:26.147790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057548+0000","last_change":"2023-10-14T09:17:25.070067+0000","last_active":"2023-10-14T09:17:26.057548+0000","last_peered":"2023-10-14T09:17:26.057548+0000","last_clean":"2023-10-14T09:17:26.057548+0000","last_became_active":"2023-10-14T09:17:25.069770+0000","last_became_peered":"2023-10-14T09:17:25.069770+0000","last_unstale":"2023-10-14T09:17:26.057548+0000","last_undegraded":"2023-10-14T09:17:26.057548+0000","last_fullsized":"2023-10-14T09:17:26.057548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149613+0000","last_change":"2023-10-14T09:17:25.082595+0000","last_active":"2023-10-14T09:17:26.149613+0000","last_peered":"2023-10-14T09:17:26.149613+0000","last_clean":"2023-10-14T09:17:26.149613+0000","last_became_active":"2023-10-14T09:17:25.082221+0000","last_became_peered":"2023-10-14T09:17:25.082221+0000","last_unstale":"2023-10-14T09:17:26.149613+0000","last_undegraded":"2023-10-14T09:17:26.149613+0000","last_fullsized":"2023-10-14T09:17:26.149613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148653+0000","last_change":"2023-10-14T09:17:25.074917+0000","last_active":"2023-10-14T09:17:26.148653+0000","last_peered":"2023-10-14T09:17:26.148653+0000","last_clean":"2023-10-14T09:17:26.148653+0000","last_became_active":"2023-10-14T09:17:25.074673+0000","last_became_peered":"2023-10-14T09:17:25.074673+0000","last_unstale":"2023-10-14T09:17:26.148653+0000","last_undegraded":"2023-10-14T09:17:26.148653+0000","last_fullsized":"2023-10-14T09:17:26.148653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057745+0000","last_change":"2023-10-14T09:17:25.070234+0000","last_active":"2023-10-14T09:17:26.057745+0000","last_peered":"2023-10-14T09:17:26.057745+0000","last_clean":"2023-10-14T09:17:26.057745+0000","last_became_active":"2023-10-14T09:17:25.069862+0000","last_became_peered":"2023-10-14T09:17:25.069862+0000","last_unstale":"2023-10-14T09:17:26.057745+0000","last_undegraded":"2023-10-14T09:17:26.057745+0000","last_fullsized":"2023-10-14T09:17:26.057745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148580+0000","last_change":"2023-10-14T09:17:25.067057+0000","last_active":"2023-10-14T09:17:26.148580+0000","last_peered":"2023-10-14T09:17:26.148580+0000","last_clean":"2023-10-14T09:17:26.148580+0000","last_became_active":"2023-10-14T09:17:25.066506+0000","last_became_peered":"2023-10-14T09:17:25.066506+0000","last_unstale":"2023-10-14T09:17:26.148580+0000","last_undegraded":"2023-10-14T09:17:26.148580+0000","last_fullsized":"2023-10-14T09:17:26.148580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:26.084905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146872+0000","last_change":"2023-10-14T09:17:25.071224+0000","last_active":"2023-10-14T09:17:26.146872+0000","last_peered":"2023-10-14T09:17:26.146872+0000","last_clean":"2023-10-14T09:17:26.146872+0000","last_became_active":"2023-10-14T09:17:25.070538+0000","last_became_peered":"2023-10-14T09:17:25.070538+0000","last_unstale":"2023-10-14T09:17:26.146872+0000","last_undegraded":"2023-10-14T09:17:26.146872+0000","last_fullsized":"2023-10-14T09:17:26.146872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.056842+0000","last_change":"2023-10-14T09:17:25.060731+0000","last_active":"2023-10-14T09:17:26.056842+0000","last_peered":"2023-10-14T09:17:26.056842+0000","last_clean":"2023-10-14T09:17:26.056842+0000","last_became_active":"2023-10-14T09:17:25.060361+0000","last_became_peered":"2023-10-14T09:17:25.060361+0000","last_unstale":"2023-10-14T09:17:26.056842+0000","last_undegraded":"2023-10-14T09:17:26.056842+0000","last_fullsized":"2023-10-14T09:17:26.056842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:58.882094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149507+0000","last_change":"2023-10-14T09:17:24.647223+0000","last_active":"2023-10-14T09:17:26.149507+0000","last_peered":"2023-10-14T09:17:26.149507+0000","last_clean":"2023-10-14T09:17:26.149507+0000","last_became_active":"2023-10-14T09:17:24.646910+0000","last_became_peered":"2023-10-14T09:17:24.646910+0000","last_unstale":"2023-10-14T09:17:26.149507+0000","last_undegraded":"2023-10-14T09:17:26.149507+0000","last_fullsized":"2023-10-14T09:17:26.149507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:43.349047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148773+0000","last_change":"2023-10-14T09:17:25.072654+0000","last_active":"2023-10-14T09:17:26.148773+0000","last_peered":"2023-10-14T09:17:26.148773+0000","last_clean":"2023-10-14T09:17:26.148773+0000","last_became_active":"2023-10-14T09:17:25.072361+0000","last_became_peered":"2023-10-14T09:17:25.072361+0000","last_unstale":"2023-10-14T09:17:26.148773+0000","last_undegraded":"2023-10-14T09:17:26.148773+0000","last_fullsized":"2023-10-14T09:17:26.148773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147198+0000","last_change":"2023-10-14T09:17:24.651708+0000","last_active":"2023-10-14T09:17:26.147198+0000","last_peered":"2023-10-14T09:17:26.147198+0000","last_clean":"2023-10-14T09:17:26.147198+0000","last_became_active":"2023-10-14T09:17:24.651461+0000","last_became_peered":"2023-10-14T09:17:24.651461+0000","last_unstale":"2023-10-14T09:17:26.147198+0000","last_undegraded":"2023-10-14T09:17:26.147198+0000","last_fullsized":"2023-10-14T09:17:26.147198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148228+0000","last_change":"2023-10-14T09:17:24.660053+0000","last_active":"2023-10-14T09:17:26.148228+0000","last_peered":"2023-10-14T09:17:26.148228+0000","last_clean":"2023-10-14T09:17:26.148228+0000","last_became_active":"2023-10-14T09:17:24.659722+0000","last_became_peered":"2023-10-14T09:17:24.659722+0000","last_unstale":"2023-10-14T09:17:26.148228+0000","last_undegraded":"2023-10-14T09:17:26.148228+0000","last_fullsized":"2023-10-14T09:17:26.148228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148174+0000","last_change":"2023-10-14T09:17:25.070599+0000","last_active":"2023-10-14T09:17:26.148174+0000","last_peered":"2023-10-14T09:17:26.148174+0000","last_clean":"2023-10-14T09:17:26.148174+0000","last_became_active":"2023-10-14T09:17:25.070202+0000","last_became_peered":"2023-10-14T09:17:25.070202+0000","last_unstale":"2023-10-14T09:17:26.148174+0000","last_undegraded":"2023-10-14T09:17:26.148174+0000","last_fullsized":"2023-10-14T09:17:26.148174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057470+0000","last_change":"2023-10-14T09:17:24.636532+0000","last_active":"2023-10-14T09:17:26.057470+0000","last_peered":"2023-10-14T09:17:26.057470+0000","last_clean":"2023-10-14T09:17:26.057470+0000","last_became_active":"2023-10-14T09:17:24.636180+0000","last_became_peered":"2023-10-14T09:17:24.636180+0000","last_unstale":"2023-10-14T09:17:26.057470+0000","last_undegraded":"2023-10-14T09:17:26.057470+0000","last_fullsized":"2023-10-14T09:17:26.057470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:25.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057394+0000","last_change":"2023-10-14T09:17:25.069990+0000","last_active":"2023-10-14T09:17:26.057394+0000","last_peered":"2023-10-14T09:17:26.057394+0000","last_clean":"2023-10-14T09:17:26.057394+0000","last_became_active":"2023-10-14T09:17:25.069733+0000","last_became_peered":"2023-10-14T09:17:25.069733+0000","last_unstale":"2023-10-14T09:17:26.057394+0000","last_undegraded":"2023-10-14T09:17:26.057394+0000","last_fullsized":"2023-10-14T09:17:26.057394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147600+0000","last_change":"2023-10-14T09:17:24.658971+0000","last_active":"2023-10-14T09:17:26.147600+0000","last_peered":"2023-10-14T09:17:26.147600+0000","last_clean":"2023-10-14T09:17:26.147600+0000","last_became_active":"2023-10-14T09:17:24.658454+0000","last_became_peered":"2023-10-14T09:17:24.658454+0000","last_unstale":"2023-10-14T09:17:26.147600+0000","last_undegraded":"2023-10-14T09:17:26.147600+0000","last_fullsized":"2023-10-14T09:17:26.147600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058246+0000","last_change":"2023-10-14T09:17:25.073538+0000","last_active":"2023-10-14T09:17:26.058246+0000","last_peered":"2023-10-14T09:17:26.058246+0000","last_clean":"2023-10-14T09:17:26.058246+0000","last_became_active":"2023-10-14T09:17:25.073196+0000","last_became_peered":"2023-10-14T09:17:25.073196+0000","last_unstale":"2023-10-14T09:17:26.058246+0000","last_undegraded":"2023-10-14T09:17:26.058246+0000","last_fullsized":"2023-10-14T09:17:26.058246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:57.142103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058171+0000","last_change":"2023-10-14T09:17:24.656283+0000","last_active":"2023-10-14T09:17:26.058171+0000","last_peered":"2023-10-14T09:17:26.058171+0000","last_clean":"2023-10-14T09:17:26.058171+0000","last_became_active":"2023-10-14T09:17:24.655902+0000","last_became_peered":"2023-10-14T09:17:24.655902+0000","last_unstale":"2023-10-14T09:17:26.058171+0000","last_undegraded":"2023-10-14T09:17:26.058171+0000","last_fullsized":"2023-10-14T09:17:26.058171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:56.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149035+0000","last_change":"2023-10-14T09:17:25.074931+0000","last_active":"2023-10-14T09:17:26.149035+0000","last_peered":"2023-10-14T09:17:26.149035+0000","last_clean":"2023-10-14T09:17:26.149035+0000","last_became_active":"2023-10-14T09:17:25.074606+0000","last_became_peered":"2023-10-14T09:17:25.074606+0000","last_unstale":"2023-10-14T09:17:26.149035+0000","last_undegraded":"2023-10-14T09:17:26.149035+0000","last_fullsized":"2023-10-14T09:17:26.149035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057641+0000","last_change":"2023-10-14T09:17:24.660850+0000","last_active":"2023-10-14T09:17:26.057641+0000","last_peered":"2023-10-14T09:17:26.057641+0000","last_clean":"2023-10-14T09:17:26.057641+0000","last_became_active":"2023-10-14T09:17:24.660566+0000","last_became_peered":"2023-10-14T09:17:24.660566+0000","last_unstale":"2023-10-14T09:17:26.057641+0000","last_undegraded":"2023-10-14T09:17:26.057641+0000","last_fullsized":"2023-10-14T09:17:26.057641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:55.254926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057347+0000","last_change":"2023-10-14T09:17:25.084623+0000","last_active":"2023-10-14T09:17:26.057347+0000","last_peered":"2023-10-14T09:17:26.057347+0000","last_clean":"2023-10-14T09:17:26.057347+0000","last_became_active":"2023-10-14T09:17:25.083870+0000","last_became_peered":"2023-10-14T09:17:25.083870+0000","last_unstale":"2023-10-14T09:17:26.057347+0000","last_undegraded":"2023-10-14T09:17:26.057347+0000","last_fullsized":"2023-10-14T09:17:26.057347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:56.260635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147002+0000","last_change":"2023-10-14T09:17:24.655371+0000","last_active":"2023-10-14T09:17:26.147002+0000","last_peered":"2023-10-14T09:17:26.147002+0000","last_clean":"2023-10-14T09:17:26.147002+0000","last_became_active":"2023-10-14T09:17:24.654821+0000","last_became_peered":"2023-10-14T09:17:24.654821+0000","last_unstale":"2023-10-14T09:17:26.147002+0000","last_undegraded":"2023-10-14T09:17:26.147002+0000","last_fullsized":"2023-10-14T09:17:26.147002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147299+0000","last_change":"2023-10-14T09:17:25.073958+0000","last_active":"2023-10-14T09:17:26.147299+0000","last_peered":"2023-10-14T09:17:26.147299+0000","last_clean":"2023-10-14T09:17:26.147299+0000","last_became_active":"2023-10-14T09:17:25.073630+0000","last_became_peered":"2023-10-14T09:17:25.073630+0000","last_unstale":"2023-10-14T09:17:26.147299+0000","last_undegraded":"2023-10-14T09:17:26.147299+0000","last_fullsized":"2023-10-14T09:17:26.147299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148859+0000","last_change":"2023-10-14T09:17:24.647614+0000","last_active":"2023-10-14T09:17:26.148859+0000","last_peered":"2023-10-14T09:17:26.148859+0000","last_clean":"2023-10-14T09:17:26.148859+0000","last_became_active":"2023-10-14T09:17:24.647181+0000","last_became_peered":"2023-10-14T09:17:24.647181+0000","last_unstale":"2023-10-14T09:17:26.148859+0000","last_undegraded":"2023-10-14T09:17:26.148859+0000","last_fullsized":"2023-10-14T09:17:26.148859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148784+0000","last_change":"2023-10-14T09:17:25.074213+0000","last_active":"2023-10-14T09:17:26.148784+0000","last_peered":"2023-10-14T09:17:26.148784+0000","last_clean":"2023-10-14T09:17:26.148784+0000","last_became_active":"2023-10-14T09:17:25.073939+0000","last_became_peered":"2023-10-14T09:17:25.073939+0000","last_unstale":"2023-10-14T09:17:26.148784+0000","last_undegraded":"2023-10-14T09:17:26.148784+0000","last_fullsized":"2023-10-14T09:17:26.148784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057774+0000","last_change":"2023-10-14T09:17:24.650224+0000","last_active":"2023-10-14T09:17:26.057774+0000","last_peered":"2023-10-14T09:17:26.057774+0000","last_clean":"2023-10-14T09:17:26.057774+0000","last_became_active":"2023-10-14T09:17:24.649874+0000","last_became_peered":"2023-10-14T09:17:24.649874+0000","last_unstale":"2023-10-14T09:17:26.057774+0000","last_undegraded":"2023-10-14T09:17:26.057774+0000","last_fullsized":"2023-10-14T09:17:26.057774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:39.459526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147326+0000","last_change":"2023-10-14T09:17:25.087021+0000","last_active":"2023-10-14T09:17:26.147326+0000","last_peered":"2023-10-14T09:17:26.147326+0000","last_clean":"2023-10-14T09:17:26.147326+0000","last_became_active":"2023-10-14T09:17:25.085886+0000","last_became_peered":"2023-10-14T09:17:25.085886+0000","last_unstale":"2023-10-14T09:17:26.147326+0000","last_undegraded":"2023-10-14T09:17:26.147326+0000","last_fullsized":"2023-10-14T09:17:26.147326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:57.270296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146875+0000","last_change":"2023-10-14T09:17:24.656925+0000","last_active":"2023-10-14T09:17:26.146875+0000","last_peered":"2023-10-14T09:17:26.146875+0000","last_clean":"2023-10-14T09:17:26.146875+0000","last_became_active":"2023-10-14T09:17:24.656662+0000","last_became_peered":"2023-10-14T09:17:24.656662+0000","last_unstale":"2023-10-14T09:17:26.146875+0000","last_undegraded":"2023-10-14T09:17:26.146875+0000","last_fullsized":"2023-10-14T09:17:26.146875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:25.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147060+0000","last_change":"2023-10-14T09:17:25.071484+0000","last_active":"2023-10-14T09:17:26.147060+0000","last_peered":"2023-10-14T09:17:26.147060+0000","last_clean":"2023-10-14T09:17:26.147060+0000","last_became_active":"2023-10-14T09:17:25.070874+0000","last_became_peered":"2023-10-14T09:17:25.070874+0000","last_unstale":"2023-10-14T09:17:26.147060+0000","last_undegraded":"2023-10-14T09:17:26.147060+0000","last_fullsized":"2023-10-14T09:17:26.147060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147921+0000","last_change":"2023-10-14T09:17:24.650705+0000","last_active":"2023-10-14T09:17:26.147921+0000","last_peered":"2023-10-14T09:17:26.147921+0000","last_clean":"2023-10-14T09:17:26.147921+0000","last_became_active":"2023-10-14T09:17:24.650339+0000","last_became_peered":"2023-10-14T09:17:24.650339+0000","last_unstale":"2023-10-14T09:17:26.147921+0000","last_undegraded":"2023-10-14T09:17:26.147921+0000","last_fullsized":"2023-10-14T09:17:26.147921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:01.491312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147488+0000","last_change":"2023-10-14T09:17:25.086229+0000","last_active":"2023-10-14T09:17:26.147488+0000","last_peered":"2023-10-14T09:17:26.147488+0000","last_clean":"2023-10-14T09:17:26.147488+0000","last_became_active":"2023-10-14T09:17:25.085568+0000","last_became_peered":"2023-10-14T09:17:25.085568+0000","last_unstale":"2023-10-14T09:17:26.147488+0000","last_undegraded":"2023-10-14T09:17:26.147488+0000","last_fullsized":"2023-10-14T09:17:26.147488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:08.172052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057268+0000","last_change":"2023-10-14T09:17:24.651869+0000","last_active":"2023-10-14T09:17:26.057268+0000","last_peered":"2023-10-14T09:17:26.057268+0000","last_clean":"2023-10-14T09:17:26.057268+0000","last_became_active":"2023-10-14T09:17:24.651545+0000","last_became_peered":"2023-10-14T09:17:24.651545+0000","last_unstale":"2023-10-14T09:17:26.057268+0000","last_undegraded":"2023-10-14T09:17:26.057268+0000","last_fullsized":"2023-10-14T09:17:26.057268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:01.491312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147728+0000","last_change":"2023-10-14T09:17:25.086054+0000","last_active":"2023-10-14T09:17:26.147728+0000","last_peered":"2023-10-14T09:17:26.147728+0000","last_clean":"2023-10-14T09:17:26.147728+0000","last_became_active":"2023-10-14T09:17:25.085704+0000","last_became_peered":"2023-10-14T09:17:25.085704+0000","last_unstale":"2023-10-14T09:17:26.147728+0000","last_undegraded":"2023-10-14T09:17:26.147728+0000","last_fullsized":"2023-10-14T09:17:26.147728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:13.523277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148998+0000","last_change":"2023-10-14T09:17:24.647549+0000","last_active":"2023-10-14T09:17:26.148998+0000","last_peered":"2023-10-14T09:17:26.148998+0000","last_clean":"2023-10-14T09:17:26.148998+0000","last_became_active":"2023-10-14T09:17:24.645321+0000","last_became_peered":"2023-10-14T09:17:24.645321+0000","last_unstale":"2023-10-14T09:17:26.148998+0000","last_undegraded":"2023-10-14T09:17:26.148998+0000","last_fullsized":"2023-10-14T09:17:26.148998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:55.254926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147428+0000","last_change":"2023-10-14T09:17:25.086522+0000","last_active":"2023-10-14T09:17:26.147428+0000","last_peered":"2023-10-14T09:17:26.147428+0000","last_clean":"2023-10-14T09:17:26.147428+0000","last_became_active":"2023-10-14T09:17:25.086192+0000","last_became_peered":"2023-10-14T09:17:25.086192+0000","last_unstale":"2023-10-14T09:17:26.147428+0000","last_undegraded":"2023-10-14T09:17:26.147428+0000","last_fullsized":"2023-10-14T09:17:26.147428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:57.142103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057720+0000","last_change":"2023-10-14T09:17:24.654486+0000","last_active":"2023-10-14T09:17:26.057720+0000","last_peered":"2023-10-14T09:17:26.057720+0000","last_clean":"2023-10-14T09:17:26.057720+0000","last_became_active":"2023-10-14T09:17:24.652694+0000","last_became_peered":"2023-10-14T09:17:24.652694+0000","last_unstale":"2023-10-14T09:17:26.057720+0000","last_undegraded":"2023-10-14T09:17:26.057720+0000","last_fullsized":"2023-10-14T09:17:26.057720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058138+0000","last_change":"2023-10-14T09:17:25.067993+0000","last_active":"2023-10-14T09:17:26.058138+0000","last_peered":"2023-10-14T09:17:26.058138+0000","last_clean":"2023-10-14T09:17:26.058138+0000","last_became_active":"2023-10-14T09:17:25.067671+0000","last_became_peered":"2023-10-14T09:17:25.067671+0000","last_unstale":"2023-10-14T09:17:26.058138+0000","last_undegraded":"2023-10-14T09:17:26.058138+0000","last_fullsized":"2023-10-14T09:17:26.058138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:26.745591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148710+0000","last_change":"2023-10-14T09:17:24.638946+0000","last_active":"2023-10-14T09:17:26.148710+0000","last_peered":"2023-10-14T09:17:26.148710+0000","last_clean":"2023-10-14T09:17:26.148710+0000","last_became_active":"2023-10-14T09:17:24.638655+0000","last_became_peered":"2023-10-14T09:17:24.638655+0000","last_unstale":"2023-10-14T09:17:26.148710+0000","last_undegraded":"2023-10-14T09:17:26.148710+0000","last_fullsized":"2023-10-14T09:17:26.148710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:00.618802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147399+0000","last_change":"2023-10-14T09:17:25.084705+0000","last_active":"2023-10-14T09:17:26.147399+0000","last_peered":"2023-10-14T09:17:26.147399+0000","last_clean":"2023-10-14T09:17:26.147399+0000","last_became_active":"2023-10-14T09:17:25.084208+0000","last_became_peered":"2023-10-14T09:17:25.084208+0000","last_unstale":"2023-10-14T09:17:26.147399+0000","last_undegraded":"2023-10-14T09:17:26.147399+0000","last_fullsized":"2023-10-14T09:17:26.147399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:52.745681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T09:17:25.064563+0000","last_change":"2023-10-14T09:17:14.304224+0000","last_active":"2023-10-14T09:17:25.064563+0000","last_peered":"2023-10-14T09:17:25.064563+0000","last_clean":"2023-10-14T09:17:25.064563+0000","last_became_active":"2023-10-14T09:17:14.303743+0000","last_became_peered":"2023-10-14T09:17:14.303743+0000","last_unstale":"2023-10-14T09:17:25.064563+0000","last_undegraded":"2023-10-14T09:17:25.064563+0000","last_fullsized":"2023-10-14T09:17:25.064563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_clean_scrub_stamp":"2023-10-14T09:17:13.285641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:24.100243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057432+0000","last_change":"2023-10-14T09:17:24.646906+0000","last_active":"2023-10-14T09:17:26.057432+0000","last_peered":"2023-10-14T09:17:26.057432+0000","last_clean":"2023-10-14T09:17:26.057432+0000","last_became_active":"2023-10-14T09:17:24.646536+0000","last_became_peered":"2023-10-14T09:17:24.646536+0000","last_unstale":"2023-10-14T09:17:26.057432+0000","last_undegraded":"2023-10-14T09:17:26.057432+0000","last_fullsized":"2023-10-14T09:17:26.057432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149345+0000","last_change":"2023-10-14T09:17:25.065358+0000","last_active":"2023-10-14T09:17:26.149345+0000","last_peered":"2023-10-14T09:17:26.149345+0000","last_clean":"2023-10-14T09:17:26.149345+0000","last_became_active":"2023-10-14T09:17:25.065048+0000","last_became_peered":"2023-10-14T09:17:25.065048+0000","last_unstale":"2023-10-14T09:17:26.149345+0000","last_undegraded":"2023-10-14T09:17:26.149345+0000","last_fullsized":"2023-10-14T09:17:26.149345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147353+0000","last_change":"2023-10-14T09:17:24.663937+0000","last_active":"2023-10-14T09:17:26.147353+0000","last_peered":"2023-10-14T09:17:26.147353+0000","last_clean":"2023-10-14T09:17:26.147353+0000","last_became_active":"2023-10-14T09:17:24.663420+0000","last_became_peered":"2023-10-14T09:17:24.663420+0000","last_unstale":"2023-10-14T09:17:26.147353+0000","last_undegraded":"2023-10-14T09:17:26.147353+0000","last_fullsized":"2023-10-14T09:17:26.147353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148230+0000","last_change":"2023-10-14T09:17:25.079632+0000","last_active":"2023-10-14T09:17:26.148230+0000","last_peered":"2023-10-14T09:17:26.148230+0000","last_clean":"2023-10-14T09:17:26.148230+0000","last_became_active":"2023-10-14T09:17:25.079358+0000","last_became_peered":"2023-10-14T09:17:25.079358+0000","last_unstale":"2023-10-14T09:17:26.148230+0000","last_undegraded":"2023-10-14T09:17:26.148230+0000","last_fullsized":"2023-10-14T09:17:26.148230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:03.207187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148663+0000","last_change":"2023-10-14T09:17:24.646437+0000","last_active":"2023-10-14T09:17:26.148663+0000","last_peered":"2023-10-14T09:17:26.148663+0000","last_clean":"2023-10-14T09:17:26.148663+0000","last_became_active":"2023-10-14T09:17:24.645079+0000","last_became_peered":"2023-10-14T09:17:24.645079+0000","last_unstale":"2023-10-14T09:17:26.148663+0000","last_undegraded":"2023-10-14T09:17:26.148663+0000","last_fullsized":"2023-10-14T09:17:26.148663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:57.876385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057579+0000","last_change":"2023-10-14T09:17:25.057184+0000","last_active":"2023-10-14T09:17:26.057579+0000","last_peered":"2023-10-14T09:17:26.057579+0000","last_clean":"2023-10-14T09:17:26.057579+0000","last_became_active":"2023-10-14T09:17:25.056927+0000","last_became_peered":"2023-10-14T09:17:25.056927+0000","last_unstale":"2023-10-14T09:17:26.057579+0000","last_undegraded":"2023-10-14T09:17:26.057579+0000","last_fullsized":"2023-10-14T09:17:26.057579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057868+0000","last_change":"2023-10-14T09:17:24.654452+0000","last_active":"2023-10-14T09:17:26.057868+0000","last_peered":"2023-10-14T09:17:26.057868+0000","last_clean":"2023-10-14T09:17:26.057868+0000","last_became_active":"2023-10-14T09:17:24.654123+0000","last_became_peered":"2023-10-14T09:17:24.654123+0000","last_unstale":"2023-10-14T09:17:26.057868+0000","last_undegraded":"2023-10-14T09:17:26.057868+0000","last_fullsized":"2023-10-14T09:17:26.057868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:06.694051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057462+0000","last_change":"2023-10-14T09:17:25.065503+0000","last_active":"2023-10-14T09:17:26.057462+0000","last_peered":"2023-10-14T09:17:26.057462+0000","last_clean":"2023-10-14T09:17:26.057462+0000","last_became_active":"2023-10-14T09:17:25.065201+0000","last_became_peered":"2023-10-14T09:17:25.065201+0000","last_unstale":"2023-10-14T09:17:26.057462+0000","last_undegraded":"2023-10-14T09:17:26.057462+0000","last_fullsized":"2023-10-14T09:17:26.057462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:08.387279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057636+0000","last_change":"2023-10-14T09:17:24.654216+0000","last_active":"2023-10-14T09:17:26.057636+0000","last_peered":"2023-10-14T09:17:26.057636+0000","last_clean":"2023-10-14T09:17:26.057636+0000","last_became_active":"2023-10-14T09:17:24.653646+0000","last_became_peered":"2023-10-14T09:17:24.653646+0000","last_unstale":"2023-10-14T09:17:26.057636+0000","last_undegraded":"2023-10-14T09:17:26.057636+0000","last_fullsized":"2023-10-14T09:17:26.057636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057990+0000","last_change":"2023-10-14T09:17:25.072986+0000","last_active":"2023-10-14T09:17:26.057990+0000","last_peered":"2023-10-14T09:17:26.057990+0000","last_clean":"2023-10-14T09:17:26.057990+0000","last_became_active":"2023-10-14T09:17:25.072730+0000","last_became_peered":"2023-10-14T09:17:25.072730+0000","last_unstale":"2023-10-14T09:17:26.057990+0000","last_undegraded":"2023-10-14T09:17:26.057990+0000","last_fullsized":"2023-10-14T09:17:26.057990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:57.270296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147812+0000","last_change":"2023-10-14T09:17:24.663546+0000","last_active":"2023-10-14T09:17:26.147812+0000","last_peered":"2023-10-14T09:17:26.147812+0000","last_clean":"2023-10-14T09:17:26.147812+0000","last_became_active":"2023-10-14T09:17:24.663199+0000","last_became_peered":"2023-10-14T09:17:24.663199+0000","last_unstale":"2023-10-14T09:17:26.147812+0000","last_undegraded":"2023-10-14T09:17:26.147812+0000","last_fullsized":"2023-10-14T09:17:26.147812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:48.194426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057548+0000","last_change":"2023-10-14T09:17:25.061842+0000","last_active":"2023-10-14T09:17:26.057548+0000","last_peered":"2023-10-14T09:17:26.057548+0000","last_clean":"2023-10-14T09:17:26.057548+0000","last_became_active":"2023-10-14T09:17:25.061587+0000","last_became_peered":"2023-10-14T09:17:25.061587+0000","last_unstale":"2023-10-14T09:17:26.057548+0000","last_undegraded":"2023-10-14T09:17:26.057548+0000","last_fullsized":"2023-10-14T09:17:26.057548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057747+0000","last_change":"2023-10-14T09:17:24.657107+0000","last_active":"2023-10-14T09:17:26.057747+0000","last_peered":"2023-10-14T09:17:26.057747+0000","last_clean":"2023-10-14T09:17:26.057747+0000","last_became_active":"2023-10-14T09:17:24.656772+0000","last_became_peered":"2023-10-14T09:17:24.656772+0000","last_unstale":"2023-10-14T09:17:26.057747+0000","last_undegraded":"2023-10-14T09:17:26.057747+0000","last_fullsized":"2023-10-14T09:17:26.057747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:33.644028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149658+0000","last_change":"2023-10-14T09:17:25.077360+0000","last_active":"2023-10-14T09:17:26.149658+0000","last_peered":"2023-10-14T09:17:26.149658+0000","last_clean":"2023-10-14T09:17:26.149658+0000","last_became_active":"2023-10-14T09:17:25.076972+0000","last_became_peered":"2023-10-14T09:17:25.076972+0000","last_unstale":"2023-10-14T09:17:26.149658+0000","last_undegraded":"2023-10-14T09:17:26.149658+0000","last_fullsized":"2023-10-14T09:17:26.149658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147675+0000","last_change":"2023-10-14T09:17:24.650946+0000","last_active":"2023-10-14T09:17:26.147675+0000","last_peered":"2023-10-14T09:17:26.147675+0000","last_clean":"2023-10-14T09:17:26.147675+0000","last_became_active":"2023-10-14T09:17:24.650657+0000","last_became_peered":"2023-10-14T09:17:24.650657+0000","last_unstale":"2023-10-14T09:17:26.147675+0000","last_undegraded":"2023-10-14T09:17:26.147675+0000","last_fullsized":"2023-10-14T09:17:26.147675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148670+0000","last_change":"2023-10-14T09:17:25.065959+0000","last_active":"2023-10-14T09:17:26.148670+0000","last_peered":"2023-10-14T09:17:26.148670+0000","last_clean":"2023-10-14T09:17:26.148670+0000","last_became_active":"2023-10-14T09:17:25.065708+0000","last_became_peered":"2023-10-14T09:17:25.065708+0000","last_unstale":"2023-10-14T09:17:26.148670+0000","last_undegraded":"2023-10-14T09:17:26.148670+0000","last_fullsized":"2023-10-14T09:17:26.148670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147118+0000","last_change":"2023-10-14T09:17:24.663717+0000","last_active":"2023-10-14T09:17:26.147118+0000","last_peered":"2023-10-14T09:17:26.147118+0000","last_clean":"2023-10-14T09:17:26.147118+0000","last_became_active":"2023-10-14T09:17:24.663082+0000","last_became_peered":"2023-10-14T09:17:24.663082+0000","last_unstale":"2023-10-14T09:17:26.147118+0000","last_undegraded":"2023-10-14T09:17:26.147118+0000","last_fullsized":"2023-10-14T09:17:26.147118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057370+0000","last_change":"2023-10-14T09:17:25.062652+0000","last_active":"2023-10-14T09:17:26.057370+0000","last_peered":"2023-10-14T09:17:26.057370+0000","last_clean":"2023-10-14T09:17:26.057370+0000","last_became_active":"2023-10-14T09:17:25.062345+0000","last_became_peered":"2023-10-14T09:17:25.062345+0000","last_unstale":"2023-10-14T09:17:26.057370+0000","last_undegraded":"2023-10-14T09:17:26.057370+0000","last_fullsized":"2023-10-14T09:17:26.057370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:26.084905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057462+0000","last_change":"2023-10-14T09:17:24.655398+0000","last_active":"2023-10-14T09:17:26.057462+0000","last_peered":"2023-10-14T09:17:26.057462+0000","last_clean":"2023-10-14T09:17:26.057462+0000","last_became_active":"2023-10-14T09:17:24.654885+0000","last_became_peered":"2023-10-14T09:17:24.654885+0000","last_unstale":"2023-10-14T09:17:26.057462+0000","last_undegraded":"2023-10-14T09:17:26.057462+0000","last_fullsized":"2023-10-14T09:17:26.057462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148294+0000","last_change":"2023-10-14T09:17:25.063668+0000","last_active":"2023-10-14T09:17:26.148294+0000","last_peered":"2023-10-14T09:17:26.148294+0000","last_clean":"2023-10-14T09:17:26.148294+0000","last_became_active":"2023-10-14T09:17:25.063408+0000","last_became_peered":"2023-10-14T09:17:25.063408+0000","last_unstale":"2023-10-14T09:17:26.148294+0000","last_undegraded":"2023-10-14T09:17:26.148294+0000","last_fullsized":"2023-10-14T09:17:26.148294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057694+0000","last_change":"2023-10-14T09:17:24.652502+0000","last_active":"2023-10-14T09:17:26.057694+0000","last_peered":"2023-10-14T09:17:26.057694+0000","last_clean":"2023-10-14T09:17:26.057694+0000","last_became_active":"2023-10-14T09:17:24.652222+0000","last_became_peered":"2023-10-14T09:17:24.652222+0000","last_unstale":"2023-10-14T09:17:26.057694+0000","last_undegraded":"2023-10-14T09:17:26.057694+0000","last_fullsized":"2023-10-14T09:17:26.057694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:57.876385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149500+0000","last_change":"2023-10-14T09:17:25.070505+0000","last_active":"2023-10-14T09:17:26.149500+0000","last_peered":"2023-10-14T09:17:26.149500+0000","last_clean":"2023-10-14T09:17:26.149500+0000","last_became_active":"2023-10-14T09:17:25.070227+0000","last_became_peered":"2023-10-14T09:17:25.070227+0000","last_unstale":"2023-10-14T09:17:26.149500+0000","last_undegraded":"2023-10-14T09:17:26.149500+0000","last_fullsized":"2023-10-14T09:17:26.149500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147529+0000","last_change":"2023-10-14T09:17:24.663767+0000","last_active":"2023-10-14T09:17:26.147529+0000","last_peered":"2023-10-14T09:17:26.147529+0000","last_clean":"2023-10-14T09:17:26.147529+0000","last_became_active":"2023-10-14T09:17:24.663287+0000","last_became_peered":"2023-10-14T09:17:24.663287+0000","last_unstale":"2023-10-14T09:17:26.147529+0000","last_undegraded":"2023-10-14T09:17:26.147529+0000","last_fullsized":"2023-10-14T09:17:26.147529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:52.317766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147098+0000","last_change":"2023-10-14T09:17:25.083037+0000","last_active":"2023-10-14T09:17:26.147098+0000","last_peered":"2023-10-14T09:17:26.147098+0000","last_clean":"2023-10-14T09:17:26.147098+0000","last_became_active":"2023-10-14T09:17:25.082685+0000","last_became_peered":"2023-10-14T09:17:25.082685+0000","last_unstale":"2023-10-14T09:17:26.147098+0000","last_undegraded":"2023-10-14T09:17:26.147098+0000","last_fullsized":"2023-10-14T09:17:26.147098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058036+0000","last_change":"2023-10-14T09:17:25.070513+0000","last_active":"2023-10-14T09:17:26.058036+0000","last_peered":"2023-10-14T09:17:26.058036+0000","last_clean":"2023-10-14T09:17:26.058036+0000","last_became_active":"2023-10-14T09:17:25.070206+0000","last_became_peered":"2023-10-14T09:17:25.070206+0000","last_unstale":"2023-10-14T09:17:26.058036+0000","last_undegraded":"2023-10-14T09:17:26.058036+0000","last_fullsized":"2023-10-14T09:17:26.058036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:52.745681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147258+0000","last_change":"2023-10-14T09:17:24.663588+0000","last_active":"2023-10-14T09:17:26.147258+0000","last_peered":"2023-10-14T09:17:26.147258+0000","last_clean":"2023-10-14T09:17:26.147258+0000","last_became_active":"2023-10-14T09:17:24.663275+0000","last_became_peered":"2023-10-14T09:17:24.663275+0000","last_unstale":"2023-10-14T09:17:26.147258+0000","last_undegraded":"2023-10-14T09:17:26.147258+0000","last_fullsized":"2023-10-14T09:17:26.147258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058308+0000","last_change":"2023-10-14T09:17:25.081621+0000","last_active":"2023-10-14T09:17:26.058308+0000","last_peered":"2023-10-14T09:17:26.058308+0000","last_clean":"2023-10-14T09:17:26.058308+0000","last_became_active":"2023-10-14T09:17:25.081183+0000","last_became_peered":"2023-10-14T09:17:25.081183+0000","last_unstale":"2023-10-14T09:17:26.058308+0000","last_undegraded":"2023-10-14T09:17:26.058308+0000","last_fullsized":"2023-10-14T09:17:26.058308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:08.172052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147404+0000","last_change":"2023-10-14T09:17:24.664054+0000","last_active":"2023-10-14T09:17:26.147404+0000","last_peered":"2023-10-14T09:17:26.147404+0000","last_clean":"2023-10-14T09:17:26.147404+0000","last_became_active":"2023-10-14T09:17:24.663750+0000","last_became_peered":"2023-10-14T09:17:24.663750+0000","last_unstale":"2023-10-14T09:17:26.147404+0000","last_undegraded":"2023-10-14T09:17:26.147404+0000","last_fullsized":"2023-10-14T09:17:26.147404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148919+0000","last_change":"2023-10-14T09:17:25.079820+0000","last_active":"2023-10-14T09:17:26.148919+0000","last_peered":"2023-10-14T09:17:26.148919+0000","last_clean":"2023-10-14T09:17:26.148919+0000","last_became_active":"2023-10-14T09:17:25.079573+0000","last_became_peered":"2023-10-14T09:17:25.079573+0000","last_unstale":"2023-10-14T09:17:26.148919+0000","last_undegraded":"2023-10-14T09:17:26.148919+0000","last_fullsized":"2023-10-14T09:17:26.148919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149601+0000","last_change":"2023-10-14T09:17:24.652635+0000","last_active":"2023-10-14T09:17:26.149601+0000","last_peered":"2023-10-14T09:17:26.149601+0000","last_clean":"2023-10-14T09:17:26.149601+0000","last_became_active":"2023-10-14T09:17:24.652363+0000","last_became_peered":"2023-10-14T09:17:24.652363+0000","last_unstale":"2023-10-14T09:17:26.149601+0000","last_undegraded":"2023-10-14T09:17:26.149601+0000","last_fullsized":"2023-10-14T09:17:26.149601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149517+0000","last_change":"2023-10-14T09:17:25.078752+0000","last_active":"2023-10-14T09:17:26.149517+0000","last_peered":"2023-10-14T09:17:26.149517+0000","last_clean":"2023-10-14T09:17:26.149517+0000","last_became_active":"2023-10-14T09:17:25.078504+0000","last_became_peered":"2023-10-14T09:17:25.078504+0000","last_unstale":"2023-10-14T09:17:26.149517+0000","last_undegraded":"2023-10-14T09:17:26.149517+0000","last_fullsized":"2023-10-14T09:17:26.149517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:17.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149133+0000","last_change":"2023-10-14T09:17:24.651100+0000","last_active":"2023-10-14T09:17:26.149133+0000","last_peered":"2023-10-14T09:17:26.149133+0000","last_clean":"2023-10-14T09:17:26.149133+0000","last_became_active":"2023-10-14T09:17:24.650418+0000","last_became_peered":"2023-10-14T09:17:24.650418+0000","last_unstale":"2023-10-14T09:17:26.149133+0000","last_undegraded":"2023-10-14T09:17:26.149133+0000","last_fullsized":"2023-10-14T09:17:26.149133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":661848,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":661904,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:17:29.729 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:17:29.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.893+0000 7f561fb3e640 1 Processor -- start 2023-10-14T09:17:29.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.893+0000 7f561fb3e640 1 -- start start 2023-10-14T09:17:29.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561fb3e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5618150a90 0x7f5618150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561fb3e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56181531d0 con 0x7f561814e0f0 2023-10-14T09:17:29.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561fb3e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56181534b0 con 0x7f561814ed10 2023-10-14T09:17:29.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561fb3e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5618153e50 con 0x7f5618150a90 2023-10-14T09:17:29.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561d8da640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f561814e0f0 0x7f5618152960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33842/0 (socket says 172.21.15.78:33842) 2023-10-14T09:17:29.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561d8da640 1 -- 172.21.15.78:0/2055570504 learned_addr learned my addr 172.21.15.78:0/2055570504 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:29.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561e0db640 1 --2- 172.21.15.78:0/2055570504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5618150a90 0x7f5618150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561c8d8640 1 -- 172.21.15.78:0/2055570504 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256686720 0 0) 0x7f56181531d0 con 0x7f561814e0f0 2023-10-14T09:17:29.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561c8d8640 1 -- 172.21.15.78:0/2055570504 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5604003530 con 0x7f561814e0f0 2023-10-14T09:17:29.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561c8d8640 1 -- 172.21.15.78:0/2055570504 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868841128 0 0) 0x7f56181534b0 con 0x7f561814ed10 2023-10-14T09:17:29.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561c8d8640 1 -- 172.21.15.78:0/2055570504 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56181531d0 con 0x7f561814ed10 2023-10-14T09:17:29.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561c8d8640 1 -- 172.21.15.78:0/2055570504 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3352913130 0 0) 0x7f5604003530 con 0x7f561814e0f0 2023-10-14T09:17:29.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561e0db640 1 -- 172.21.15.78:0/2055570504 >> v1:172.21.15.157:6789/0 conn(0x7f561814ed10 legacy=0x7f561814f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561e0db640 1 -- 172.21.15.78:0/2055570504 >> v1:172.21.15.78:6789/0 conn(0x7f561814e0f0 legacy=0x7f5618152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.897+0000 7f561e0db640 1 -- 172.21.15.78:0/2055570504 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5618153790 con 0x7f5618150a90 2023-10-14T09:17:29.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561e0db640 1 --2- 172.21.15.78:0/2055570504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5618150a90 0x7f5618150ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5610009dc0 tx=0x7f561001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aedd540dce00369b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:29.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561c8d8640 1 -- 172.21.15.78:0/2055570504 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5614001680 con 0x7f5618150a90 2023-10-14T09:17:29.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561c8d8640 1 -- 172.21.15.78:0/2055570504 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56100a5530 con 0x7f5618150a90 2023-10-14T09:17:29.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561c8d8640 1 -- 172.21.15.78:0/2055570504 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100a58c0 con 0x7f5618150a90 2023-10-14T09:17:29.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561fb3e640 1 -- 172.21.15.78:0/2055570504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5618150a90 msgr2=0x7f5618150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561fb3e640 1 --2- 172.21.15.78:0/2055570504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5618150a90 0x7f5618150ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5610009dc0 tx=0x7f561001c800 comp rx=0 tx=0).stop 2023-10-14T09:17:29.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561fb3e640 1 -- 172.21.15.78:0/2055570504 shutdown_connections 2023-10-14T09:17:29.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561fb3e640 1 --2- 172.21.15.78:0/2055570504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5618150a90 0x7f5618150ea0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561fb3e640 1 -- 172.21.15.78:0/2055570504 >> 172.21.15.78:0/2055570504 conn(0x7f56180c1cc0 msgr2=0x7f56180c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:29.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561fb3e640 1 -- 172.21.15.78:0/2055570504 shutdown_connections 2023-10-14T09:17:29.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561fb3e640 1 -- 172.21.15.78:0/2055570504 wait complete. 2023-10-14T09:17:29.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561fb3e640 1 Processor -- start 2023-10-14T09:17:29.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.901+0000 7f561fb3e640 1 -- start start 2023-10-14T09:17:29.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561fb3e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f561814e0f0 0x7f561815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561fb3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814ed10 0x7f561814cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561fb3e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5618150a90 0x7f56181e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561fb3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5618142b30 con 0x7f561814ed10 2023-10-14T09:17:29.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561fb3e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561806d5c0 con 0x7f561814e0f0 2023-10-14T09:17:29.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561fb3e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561806d8a0 con 0x7f5618150a90 2023-10-14T09:17:29.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561d0d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814ed10 0x7f561814cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561d8da640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f561814e0f0 0x7f561815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561d0d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814ed10 0x7f561814cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38956/0 (socket says 172.21.15.78:38956) 2023-10-14T09:17:29.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561d0d9640 1 -- 172.21.15.78:0/887927829 learned_addr learned my addr 172.21.15.78:0/887927829 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:29.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561e0db640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5618150a90 0x7f56181e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561d0d9640 1 -- 172.21.15.78:0/887927829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5618150a90 msgr2=0x7f56181e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561d0d9640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5618150a90 0x7f56181e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561d0d9640 1 -- 172.21.15.78:0/887927829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f561814e0f0 msgr2=0x7f561815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:29.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561d0d9640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f561814e0f0 0x7f561815b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:29.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561d0d9640 1 -- 172.21.15.78:0/887927829 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5610009a70 con 0x7f561814ed10 2023-10-14T09:17:29.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561d0d9640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814ed10 0x7f561814cd00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f560800c490 tx=0x7f560800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:29.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f560e7fc640 1 -- 172.21.15.78:0/887927829 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56080052d0 con 0x7f561814ed10 2023-10-14T09:17:29.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f560e7fc640 1 -- 172.21.15.78:0/887927829 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5608005430 con 0x7f561814ed10 2023-10-14T09:17:29.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f560e7fc640 1 -- 172.21.15.78:0/887927829 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608012870 con 0x7f561814ed10 2023-10-14T09:17:29.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561fb3e640 1 -- 172.21.15.78:0/887927829 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561814d240 con 0x7f561814ed10 2023-10-14T09:17:29.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561fb3e640 1 -- 172.21.15.78:0/887927829 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56181e8bb0 con 0x7f561814ed10 2023-10-14T09:17:29.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f561fb3e640 1 -- 172.21.15.78:0/887927829 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561806da10 con 0x7f561814ed10 2023-10-14T09:17:29.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.905+0000 7f560e7fc640 1 -- 172.21.15.78:0/887927829 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f56080129d0 con 0x7f561814ed10 2023-10-14T09:17:29.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.909+0000 7f560e7fc640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f55fc0664a0 0x7f55fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:29.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.909+0000 7f560e7fc640 1 -- 172.21.15.78:0/887927829 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5608083830 con 0x7f561814ed10 2023-10-14T09:17:29.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.909+0000 7f561d8da640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f55fc0664a0 0x7f55fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:29.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.909+0000 7f561d8da640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f55fc0664a0 0x7f55fc068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56140011f0 tx=0x7f5614001d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:29.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:29.913+0000 7f560e7fc640 1 -- 172.21.15.78:0/887927829 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5608050df0 con 0x7f561814ed10 2023-10-14T09:17:30.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.061+0000 7f561fb3e640 1 -- 172.21.15.78:0/887927829 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f561806d730 con 0x7f55fc0664a0 2023-10-14T09:17:30.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.065+0000 7f560e7fc640 1 -- 172.21.15.78:0/887927829 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264744 (secure 0 0 0) 0x7f561806d730 con 0x7f55fc0664a0 2023-10-14T09:17:30.074 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-10-14T09:17:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 -- 172.21.15.78:0/887927829 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f55fc0664a0 msgr2=0x7f55fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f55fc0664a0 0x7f55fc068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56140011f0 tx=0x7f5614001d60 comp rx=0 tx=0).stop 2023-10-14T09:17:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 -- 172.21.15.78:0/887927829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814ed10 msgr2=0x7f561814cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814ed10 0x7f561814cd00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f560800c490 tx=0x7f560800c950 comp rx=0 tx=0).stop 2023-10-14T09:17:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 -- 172.21.15.78:0/887927829 shutdown_connections 2023-10-14T09:17:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f55fc0664a0 0x7f55fc068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5618150a90 0x7f56181e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f561814ed10 0x7f561814cd00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 --2- 172.21.15.78:0/887927829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f561814e0f0 0x7f561815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 -- 172.21.15.78:0/887927829 >> 172.21.15.78:0/887927829 conn(0x7f56180c1cc0 msgr2=0x7f5618152070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 -- 172.21.15.78:0/887927829 shutdown_connections 2023-10-14T09:17:30.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.069+0000 7f561fb3e640 1 -- 172.21.15.78:0/887927829 wait complete. 2023-10-14T09:17:30.095 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-14T09:17:29.226881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217980,"kb_used_data":1792,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756740,"statfs":{"total":773094113280,"available":772870901760,"internally_reserved":0,"allocated":1835008,"data_stored":1752740,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.604638"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147278+0000","last_change":"2023-10-14T09:17:25.079007+0000","last_active":"2023-10-14T09:17:26.147278+0000","last_peered":"2023-10-14T09:17:26.147278+0000","last_clean":"2023-10-14T09:17:26.147278+0000","last_became_active":"2023-10-14T09:17:25.078749+0000","last_became_peered":"2023-10-14T09:17:25.078749+0000","last_unstale":"2023-10-14T09:17:26.147278+0000","last_undegraded":"2023-10-14T09:17:26.147278+0000","last_fullsized":"2023-10-14T09:17:26.147278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057783+0000","last_change":"2023-10-14T09:17:25.065460+0000","last_active":"2023-10-14T09:17:26.057783+0000","last_peered":"2023-10-14T09:17:26.057783+0000","last_clean":"2023-10-14T09:17:26.057783+0000","last_became_active":"2023-10-14T09:17:25.065172+0000","last_became_peered":"2023-10-14T09:17:25.065172+0000","last_unstale":"2023-10-14T09:17:26.057783+0000","last_undegraded":"2023-10-14T09:17:26.057783+0000","last_fullsized":"2023-10-14T09:17:26.057783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148566+0000","last_change":"2023-10-14T09:17:25.070948+0000","last_active":"2023-10-14T09:17:26.148566+0000","last_peered":"2023-10-14T09:17:26.148566+0000","last_clean":"2023-10-14T09:17:26.148566+0000","last_became_active":"2023-10-14T09:17:25.070661+0000","last_became_peered":"2023-10-14T09:17:25.070661+0000","last_unstale":"2023-10-14T09:17:26.148566+0000","last_undegraded":"2023-10-14T09:17:26.148566+0000","last_fullsized":"2023-10-14T09:17:26.148566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:44.354756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057834+0000","last_change":"2023-10-14T09:17:25.072881+0000","last_active":"2023-10-14T09:17:26.057834+0000","last_peered":"2023-10-14T09:17:26.057834+0000","last_clean":"2023-10-14T09:17:26.057834+0000","last_became_active":"2023-10-14T09:17:25.072555+0000","last_became_peered":"2023-10-14T09:17:25.072555+0000","last_unstale":"2023-10-14T09:17:26.057834+0000","last_undegraded":"2023-10-14T09:17:26.057834+0000","last_fullsized":"2023-10-14T09:17:26.057834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147164+0000","last_change":"2023-10-14T09:17:25.083056+0000","last_active":"2023-10-14T09:17:26.147164+0000","last_peered":"2023-10-14T09:17:26.147164+0000","last_clean":"2023-10-14T09:17:26.147164+0000","last_became_active":"2023-10-14T09:17:25.077385+0000","last_became_peered":"2023-10-14T09:17:25.077385+0000","last_unstale":"2023-10-14T09:17:26.147164+0000","last_undegraded":"2023-10-14T09:17:26.147164+0000","last_fullsized":"2023-10-14T09:17:26.147164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057542+0000","last_change":"2023-10-14T09:17:25.063358+0000","last_active":"2023-10-14T09:17:26.057542+0000","last_peered":"2023-10-14T09:17:26.057542+0000","last_clean":"2023-10-14T09:17:26.057542+0000","last_became_active":"2023-10-14T09:17:25.063069+0000","last_became_peered":"2023-10-14T09:17:25.063069+0000","last_unstale":"2023-10-14T09:17:26.057542+0000","last_undegraded":"2023-10-14T09:17:26.057542+0000","last_fullsized":"2023-10-14T09:17:26.057542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:17.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147429+0000","last_change":"2023-10-14T09:17:25.074574+0000","last_active":"2023-10-14T09:17:26.147429+0000","last_peered":"2023-10-14T09:17:26.147429+0000","last_clean":"2023-10-14T09:17:26.147429+0000","last_became_active":"2023-10-14T09:17:25.074288+0000","last_became_peered":"2023-10-14T09:17:25.074288+0000","last_unstale":"2023-10-14T09:17:26.147429+0000","last_undegraded":"2023-10-14T09:17:26.147429+0000","last_fullsized":"2023-10-14T09:17:26.147429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:26.745591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148053+0000","last_change":"2023-10-14T09:17:25.071156+0000","last_active":"2023-10-14T09:17:26.148053+0000","last_peered":"2023-10-14T09:17:26.148053+0000","last_clean":"2023-10-14T09:17:26.148053+0000","last_became_active":"2023-10-14T09:17:25.070907+0000","last_became_peered":"2023-10-14T09:17:25.070907+0000","last_unstale":"2023-10-14T09:17:26.148053+0000","last_undegraded":"2023-10-14T09:17:26.148053+0000","last_fullsized":"2023-10-14T09:17:26.148053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147584+0000","last_change":"2023-10-14T09:17:25.083299+0000","last_active":"2023-10-14T09:17:26.147584+0000","last_peered":"2023-10-14T09:17:26.147584+0000","last_clean":"2023-10-14T09:17:26.147584+0000","last_became_active":"2023-10-14T09:17:25.082917+0000","last_became_peered":"2023-10-14T09:17:25.082917+0000","last_unstale":"2023-10-14T09:17:26.147584+0000","last_undegraded":"2023-10-14T09:17:26.147584+0000","last_fullsized":"2023-10-14T09:17:26.147584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:23.681006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147796+0000","last_change":"2023-10-14T09:17:25.079917+0000","last_active":"2023-10-14T09:17:26.147796+0000","last_peered":"2023-10-14T09:17:26.147796+0000","last_clean":"2023-10-14T09:17:26.147796+0000","last_became_active":"2023-10-14T09:17:25.079320+0000","last_became_peered":"2023-10-14T09:17:25.079320+0000","last_unstale":"2023-10-14T09:17:26.147796+0000","last_undegraded":"2023-10-14T09:17:26.147796+0000","last_fullsized":"2023-10-14T09:17:26.147796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147174+0000","last_change":"2023-10-14T09:17:25.090783+0000","last_active":"2023-10-14T09:17:26.147174+0000","last_peered":"2023-10-14T09:17:26.147174+0000","last_clean":"2023-10-14T09:17:26.147174+0000","last_became_active":"2023-10-14T09:17:25.090462+0000","last_became_peered":"2023-10-14T09:17:25.090462+0000","last_unstale":"2023-10-14T09:17:26.147174+0000","last_undegraded":"2023-10-14T09:17:26.147174+0000","last_fullsized":"2023-10-14T09:17:26.147174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057218+0000","last_change":"2023-10-14T09:17:25.072604+0000","last_active":"2023-10-14T09:17:26.057218+0000","last_peered":"2023-10-14T09:17:26.057218+0000","last_clean":"2023-10-14T09:17:26.057218+0000","last_became_active":"2023-10-14T09:17:25.072215+0000","last_became_peered":"2023-10-14T09:17:25.072215+0000","last_unstale":"2023-10-14T09:17:26.057218+0000","last_undegraded":"2023-10-14T09:17:26.057218+0000","last_fullsized":"2023-10-14T09:17:26.057218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:01.624510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149412+0000","last_change":"2023-10-14T09:17:25.074394+0000","last_active":"2023-10-14T09:17:26.149412+0000","last_peered":"2023-10-14T09:17:26.149412+0000","last_clean":"2023-10-14T09:17:26.149412+0000","last_became_active":"2023-10-14T09:17:25.074139+0000","last_became_peered":"2023-10-14T09:17:25.074139+0000","last_unstale":"2023-10-14T09:17:26.149412+0000","last_undegraded":"2023-10-14T09:17:26.149412+0000","last_fullsized":"2023-10-14T09:17:26.149412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148817+0000","last_change":"2023-10-14T09:17:25.066224+0000","last_active":"2023-10-14T09:17:26.148817+0000","last_peered":"2023-10-14T09:17:26.148817+0000","last_clean":"2023-10-14T09:17:26.148817+0000","last_became_active":"2023-10-14T09:17:25.065977+0000","last_became_peered":"2023-10-14T09:17:25.065977+0000","last_unstale":"2023-10-14T09:17:26.148817+0000","last_undegraded":"2023-10-14T09:17:26.148817+0000","last_fullsized":"2023-10-14T09:17:26.148817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057378+0000","last_change":"2023-10-14T09:17:25.065526+0000","last_active":"2023-10-14T09:17:26.057378+0000","last_peered":"2023-10-14T09:17:26.057378+0000","last_clean":"2023-10-14T09:17:26.057378+0000","last_became_active":"2023-10-14T09:17:25.065045+0000","last_became_peered":"2023-10-14T09:17:25.065045+0000","last_unstale":"2023-10-14T09:17:26.057378+0000","last_undegraded":"2023-10-14T09:17:26.057378+0000","last_fullsized":"2023-10-14T09:17:26.057378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057383+0000","last_change":"2023-10-14T09:17:25.068473+0000","last_active":"2023-10-14T09:17:26.057383+0000","last_peered":"2023-10-14T09:17:26.057383+0000","last_clean":"2023-10-14T09:17:26.057383+0000","last_became_active":"2023-10-14T09:17:25.065827+0000","last_became_peered":"2023-10-14T09:17:25.065827+0000","last_unstale":"2023-10-14T09:17:26.057383+0000","last_undegraded":"2023-10-14T09:17:26.057383+0000","last_fullsized":"2023-10-14T09:17:26.057383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058518+0000","last_change":"2023-10-14T09:17:25.080133+0000","last_active":"2023-10-14T09:17:26.058518+0000","last_peered":"2023-10-14T09:17:26.058518+0000","last_clean":"2023-10-14T09:17:26.058518+0000","last_became_active":"2023-10-14T09:17:25.079868+0000","last_became_peered":"2023-10-14T09:17:25.079868+0000","last_unstale":"2023-10-14T09:17:26.058518+0000","last_undegraded":"2023-10-14T09:17:26.058518+0000","last_fullsized":"2023-10-14T09:17:26.058518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:23.681006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149034+0000","last_change":"2023-10-14T09:17:25.072227+0000","last_active":"2023-10-14T09:17:26.149034+0000","last_peered":"2023-10-14T09:17:26.149034+0000","last_clean":"2023-10-14T09:17:26.149034+0000","last_became_active":"2023-10-14T09:17:25.071942+0000","last_became_peered":"2023-10-14T09:17:25.071942+0000","last_unstale":"2023-10-14T09:17:26.149034+0000","last_undegraded":"2023-10-14T09:17:26.149034+0000","last_fullsized":"2023-10-14T09:17:26.149034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:08.387279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148853+0000","last_change":"2023-10-14T09:17:25.086013+0000","last_active":"2023-10-14T09:17:26.148853+0000","last_peered":"2023-10-14T09:17:26.148853+0000","last_clean":"2023-10-14T09:17:26.148853+0000","last_became_active":"2023-10-14T09:17:25.085027+0000","last_became_peered":"2023-10-14T09:17:25.085027+0000","last_unstale":"2023-10-14T09:17:26.148853+0000","last_undegraded":"2023-10-14T09:17:26.148853+0000","last_fullsized":"2023-10-14T09:17:26.148853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:18.616879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146990+0000","last_change":"2023-10-14T09:17:25.076399+0000","last_active":"2023-10-14T09:17:26.146990+0000","last_peered":"2023-10-14T09:17:26.146990+0000","last_clean":"2023-10-14T09:17:26.146990+0000","last_became_active":"2023-10-14T09:17:25.076035+0000","last_became_peered":"2023-10-14T09:17:25.076035+0000","last_unstale":"2023-10-14T09:17:26.146990+0000","last_undegraded":"2023-10-14T09:17:26.146990+0000","last_fullsized":"2023-10-14T09:17:26.146990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148535+0000","last_change":"2023-10-14T09:17:25.073762+0000","last_active":"2023-10-14T09:17:26.148535+0000","last_peered":"2023-10-14T09:17:26.148535+0000","last_clean":"2023-10-14T09:17:26.148535+0000","last_became_active":"2023-10-14T09:17:25.073517+0000","last_became_peered":"2023-10-14T09:17:25.073517+0000","last_unstale":"2023-10-14T09:17:26.148535+0000","last_undegraded":"2023-10-14T09:17:26.148535+0000","last_fullsized":"2023-10-14T09:17:26.148535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:54.504717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057667+0000","last_change":"2023-10-14T09:17:25.085256+0000","last_active":"2023-10-14T09:17:26.057667+0000","last_peered":"2023-10-14T09:17:26.057667+0000","last_clean":"2023-10-14T09:17:26.057667+0000","last_became_active":"2023-10-14T09:17:25.077345+0000","last_became_peered":"2023-10-14T09:17:25.077345+0000","last_unstale":"2023-10-14T09:17:26.057667+0000","last_undegraded":"2023-10-14T09:17:26.057667+0000","last_fullsized":"2023-10-14T09:17:26.057667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148088+0000","last_change":"2023-10-14T09:17:25.069064+0000","last_active":"2023-10-14T09:17:26.148088+0000","last_peered":"2023-10-14T09:17:26.148088+0000","last_clean":"2023-10-14T09:17:26.148088+0000","last_became_active":"2023-10-14T09:17:25.068801+0000","last_became_peered":"2023-10-14T09:17:25.068801+0000","last_unstale":"2023-10-14T09:17:26.148088+0000","last_undegraded":"2023-10-14T09:17:26.148088+0000","last_fullsized":"2023-10-14T09:17:26.148088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057463+0000","last_change":"2023-10-14T09:17:25.069195+0000","last_active":"2023-10-14T09:17:26.057463+0000","last_peered":"2023-10-14T09:17:26.057463+0000","last_clean":"2023-10-14T09:17:26.057463+0000","last_became_active":"2023-10-14T09:17:25.068765+0000","last_became_peered":"2023-10-14T09:17:25.068765+0000","last_unstale":"2023-10-14T09:17:26.057463+0000","last_undegraded":"2023-10-14T09:17:26.057463+0000","last_fullsized":"2023-10-14T09:17:26.057463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149566+0000","last_change":"2023-10-14T09:17:25.082506+0000","last_active":"2023-10-14T09:17:26.149566+0000","last_peered":"2023-10-14T09:17:26.149566+0000","last_clean":"2023-10-14T09:17:26.149566+0000","last_became_active":"2023-10-14T09:17:25.082192+0000","last_became_peered":"2023-10-14T09:17:25.082192+0000","last_unstale":"2023-10-14T09:17:26.149566+0000","last_undegraded":"2023-10-14T09:17:26.149566+0000","last_fullsized":"2023-10-14T09:17:26.149566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147790+0000","last_change":"2023-10-14T09:17:25.076265+0000","last_active":"2023-10-14T09:17:26.147790+0000","last_peered":"2023-10-14T09:17:26.147790+0000","last_clean":"2023-10-14T09:17:26.147790+0000","last_became_active":"2023-10-14T09:17:25.075674+0000","last_became_peered":"2023-10-14T09:17:25.075674+0000","last_unstale":"2023-10-14T09:17:26.147790+0000","last_undegraded":"2023-10-14T09:17:26.147790+0000","last_fullsized":"2023-10-14T09:17:26.147790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057548+0000","last_change":"2023-10-14T09:17:25.070067+0000","last_active":"2023-10-14T09:17:26.057548+0000","last_peered":"2023-10-14T09:17:26.057548+0000","last_clean":"2023-10-14T09:17:26.057548+0000","last_became_active":"2023-10-14T09:17:25.069770+0000","last_became_peered":"2023-10-14T09:17:25.069770+0000","last_unstale":"2023-10-14T09:17:26.057548+0000","last_undegraded":"2023-10-14T09:17:26.057548+0000","last_fullsized":"2023-10-14T09:17:26.057548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149613+0000","last_change":"2023-10-14T09:17:25.082595+0000","last_active":"2023-10-14T09:17:26.149613+0000","last_peered":"2023-10-14T09:17:26.149613+0000","last_clean":"2023-10-14T09:17:26.149613+0000","last_became_active":"2023-10-14T09:17:25.082221+0000","last_became_peered":"2023-10-14T09:17:25.082221+0000","last_unstale":"2023-10-14T09:17:26.149613+0000","last_undegraded":"2023-10-14T09:17:26.149613+0000","last_fullsized":"2023-10-14T09:17:26.149613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148653+0000","last_change":"2023-10-14T09:17:25.074917+0000","last_active":"2023-10-14T09:17:26.148653+0000","last_peered":"2023-10-14T09:17:26.148653+0000","last_clean":"2023-10-14T09:17:26.148653+0000","last_became_active":"2023-10-14T09:17:25.074673+0000","last_became_peered":"2023-10-14T09:17:25.074673+0000","last_unstale":"2023-10-14T09:17:26.148653+0000","last_undegraded":"2023-10-14T09:17:26.148653+0000","last_fullsized":"2023-10-14T09:17:26.148653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057745+0000","last_change":"2023-10-14T09:17:25.070234+0000","last_active":"2023-10-14T09:17:26.057745+0000","last_peered":"2023-10-14T09:17:26.057745+0000","last_clean":"2023-10-14T09:17:26.057745+0000","last_became_active":"2023-10-14T09:17:25.069862+0000","last_became_peered":"2023-10-14T09:17:25.069862+0000","last_unstale":"2023-10-14T09:17:26.057745+0000","last_undegraded":"2023-10-14T09:17:26.057745+0000","last_fullsized":"2023-10-14T09:17:26.057745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148580+0000","last_change":"2023-10-14T09:17:25.067057+0000","last_active":"2023-10-14T09:17:26.148580+0000","last_peered":"2023-10-14T09:17:26.148580+0000","last_clean":"2023-10-14T09:17:26.148580+0000","last_became_active":"2023-10-14T09:17:25.066506+0000","last_became_peered":"2023-10-14T09:17:25.066506+0000","last_unstale":"2023-10-14T09:17:26.148580+0000","last_undegraded":"2023-10-14T09:17:26.148580+0000","last_fullsized":"2023-10-14T09:17:26.148580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:26.084905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146872+0000","last_change":"2023-10-14T09:17:25.071224+0000","last_active":"2023-10-14T09:17:26.146872+0000","last_peered":"2023-10-14T09:17:26.146872+0000","last_clean":"2023-10-14T09:17:26.146872+0000","last_became_active":"2023-10-14T09:17:25.070538+0000","last_became_peered":"2023-10-14T09:17:25.070538+0000","last_unstale":"2023-10-14T09:17:26.146872+0000","last_undegraded":"2023-10-14T09:17:26.146872+0000","last_fullsized":"2023-10-14T09:17:26.146872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.056842+0000","last_change":"2023-10-14T09:17:25.060731+0000","last_active":"2023-10-14T09:17:26.056842+0000","last_peered":"2023-10-14T09:17:26.056842+0000","last_clean":"2023-10-14T09:17:26.056842+0000","last_became_active":"2023-10-14T09:17:25.060361+0000","last_became_peered":"2023-10-14T09:17:25.060361+0000","last_unstale":"2023-10-14T09:17:26.056842+0000","last_undegraded":"2023-10-14T09:17:26.056842+0000","last_fullsized":"2023-10-14T09:17:26.056842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:58.882094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149507+0000","last_change":"2023-10-14T09:17:24.647223+0000","last_active":"2023-10-14T09:17:26.149507+0000","last_peered":"2023-10-14T09:17:26.149507+0000","last_clean":"2023-10-14T09:17:26.149507+0000","last_became_active":"2023-10-14T09:17:24.646910+0000","last_became_peered":"2023-10-14T09:17:24.646910+0000","last_unstale":"2023-10-14T09:17:26.149507+0000","last_undegraded":"2023-10-14T09:17:26.149507+0000","last_fullsized":"2023-10-14T09:17:26.149507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:43.349047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148773+0000","last_change":"2023-10-14T09:17:25.072654+0000","last_active":"2023-10-14T09:17:26.148773+0000","last_peered":"2023-10-14T09:17:26.148773+0000","last_clean":"2023-10-14T09:17:26.148773+0000","last_became_active":"2023-10-14T09:17:25.072361+0000","last_became_peered":"2023-10-14T09:17:25.072361+0000","last_unstale":"2023-10-14T09:17:26.148773+0000","last_undegraded":"2023-10-14T09:17:26.148773+0000","last_fullsized":"2023-10-14T09:17:26.148773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147198+0000","last_change":"2023-10-14T09:17:24.651708+0000","last_active":"2023-10-14T09:17:26.147198+0000","last_peered":"2023-10-14T09:17:26.147198+0000","last_clean":"2023-10-14T09:17:26.147198+0000","last_became_active":"2023-10-14T09:17:24.651461+0000","last_became_peered":"2023-10-14T09:17:24.651461+0000","last_unstale":"2023-10-14T09:17:26.147198+0000","last_undegraded":"2023-10-14T09:17:26.147198+0000","last_fullsized":"2023-10-14T09:17:26.147198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148228+0000","last_change":"2023-10-14T09:17:24.660053+0000","last_active":"2023-10-14T09:17:26.148228+0000","last_peered":"2023-10-14T09:17:26.148228+0000","last_clean":"2023-10-14T09:17:26.148228+0000","last_became_active":"2023-10-14T09:17:24.659722+0000","last_became_peered":"2023-10-14T09:17:24.659722+0000","last_unstale":"2023-10-14T09:17:26.148228+0000","last_undegraded":"2023-10-14T09:17:26.148228+0000","last_fullsized":"2023-10-14T09:17:26.148228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148174+0000","last_change":"2023-10-14T09:17:25.070599+0000","last_active":"2023-10-14T09:17:26.148174+0000","last_peered":"2023-10-14T09:17:26.148174+0000","last_clean":"2023-10-14T09:17:26.148174+0000","last_became_active":"2023-10-14T09:17:25.070202+0000","last_became_peered":"2023-10-14T09:17:25.070202+0000","last_unstale":"2023-10-14T09:17:26.148174+0000","last_undegraded":"2023-10-14T09:17:26.148174+0000","last_fullsized":"2023-10-14T09:17:26.148174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057470+0000","last_change":"2023-10-14T09:17:24.636532+0000","last_active":"2023-10-14T09:17:26.057470+0000","last_peered":"2023-10-14T09:17:26.057470+0000","last_clean":"2023-10-14T09:17:26.057470+0000","last_became_active":"2023-10-14T09:17:24.636180+0000","last_became_peered":"2023-10-14T09:17:24.636180+0000","last_unstale":"2023-10-14T09:17:26.057470+0000","last_undegraded":"2023-10-14T09:17:26.057470+0000","last_fullsized":"2023-10-14T09:17:26.057470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:25.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057394+0000","last_change":"2023-10-14T09:17:25.069990+0000","last_active":"2023-10-14T09:17:26.057394+0000","last_peered":"2023-10-14T09:17:26.057394+0000","last_clean":"2023-10-14T09:17:26.057394+0000","last_became_active":"2023-10-14T09:17:25.069733+0000","last_became_peered":"2023-10-14T09:17:25.069733+0000","last_unstale":"2023-10-14T09:17:26.057394+0000","last_undegraded":"2023-10-14T09:17:26.057394+0000","last_fullsized":"2023-10-14T09:17:26.057394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147600+0000","last_change":"2023-10-14T09:17:24.658971+0000","last_active":"2023-10-14T09:17:26.147600+0000","last_peered":"2023-10-14T09:17:26.147600+0000","last_clean":"2023-10-14T09:17:26.147600+0000","last_became_active":"2023-10-14T09:17:24.658454+0000","last_became_peered":"2023-10-14T09:17:24.658454+0000","last_unstale":"2023-10-14T09:17:26.147600+0000","last_undegraded":"2023-10-14T09:17:26.147600+0000","last_fullsized":"2023-10-14T09:17:26.147600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058246+0000","last_change":"2023-10-14T09:17:25.073538+0000","last_active":"2023-10-14T09:17:26.058246+0000","last_peered":"2023-10-14T09:17:26.058246+0000","last_clean":"2023-10-14T09:17:26.058246+0000","last_became_active":"2023-10-14T09:17:25.073196+0000","last_became_peered":"2023-10-14T09:17:25.073196+0000","last_unstale":"2023-10-14T09:17:26.058246+0000","last_undegraded":"2023-10-14T09:17:26.058246+0000","last_fullsized":"2023-10-14T09:17:26.058246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:57.142103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058171+0000","last_change":"2023-10-14T09:17:24.656283+0000","last_active":"2023-10-14T09:17:26.058171+0000","last_peered":"2023-10-14T09:17:26.058171+0000","last_clean":"2023-10-14T09:17:26.058171+0000","last_became_active":"2023-10-14T09:17:24.655902+0000","last_became_peered":"2023-10-14T09:17:24.655902+0000","last_unstale":"2023-10-14T09:17:26.058171+0000","last_undegraded":"2023-10-14T09:17:26.058171+0000","last_fullsized":"2023-10-14T09:17:26.058171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:56.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149035+0000","last_change":"2023-10-14T09:17:25.074931+0000","last_active":"2023-10-14T09:17:26.149035+0000","last_peered":"2023-10-14T09:17:26.149035+0000","last_clean":"2023-10-14T09:17:26.149035+0000","last_became_active":"2023-10-14T09:17:25.074606+0000","last_became_peered":"2023-10-14T09:17:25.074606+0000","last_unstale":"2023-10-14T09:17:26.149035+0000","last_undegraded":"2023-10-14T09:17:26.149035+0000","last_fullsized":"2023-10-14T09:17:26.149035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057641+0000","last_change":"2023-10-14T09:17:24.660850+0000","last_active":"2023-10-14T09:17:26.057641+0000","last_peered":"2023-10-14T09:17:26.057641+0000","last_clean":"2023-10-14T09:17:26.057641+0000","last_became_active":"2023-10-14T09:17:24.660566+0000","last_became_peered":"2023-10-14T09:17:24.660566+0000","last_unstale":"2023-10-14T09:17:26.057641+0000","last_undegraded":"2023-10-14T09:17:26.057641+0000","last_fullsized":"2023-10-14T09:17:26.057641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:55.254926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057347+0000","last_change":"2023-10-14T09:17:25.084623+0000","last_active":"2023-10-14T09:17:26.057347+0000","last_peered":"2023-10-14T09:17:26.057347+0000","last_clean":"2023-10-14T09:17:26.057347+0000","last_became_active":"2023-10-14T09:17:25.083870+0000","last_became_peered":"2023-10-14T09:17:25.083870+0000","last_unstale":"2023-10-14T09:17:26.057347+0000","last_undegraded":"2023-10-14T09:17:26.057347+0000","last_fullsized":"2023-10-14T09:17:26.057347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:56.260635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147002+0000","last_change":"2023-10-14T09:17:24.655371+0000","last_active":"2023-10-14T09:17:26.147002+0000","last_peered":"2023-10-14T09:17:26.147002+0000","last_clean":"2023-10-14T09:17:26.147002+0000","last_became_active":"2023-10-14T09:17:24.654821+0000","last_became_peered":"2023-10-14T09:17:24.654821+0000","last_unstale":"2023-10-14T09:17:26.147002+0000","last_undegraded":"2023-10-14T09:17:26.147002+0000","last_fullsized":"2023-10-14T09:17:26.147002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147299+0000","last_change":"2023-10-14T09:17:25.073958+0000","last_active":"2023-10-14T09:17:26.147299+0000","last_peered":"2023-10-14T09:17:26.147299+0000","last_clean":"2023-10-14T09:17:26.147299+0000","last_became_active":"2023-10-14T09:17:25.073630+0000","last_became_peered":"2023-10-14T09:17:25.073630+0000","last_unstale":"2023-10-14T09:17:26.147299+0000","last_undegraded":"2023-10-14T09:17:26.147299+0000","last_fullsized":"2023-10-14T09:17:26.147299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148859+0000","last_change":"2023-10-14T09:17:24.647614+0000","last_active":"2023-10-14T09:17:26.148859+0000","last_peered":"2023-10-14T09:17:26.148859+0000","last_clean":"2023-10-14T09:17:26.148859+0000","last_became_active":"2023-10-14T09:17:24.647181+0000","last_became_peered":"2023-10-14T09:17:24.647181+0000","last_unstale":"2023-10-14T09:17:26.148859+0000","last_undegraded":"2023-10-14T09:17:26.148859+0000","last_fullsized":"2023-10-14T09:17:26.148859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148784+0000","last_change":"2023-10-14T09:17:25.074213+0000","last_active":"2023-10-14T09:17:26.148784+0000","last_peered":"2023-10-14T09:17:26.148784+0000","last_clean":"2023-10-14T09:17:26.148784+0000","last_became_active":"2023-10-14T09:17:25.073939+0000","last_became_peered":"2023-10-14T09:17:25.073939+0000","last_unstale":"2023-10-14T09:17:26.148784+0000","last_undegraded":"2023-10-14T09:17:26.148784+0000","last_fullsized":"2023-10-14T09:17:26.148784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057774+0000","last_change":"2023-10-14T09:17:24.650224+0000","last_active":"2023-10-14T09:17:26.057774+0000","last_peered":"2023-10-14T09:17:26.057774+0000","last_clean":"2023-10-14T09:17:26.057774+0000","last_became_active":"2023-10-14T09:17:24.649874+0000","last_became_peered":"2023-10-14T09:17:24.649874+0000","last_unstale":"2023-10-14T09:17:26.057774+0000","last_undegraded":"2023-10-14T09:17:26.057774+0000","last_fullsized":"2023-10-14T09:17:26.057774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:39.459526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147326+0000","last_change":"2023-10-14T09:17:25.087021+0000","last_active":"2023-10-14T09:17:26.147326+0000","last_peered":"2023-10-14T09:17:26.147326+0000","last_clean":"2023-10-14T09:17:26.147326+0000","last_became_active":"2023-10-14T09:17:25.085886+0000","last_became_peered":"2023-10-14T09:17:25.085886+0000","last_unstale":"2023-10-14T09:17:26.147326+0000","last_undegraded":"2023-10-14T09:17:26.147326+0000","last_fullsized":"2023-10-14T09:17:26.147326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:57.270296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146875+0000","last_change":"2023-10-14T09:17:24.656925+0000","last_active":"2023-10-14T09:17:26.146875+0000","last_peered":"2023-10-14T09:17:26.146875+0000","last_clean":"2023-10-14T09:17:26.146875+0000","last_became_active":"2023-10-14T09:17:24.656662+0000","last_became_peered":"2023-10-14T09:17:24.656662+0000","last_unstale":"2023-10-14T09:17:26.146875+0000","last_undegraded":"2023-10-14T09:17:26.146875+0000","last_fullsized":"2023-10-14T09:17:26.146875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:25.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147060+0000","last_change":"2023-10-14T09:17:25.071484+0000","last_active":"2023-10-14T09:17:26.147060+0000","last_peered":"2023-10-14T09:17:26.147060+0000","last_clean":"2023-10-14T09:17:26.147060+0000","last_became_active":"2023-10-14T09:17:25.070874+0000","last_became_peered":"2023-10-14T09:17:25.070874+0000","last_unstale":"2023-10-14T09:17:26.147060+0000","last_undegraded":"2023-10-14T09:17:26.147060+0000","last_fullsized":"2023-10-14T09:17:26.147060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147921+0000","last_change":"2023-10-14T09:17:24.650705+0000","last_active":"2023-10-14T09:17:26.147921+0000","last_peered":"2023-10-14T09:17:26.147921+0000","last_clean":"2023-10-14T09:17:26.147921+0000","last_became_active":"2023-10-14T09:17:24.650339+0000","last_became_peered":"2023-10-14T09:17:24.650339+0000","last_unstale":"2023-10-14T09:17:26.147921+0000","last_undegraded":"2023-10-14T09:17:26.147921+0000","last_fullsized":"2023-10-14T09:17:26.147921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:01.491312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147488+0000","last_change":"2023-10-14T09:17:25.086229+0000","last_active":"2023-10-14T09:17:26.147488+0000","last_peered":"2023-10-14T09:17:26.147488+0000","last_clean":"2023-10-14T09:17:26.147488+0000","last_became_active":"2023-10-14T09:17:25.085568+0000","last_became_peered":"2023-10-14T09:17:25.085568+0000","last_unstale":"2023-10-14T09:17:26.147488+0000","last_undegraded":"2023-10-14T09:17:26.147488+0000","last_fullsized":"2023-10-14T09:17:26.147488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:08.172052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057268+0000","last_change":"2023-10-14T09:17:24.651869+0000","last_active":"2023-10-14T09:17:26.057268+0000","last_peered":"2023-10-14T09:17:26.057268+0000","last_clean":"2023-10-14T09:17:26.057268+0000","last_became_active":"2023-10-14T09:17:24.651545+0000","last_became_peered":"2023-10-14T09:17:24.651545+0000","last_unstale":"2023-10-14T09:17:26.057268+0000","last_undegraded":"2023-10-14T09:17:26.057268+0000","last_fullsized":"2023-10-14T09:17:26.057268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:01.491312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147728+0000","last_change":"2023-10-14T09:17:25.086054+0000","last_active":"2023-10-14T09:17:26.147728+0000","last_peered":"2023-10-14T09:17:26.147728+0000","last_clean":"2023-10-14T09:17:26.147728+0000","last_became_active":"2023-10-14T09:17:25.085704+0000","last_became_peered":"2023-10-14T09:17:25.085704+0000","last_unstale":"2023-10-14T09:17:26.147728+0000","last_undegraded":"2023-10-14T09:17:26.147728+0000","last_fullsized":"2023-10-14T09:17:26.147728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:13.523277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148998+0000","last_change":"2023-10-14T09:17:24.647549+0000","last_active":"2023-10-14T09:17:26.148998+0000","last_peered":"2023-10-14T09:17:26.148998+0000","last_clean":"2023-10-14T09:17:26.148998+0000","last_became_active":"2023-10-14T09:17:24.645321+0000","last_became_peered":"2023-10-14T09:17:24.645321+0000","last_unstale":"2023-10-14T09:17:26.148998+0000","last_undegraded":"2023-10-14T09:17:26.148998+0000","last_fullsized":"2023-10-14T09:17:26.148998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:55.254926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147428+0000","last_change":"2023-10-14T09:17:25.086522+0000","last_active":"2023-10-14T09:17:26.147428+0000","last_peered":"2023-10-14T09:17:26.147428+0000","last_clean":"2023-10-14T09:17:26.147428+0000","last_became_active":"2023-10-14T09:17:25.086192+0000","last_became_peered":"2023-10-14T09:17:25.086192+0000","last_unstale":"2023-10-14T09:17:26.147428+0000","last_undegraded":"2023-10-14T09:17:26.147428+0000","last_fullsized":"2023-10-14T09:17:26.147428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:57.142103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057720+0000","last_change":"2023-10-14T09:17:24.654486+0000","last_active":"2023-10-14T09:17:26.057720+0000","last_peered":"2023-10-14T09:17:26.057720+0000","last_clean":"2023-10-14T09:17:26.057720+0000","last_became_active":"2023-10-14T09:17:24.652694+0000","last_became_peered":"2023-10-14T09:17:24.652694+0000","last_unstale":"2023-10-14T09:17:26.057720+0000","last_undegraded":"2023-10-14T09:17:26.057720+0000","last_fullsized":"2023-10-14T09:17:26.057720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058138+0000","last_change":"2023-10-14T09:17:25.067993+0000","last_active":"2023-10-14T09:17:26.058138+0000","last_peered":"2023-10-14T09:17:26.058138+0000","last_clean":"2023-10-14T09:17:26.058138+0000","last_became_active":"2023-10-14T09:17:25.067671+0000","last_became_peered":"2023-10-14T09:17:25.067671+0000","last_unstale":"2023-10-14T09:17:26.058138+0000","last_undegraded":"2023-10-14T09:17:26.058138+0000","last_fullsized":"2023-10-14T09:17:26.058138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:26.745591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148710+0000","last_change":"2023-10-14T09:17:24.638946+0000","last_active":"2023-10-14T09:17:26.148710+0000","last_peered":"2023-10-14T09:17:26.148710+0000","last_clean":"2023-10-14T09:17:26.148710+0000","last_became_active":"2023-10-14T09:17:24.638655+0000","last_became_peered":"2023-10-14T09:17:24.638655+0000","last_unstale":"2023-10-14T09:17:26.148710+0000","last_undegraded":"2023-10-14T09:17:26.148710+0000","last_fullsized":"2023-10-14T09:17:26.148710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:00.618802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147399+0000","last_change":"2023-10-14T09:17:25.084705+0000","last_active":"2023-10-14T09:17:26.147399+0000","last_peered":"2023-10-14T09:17:26.147399+0000","last_clean":"2023-10-14T09:17:26.147399+0000","last_became_active":"2023-10-14T09:17:25.084208+0000","last_became_peered":"2023-10-14T09:17:25.084208+0000","last_unstale":"2023-10-14T09:17:26.147399+0000","last_undegraded":"2023-10-14T09:17:26.147399+0000","last_fullsized":"2023-10-14T09:17:26.147399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:52.745681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T09:17:25.064563+0000","last_change":"2023-10-14T09:17:14.304224+0000","last_active":"2023-10-14T09:17:25.064563+0000","last_peered":"2023-10-14T09:17:25.064563+0000","last_clean":"2023-10-14T09:17:25.064563+0000","last_became_active":"2023-10-14T09:17:14.303743+0000","last_became_peered":"2023-10-14T09:17:14.303743+0000","last_unstale":"2023-10-14T09:17:25.064563+0000","last_undegraded":"2023-10-14T09:17:25.064563+0000","last_fullsized":"2023-10-14T09:17:25.064563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_clean_scrub_stamp":"2023-10-14T09:17:13.285641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:24.100243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057432+0000","last_change":"2023-10-14T09:17:24.646906+0000","last_active":"2023-10-14T09:17:26.057432+0000","last_peered":"2023-10-14T09:17:26.057432+0000","last_clean":"2023-10-14T09:17:26.057432+0000","last_became_active":"2023-10-14T09:17:24.646536+0000","last_became_peered":"2023-10-14T09:17:24.646536+0000","last_unstale":"2023-10-14T09:17:26.057432+0000","last_undegraded":"2023-10-14T09:17:26.057432+0000","last_fullsized":"2023-10-14T09:17:26.057432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149345+0000","last_change":"2023-10-14T09:17:25.065358+0000","last_active":"2023-10-14T09:17:26.149345+0000","last_peered":"2023-10-14T09:17:26.149345+0000","last_clean":"2023-10-14T09:17:26.149345+0000","last_became_active":"2023-10-14T09:17:25.065048+0000","last_became_peered":"2023-10-14T09:17:25.065048+0000","last_unstale":"2023-10-14T09:17:26.149345+0000","last_undegraded":"2023-10-14T09:17:26.149345+0000","last_fullsized":"2023-10-14T09:17:26.149345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147353+0000","last_change":"2023-10-14T09:17:24.663937+0000","last_active":"2023-10-14T09:17:26.147353+0000","last_peered":"2023-10-14T09:17:26.147353+0000","last_clean":"2023-10-14T09:17:26.147353+0000","last_became_active":"2023-10-14T09:17:24.663420+0000","last_became_peered":"2023-10-14T09:17:24.663420+0000","last_unstale":"2023-10-14T09:17:26.147353+0000","last_undegraded":"2023-10-14T09:17:26.147353+0000","last_fullsized":"2023-10-14T09:17:26.147353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148230+0000","last_change":"2023-10-14T09:17:25.079632+0000","last_active":"2023-10-14T09:17:26.148230+0000","last_peered":"2023-10-14T09:17:26.148230+0000","last_clean":"2023-10-14T09:17:26.148230+0000","last_became_active":"2023-10-14T09:17:25.079358+0000","last_became_peered":"2023-10-14T09:17:25.079358+0000","last_unstale":"2023-10-14T09:17:26.148230+0000","last_undegraded":"2023-10-14T09:17:26.148230+0000","last_fullsized":"2023-10-14T09:17:26.148230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:03.207187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148663+0000","last_change":"2023-10-14T09:17:24.646437+0000","last_active":"2023-10-14T09:17:26.148663+0000","last_peered":"2023-10-14T09:17:26.148663+0000","last_clean":"2023-10-14T09:17:26.148663+0000","last_became_active":"2023-10-14T09:17:24.645079+0000","last_became_peered":"2023-10-14T09:17:24.645079+0000","last_unstale":"2023-10-14T09:17:26.148663+0000","last_undegraded":"2023-10-14T09:17:26.148663+0000","last_fullsized":"2023-10-14T09:17:26.148663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:57.876385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057579+0000","last_change":"2023-10-14T09:17:25.057184+0000","last_active":"2023-10-14T09:17:26.057579+0000","last_peered":"2023-10-14T09:17:26.057579+0000","last_clean":"2023-10-14T09:17:26.057579+0000","last_became_active":"2023-10-14T09:17:25.056927+0000","last_became_peered":"2023-10-14T09:17:25.056927+0000","last_unstale":"2023-10-14T09:17:26.057579+0000","last_undegraded":"2023-10-14T09:17:26.057579+0000","last_fullsized":"2023-10-14T09:17:26.057579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057868+0000","last_change":"2023-10-14T09:17:24.654452+0000","last_active":"2023-10-14T09:17:26.057868+0000","last_peered":"2023-10-14T09:17:26.057868+0000","last_clean":"2023-10-14T09:17:26.057868+0000","last_became_active":"2023-10-14T09:17:24.654123+0000","last_became_peered":"2023-10-14T09:17:24.654123+0000","last_unstale":"2023-10-14T09:17:26.057868+0000","last_undegraded":"2023-10-14T09:17:26.057868+0000","last_fullsized":"2023-10-14T09:17:26.057868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:06.694051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057462+0000","last_change":"2023-10-14T09:17:25.065503+0000","last_active":"2023-10-14T09:17:26.057462+0000","last_peered":"2023-10-14T09:17:26.057462+0000","last_clean":"2023-10-14T09:17:26.057462+0000","last_became_active":"2023-10-14T09:17:25.065201+0000","last_became_peered":"2023-10-14T09:17:25.065201+0000","last_unstale":"2023-10-14T09:17:26.057462+0000","last_undegraded":"2023-10-14T09:17:26.057462+0000","last_fullsized":"2023-10-14T09:17:26.057462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:08.387279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057636+0000","last_change":"2023-10-14T09:17:24.654216+0000","last_active":"2023-10-14T09:17:26.057636+0000","last_peered":"2023-10-14T09:17:26.057636+0000","last_clean":"2023-10-14T09:17:26.057636+0000","last_became_active":"2023-10-14T09:17:24.653646+0000","last_became_peered":"2023-10-14T09:17:24.653646+0000","last_unstale":"2023-10-14T09:17:26.057636+0000","last_undegraded":"2023-10-14T09:17:26.057636+0000","last_fullsized":"2023-10-14T09:17:26.057636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057990+0000","last_change":"2023-10-14T09:17:25.072986+0000","last_active":"2023-10-14T09:17:26.057990+0000","last_peered":"2023-10-14T09:17:26.057990+0000","last_clean":"2023-10-14T09:17:26.057990+0000","last_became_active":"2023-10-14T09:17:25.072730+0000","last_became_peered":"2023-10-14T09:17:25.072730+0000","last_unstale":"2023-10-14T09:17:26.057990+0000","last_undegraded":"2023-10-14T09:17:26.057990+0000","last_fullsized":"2023-10-14T09:17:26.057990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:57.270296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147812+0000","last_change":"2023-10-14T09:17:24.663546+0000","last_active":"2023-10-14T09:17:26.147812+0000","last_peered":"2023-10-14T09:17:26.147812+0000","last_clean":"2023-10-14T09:17:26.147812+0000","last_became_active":"2023-10-14T09:17:24.663199+0000","last_became_peered":"2023-10-14T09:17:24.663199+0000","last_unstale":"2023-10-14T09:17:26.147812+0000","last_undegraded":"2023-10-14T09:17:26.147812+0000","last_fullsized":"2023-10-14T09:17:26.147812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:48.194426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057548+0000","last_change":"2023-10-14T09:17:25.061842+0000","last_active":"2023-10-14T09:17:26.057548+0000","last_peered":"2023-10-14T09:17:26.057548+0000","last_clean":"2023-10-14T09:17:26.057548+0000","last_became_active":"2023-10-14T09:17:25.061587+0000","last_became_peered":"2023-10-14T09:17:25.061587+0000","last_unstale":"2023-10-14T09:17:26.057548+0000","last_undegraded":"2023-10-14T09:17:26.057548+0000","last_fullsized":"2023-10-14T09:17:26.057548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057747+0000","last_change":"2023-10-14T09:17:24.657107+0000","last_active":"2023-10-14T09:17:26.057747+0000","last_peered":"2023-10-14T09:17:26.057747+0000","last_clean":"2023-10-14T09:17:26.057747+0000","last_became_active":"2023-10-14T09:17:24.656772+0000","last_became_peered":"2023-10-14T09:17:24.656772+0000","last_unstale":"2023-10-14T09:17:26.057747+0000","last_undegraded":"2023-10-14T09:17:26.057747+0000","last_fullsized":"2023-10-14T09:17:26.057747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:33.644028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149658+0000","last_change":"2023-10-14T09:17:25.077360+0000","last_active":"2023-10-14T09:17:26.149658+0000","last_peered":"2023-10-14T09:17:26.149658+0000","last_clean":"2023-10-14T09:17:26.149658+0000","last_became_active":"2023-10-14T09:17:25.076972+0000","last_became_peered":"2023-10-14T09:17:25.076972+0000","last_unstale":"2023-10-14T09:17:26.149658+0000","last_undegraded":"2023-10-14T09:17:26.149658+0000","last_fullsized":"2023-10-14T09:17:26.149658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147675+0000","last_change":"2023-10-14T09:17:24.650946+0000","last_active":"2023-10-14T09:17:26.147675+0000","last_peered":"2023-10-14T09:17:26.147675+0000","last_clean":"2023-10-14T09:17:26.147675+0000","last_became_active":"2023-10-14T09:17:24.650657+0000","last_became_peered":"2023-10-14T09:17:24.650657+0000","last_unstale":"2023-10-14T09:17:26.147675+0000","last_undegraded":"2023-10-14T09:17:26.147675+0000","last_fullsized":"2023-10-14T09:17:26.147675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148670+0000","last_change":"2023-10-14T09:17:25.065959+0000","last_active":"2023-10-14T09:17:26.148670+0000","last_peered":"2023-10-14T09:17:26.148670+0000","last_clean":"2023-10-14T09:17:26.148670+0000","last_became_active":"2023-10-14T09:17:25.065708+0000","last_became_peered":"2023-10-14T09:17:25.065708+0000","last_unstale":"2023-10-14T09:17:26.148670+0000","last_undegraded":"2023-10-14T09:17:26.148670+0000","last_fullsized":"2023-10-14T09:17:26.148670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147118+0000","last_change":"2023-10-14T09:17:24.663717+0000","last_active":"2023-10-14T09:17:26.147118+0000","last_peered":"2023-10-14T09:17:26.147118+0000","last_clean":"2023-10-14T09:17:26.147118+0000","last_became_active":"2023-10-14T09:17:24.663082+0000","last_became_peered":"2023-10-14T09:17:24.663082+0000","last_unstale":"2023-10-14T09:17:26.147118+0000","last_undegraded":"2023-10-14T09:17:26.147118+0000","last_fullsized":"2023-10-14T09:17:26.147118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057370+0000","last_change":"2023-10-14T09:17:25.062652+0000","last_active":"2023-10-14T09:17:26.057370+0000","last_peered":"2023-10-14T09:17:26.057370+0000","last_clean":"2023-10-14T09:17:26.057370+0000","last_became_active":"2023-10-14T09:17:25.062345+0000","last_became_peered":"2023-10-14T09:17:25.062345+0000","last_unstale":"2023-10-14T09:17:26.057370+0000","last_undegraded":"2023-10-14T09:17:26.057370+0000","last_fullsized":"2023-10-14T09:17:26.057370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:26.084905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057462+0000","last_change":"2023-10-14T09:17:24.655398+0000","last_active":"2023-10-14T09:17:26.057462+0000","last_peered":"2023-10-14T09:17:26.057462+0000","last_clean":"2023-10-14T09:17:26.057462+0000","last_became_active":"2023-10-14T09:17:24.654885+0000","last_became_peered":"2023-10-14T09:17:24.654885+0000","last_unstale":"2023-10-14T09:17:26.057462+0000","last_undegraded":"2023-10-14T09:17:26.057462+0000","last_fullsized":"2023-10-14T09:17:26.057462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148294+0000","last_change":"2023-10-14T09:17:25.063668+0000","last_active":"2023-10-14T09:17:26.148294+0000","last_peered":"2023-10-14T09:17:26.148294+0000","last_clean":"2023-10-14T09:17:26.148294+0000","last_became_active":"2023-10-14T09:17:25.063408+0000","last_became_peered":"2023-10-14T09:17:25.063408+0000","last_unstale":"2023-10-14T09:17:26.148294+0000","last_undegraded":"2023-10-14T09:17:26.148294+0000","last_fullsized":"2023-10-14T09:17:26.148294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057694+0000","last_change":"2023-10-14T09:17:24.652502+0000","last_active":"2023-10-14T09:17:26.057694+0000","last_peered":"2023-10-14T09:17:26.057694+0000","last_clean":"2023-10-14T09:17:26.057694+0000","last_became_active":"2023-10-14T09:17:24.652222+0000","last_became_peered":"2023-10-14T09:17:24.652222+0000","last_unstale":"2023-10-14T09:17:26.057694+0000","last_undegraded":"2023-10-14T09:17:26.057694+0000","last_fullsized":"2023-10-14T09:17:26.057694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:57.876385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149500+0000","last_change":"2023-10-14T09:17:25.070505+0000","last_active":"2023-10-14T09:17:26.149500+0000","last_peered":"2023-10-14T09:17:26.149500+0000","last_clean":"2023-10-14T09:17:26.149500+0000","last_became_active":"2023-10-14T09:17:25.070227+0000","last_became_peered":"2023-10-14T09:17:25.070227+0000","last_unstale":"2023-10-14T09:17:26.149500+0000","last_undegraded":"2023-10-14T09:17:26.149500+0000","last_fullsized":"2023-10-14T09:17:26.149500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147529+0000","last_change":"2023-10-14T09:17:24.663767+0000","last_active":"2023-10-14T09:17:26.147529+0000","last_peered":"2023-10-14T09:17:26.147529+0000","last_clean":"2023-10-14T09:17:26.147529+0000","last_became_active":"2023-10-14T09:17:24.663287+0000","last_became_peered":"2023-10-14T09:17:24.663287+0000","last_unstale":"2023-10-14T09:17:26.147529+0000","last_undegraded":"2023-10-14T09:17:26.147529+0000","last_fullsized":"2023-10-14T09:17:26.147529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:52.317766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147098+0000","last_change":"2023-10-14T09:17:25.083037+0000","last_active":"2023-10-14T09:17:26.147098+0000","last_peered":"2023-10-14T09:17:26.147098+0000","last_clean":"2023-10-14T09:17:26.147098+0000","last_became_active":"2023-10-14T09:17:25.082685+0000","last_became_peered":"2023-10-14T09:17:25.082685+0000","last_unstale":"2023-10-14T09:17:26.147098+0000","last_undegraded":"2023-10-14T09:17:26.147098+0000","last_fullsized":"2023-10-14T09:17:26.147098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058036+0000","last_change":"2023-10-14T09:17:25.070513+0000","last_active":"2023-10-14T09:17:26.058036+0000","last_peered":"2023-10-14T09:17:26.058036+0000","last_clean":"2023-10-14T09:17:26.058036+0000","last_became_active":"2023-10-14T09:17:25.070206+0000","last_became_peered":"2023-10-14T09:17:25.070206+0000","last_unstale":"2023-10-14T09:17:26.058036+0000","last_undegraded":"2023-10-14T09:17:26.058036+0000","last_fullsized":"2023-10-14T09:17:26.058036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:52.745681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147258+0000","last_change":"2023-10-14T09:17:24.663588+0000","last_active":"2023-10-14T09:17:26.147258+0000","last_peered":"2023-10-14T09:17:26.147258+0000","last_clean":"2023-10-14T09:17:26.147258+0000","last_became_active":"2023-10-14T09:17:24.663275+0000","last_became_peered":"2023-10-14T09:17:24.663275+0000","last_unstale":"2023-10-14T09:17:26.147258+0000","last_undegraded":"2023-10-14T09:17:26.147258+0000","last_fullsized":"2023-10-14T09:17:26.147258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058308+0000","last_change":"2023-10-14T09:17:25.081621+0000","last_active":"2023-10-14T09:17:26.058308+0000","last_peered":"2023-10-14T09:17:26.058308+0000","last_clean":"2023-10-14T09:17:26.058308+0000","last_became_active":"2023-10-14T09:17:25.081183+0000","last_became_peered":"2023-10-14T09:17:25.081183+0000","last_unstale":"2023-10-14T09:17:26.058308+0000","last_undegraded":"2023-10-14T09:17:26.058308+0000","last_fullsized":"2023-10-14T09:17:26.058308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:08.172052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147404+0000","last_change":"2023-10-14T09:17:24.664054+0000","last_active":"2023-10-14T09:17:26.147404+0000","last_peered":"2023-10-14T09:17:26.147404+0000","last_clean":"2023-10-14T09:17:26.147404+0000","last_became_active":"2023-10-14T09:17:24.663750+0000","last_became_peered":"2023-10-14T09:17:24.663750+0000","last_unstale":"2023-10-14T09:17:26.147404+0000","last_undegraded":"2023-10-14T09:17:26.147404+0000","last_fullsized":"2023-10-14T09:17:26.147404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148919+0000","last_change":"2023-10-14T09:17:25.079820+0000","last_active":"2023-10-14T09:17:26.148919+0000","last_peered":"2023-10-14T09:17:26.148919+0000","last_clean":"2023-10-14T09:17:26.148919+0000","last_became_active":"2023-10-14T09:17:25.079573+0000","last_became_peered":"2023-10-14T09:17:25.079573+0000","last_unstale":"2023-10-14T09:17:26.148919+0000","last_undegraded":"2023-10-14T09:17:26.148919+0000","last_fullsized":"2023-10-14T09:17:26.148919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149601+0000","last_change":"2023-10-14T09:17:24.652635+0000","last_active":"2023-10-14T09:17:26.149601+0000","last_peered":"2023-10-14T09:17:26.149601+0000","last_clean":"2023-10-14T09:17:26.149601+0000","last_became_active":"2023-10-14T09:17:24.652363+0000","last_became_peered":"2023-10-14T09:17:24.652363+0000","last_unstale":"2023-10-14T09:17:26.149601+0000","last_undegraded":"2023-10-14T09:17:26.149601+0000","last_fullsized":"2023-10-14T09:17:26.149601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149517+0000","last_change":"2023-10-14T09:17:25.078752+0000","last_active":"2023-10-14T09:17:26.149517+0000","last_peered":"2023-10-14T09:17:26.149517+0000","last_clean":"2023-10-14T09:17:26.149517+0000","last_became_active":"2023-10-14T09:17:25.078504+0000","last_became_peered":"2023-10-14T09:17:25.078504+0000","last_unstale":"2023-10-14T09:17:26.149517+0000","last_undegraded":"2023-10-14T09:17:26.149517+0000","last_fullsized":"2023-10-14T09:17:26.149517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:17.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149133+0000","last_change":"2023-10-14T09:17:24.651100+0000","last_active":"2023-10-14T09:17:26.149133+0000","last_peered":"2023-10-14T09:17:26.149133+0000","last_clean":"2023-10-14T09:17:26.149133+0000","last_became_active":"2023-10-14T09:17:24.650418+0000","last_became_peered":"2023-10-14T09:17:24.650418+0000","last_unstale":"2023-10-14T09:17:26.149133+0000","last_undegraded":"2023-10-14T09:17:26.149133+0000","last_fullsized":"2023-10-14T09:17:26.149133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":661848,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":661904,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:17:30.101 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T09:17:30.101 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T09:17:30.101 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T09:17:30.102 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T09:17:30.103 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T09:17:30.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.265+0000 7f884dd72640 1 Processor -- start 2023-10-14T09:17:30.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.265+0000 7f884dd72640 1 -- start start 2023-10-14T09:17:30.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f884dd72640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f884814e0f0 0x7f8848152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f884dd72640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f884814ed10 0x7f884814f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f884dd72640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f884814f6d0 0x7f8848150a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f884dd72640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8848153e50 con 0x7f884814ed10 2023-10-14T09:17:30.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f884dd72640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88481531d0 con 0x7f884814f6d0 2023-10-14T09:17:30.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f884dd72640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88481534b0 con 0x7f884814e0f0 2023-10-14T09:17:30.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f8846ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f884814ed10 0x7f884814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f8846ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f884814ed10 0x7f884814f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38958/0 (socket says 172.21.15.78:38958) 2023-10-14T09:17:30.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f8846ffd640 1 -- 172.21.15.78:0/1238881178 learned_addr learned my addr 172.21.15.78:0/1238881178 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:30.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f88477fe640 1 --2- 172.21.15.78:0/1238881178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f884814e0f0 0x7f8848152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f8847fff640 1 --2- 172.21.15.78:0/1238881178 >> v2:172.21.15.157:3300/0 conn(0x7f884814f6d0 0x7f8848150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f8846ffd640 1 -- 172.21.15.78:0/1238881178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f884814e0f0 msgr2=0x7f8848152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:30.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f8846ffd640 1 --2- 172.21.15.78:0/1238881178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f884814e0f0 0x7f8848152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f8846ffd640 1 -- 172.21.15.78:0/1238881178 >> v2:172.21.15.157:3300/0 conn(0x7f884814f6d0 msgr2=0x7f8848150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:30.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f8846ffd640 1 --2- 172.21.15.78:0/1238881178 >> v2:172.21.15.157:3300/0 conn(0x7f884814f6d0 0x7f8848150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f8846ffd640 1 -- 172.21.15.78:0/1238881178 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848153790 con 0x7f884814ed10 2023-10-14T09:17:30.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.269+0000 7f8847fff640 1 --2- 172.21.15.78:0/1238881178 >> v2:172.21.15.157:3300/0 conn(0x7f884814f6d0 0x7f8848150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:30.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f8846ffd640 1 --2- 172.21.15.78:0/1238881178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884814ed10 0x7f884814f190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88480bf7d0 tx=0x7f883c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc69718aab9865c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:30.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f88467fc640 1 -- 172.21.15.78:0/1238881178 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0ab600 con 0x7f884814ed10 2023-10-14T09:17:30.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f88467fc640 1 -- 172.21.15.78:0/1238881178 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c0a7050 con 0x7f884814ed10 2023-10-14T09:17:30.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f88467fc640 1 -- 172.21.15.78:0/1238881178 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0ab980 con 0x7f884814ed10 2023-10-14T09:17:30.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f884dd72640 1 -- 172.21.15.78:0/1238881178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884814ed10 msgr2=0x7f884814f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f884dd72640 1 --2- 172.21.15.78:0/1238881178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884814ed10 0x7f884814f190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88480bf7d0 tx=0x7f883c01c470 comp rx=0 tx=0).stop 2023-10-14T09:17:30.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f884dd72640 1 -- 172.21.15.78:0/1238881178 shutdown_connections 2023-10-14T09:17:30.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f884dd72640 1 --2- 172.21.15.78:0/1238881178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884814ed10 0x7f884814f190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f884dd72640 1 --2- 172.21.15.78:0/1238881178 >> v2:172.21.15.157:3300/0 conn(0x7f884814f6d0 0x7f8848150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f884dd72640 1 --2- 172.21.15.78:0/1238881178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f884814e0f0 0x7f8848152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f884dd72640 1 -- 172.21.15.78:0/1238881178 >> 172.21.15.78:0/1238881178 conn(0x7f88480c1cc0 msgr2=0x7f88480c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f884dd72640 1 -- 172.21.15.78:0/1238881178 shutdown_connections 2023-10-14T09:17:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f884dd72640 1 -- 172.21.15.78:0/1238881178 wait complete. 2023-10-14T09:17:30.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f884dd72640 1 Processor -- start 2023-10-14T09:17:30.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.273+0000 7f884dd72640 1 -- start start 2023-10-14T09:17:30.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f884dd72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884814e0f0 0x7f88481ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f884dd72640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f884814ed10 0x7f884814c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f884dd72640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f884814f6d0 0x7f8848147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f884dd72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88481e9a30 con 0x7f884814e0f0 2023-10-14T09:17:30.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f884dd72640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884814cd40 con 0x7f884814f6d0 2023-10-14T09:17:30.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f884dd72640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884814d020 con 0x7f884814ed10 2023-10-14T09:17:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f88477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884814e0f0 0x7f88481ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f88477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884814e0f0 0x7f88481ecfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38960/0 (socket says 172.21.15.78:38960) 2023-10-14T09:17:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f88477fe640 1 -- 172.21.15.78:0/2952392850 learned_addr learned my addr 172.21.15.78:0/2952392850 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f8846ffd640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f884814ed10 0x7f884814c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f8847fff640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f884814f6d0 0x7f8848147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f88477fe640 1 -- 172.21.15.78:0/2952392850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f884814ed10 msgr2=0x7f884814c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f88477fe640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f884814ed10 0x7f884814c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f88477fe640 1 -- 172.21.15.78:0/2952392850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f884814f6d0 msgr2=0x7f8848147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f88477fe640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f884814f6d0 0x7f8848147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f88477fe640 1 -- 172.21.15.78:0/2952392850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c0094d0 con 0x7f884814e0f0 2023-10-14T09:17:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f88477fe640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884814e0f0 0x7f88481ecfa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f883800d800 tx=0x7f883800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f882ffff640 1 -- 172.21.15.78:0/2952392850 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380096a0 con 0x7f884814e0f0 2023-10-14T09:17:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f882ffff640 1 -- 172.21.15.78:0/2952392850 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8838009800 con 0x7f884814e0f0 2023-10-14T09:17:30.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f882ffff640 1 -- 172.21.15.78:0/2952392850 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838009b70 con 0x7f884814e0f0 2023-10-14T09:17:30.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f884dd72640 1 -- 172.21.15.78:0/2952392850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884814d300 con 0x7f884814e0f0 2023-10-14T09:17:30.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f884dd72640 1 -- 172.21.15.78:0/2952392850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884806fc30 con 0x7f884814e0f0 2023-10-14T09:17:30.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f884dd72640 1 -- 172.21.15.78:0/2952392850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8848074180 con 0x7f884814e0f0 2023-10-14T09:17:30.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.277+0000 7f882ffff640 1 -- 172.21.15.78:0/2952392850 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8838009cd0 con 0x7f884814e0f0 2023-10-14T09:17:30.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.281+0000 7f882ffff640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88340664a0 0x7f8834068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.281+0000 7f882ffff640 1 -- 172.21.15.78:0/2952392850 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88380844a0 con 0x7f884814e0f0 2023-10-14T09:17:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.281+0000 7f8846ffd640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88340664a0 0x7f8834068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.281+0000 7f8846ffd640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88340664a0 0x7f8834068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f883c0ad000 tx=0x7f883c0a4f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.285+0000 7f882ffff640 1 -- 172.21.15.78:0/2952392850 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f88380519b0 con 0x7f884814e0f0 2023-10-14T09:17:30.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.469+0000 7f884dd72640 1 -- 172.21.15.78:0/2952392850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f88480c13b0 con 0x7f884814e0f0 2023-10-14T09:17:30.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.473+0000 7f882ffff640 1 -- 172.21.15.78:0/2952392850 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164429 (secure 0 0 0) 0x7f8838054fd0 con 0x7f884814e0f0 2023-10-14T09:17:30.479 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:30.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.473+0000 7f884dd72640 1 -- 172.21.15.78:0/2952392850 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88340664a0 msgr2=0x7f8834068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.473+0000 7f884dd72640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88340664a0 0x7f8834068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f883c0ad000 tx=0x7f883c0a4f90 comp rx=0 tx=0).stop 2023-10-14T09:17:30.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.473+0000 7f884dd72640 1 -- 172.21.15.78:0/2952392850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884814e0f0 msgr2=0x7f88481ecfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.473+0000 7f884dd72640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884814e0f0 0x7f88481ecfa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f883800d800 tx=0x7f883800dcc0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.473+0000 7f884dd72640 1 -- 172.21.15.78:0/2952392850 shutdown_connections 2023-10-14T09:17:30.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.473+0000 7f884dd72640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f884814f6d0 0x7f8848147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.473+0000 7f884dd72640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88340664a0 0x7f8834068960 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.473+0000 7f884dd72640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f884814ed10 0x7f884814c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.473+0000 7f884dd72640 1 --2- 172.21.15.78:0/2952392850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884814e0f0 0x7f88481ecfa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.473+0000 7f884dd72640 1 -- 172.21.15.78:0/2952392850 >> 172.21.15.78:0/2952392850 conn(0x7f88480c1cc0 msgr2=0x7f88480c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:30.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.477+0000 7f884dd72640 1 -- 172.21.15.78:0/2952392850 shutdown_connections 2023-10-14T09:17:30.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.477+0000 7f884dd72640 1 -- 172.21.15.78:0/2952392850 wait complete. 2023-10-14T09:17:30.500 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"active_gid":4106,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3520689651},{"type":"v1","addr":"172.21.15.78:6833","nonce":3520689651}]},"active_addr":"172.21.15.78:6833/3520689651","active_change":"2023-10-14T09:17:05.211345+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3059253334}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3317894217}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3158271528}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":744198400}]}]} 2023-10-14T09:17:30.504 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T09:17:30.504 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T09:17:30.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:30.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.637+0000 7f7d18232640 1 Processor -- start 2023-10-14T09:17:30.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.637+0000 7f7d18232640 1 -- start start 2023-10-14T09:17:30.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.637+0000 7f7d18232640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d100a8360 0x7f7d100a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.637+0000 7f7d18232640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d1006cd70 0x7f7d1006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.637+0000 7f7d18232640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d10152a60 con 0x7f7d1013b050 2023-10-14T09:17:30.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.637+0000 7f7d18232640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d100a9340 con 0x7f7d1006cd70 2023-10-14T09:17:30.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.637+0000 7f7d18232640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d10151e50 con 0x7f7d100a8360 2023-10-14T09:17:30.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.637+0000 7f7d167cf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d1006cd70 0x7f7d1006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.637+0000 7f7d167cf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d1006cd70 0x7f7d1006d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38976/0 (socket says 172.21.15.78:38976) 2023-10-14T09:17:30.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.637+0000 7f7d167cf640 1 -- 172.21.15.78:0/2748164576 learned_addr learned my addr 172.21.15.78:0/2748164576 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:30.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d157cd640 1 --2- 172.21.15.78:0/2748164576 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d100a8360 0x7f7d100a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d167cf640 1 -- 172.21.15.78:0/2748164576 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d100a8360 msgr2=0x7f7d100a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:30.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d167cf640 1 --2- 172.21.15.78:0/2748164576 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d100a8360 0x7f7d100a87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d167cf640 1 -- 172.21.15.78:0/2748164576 >> v1:172.21.15.157:6789/0 conn(0x7f7d1013b050 legacy=0x7f7d10155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:30.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d167cf640 1 -- 172.21.15.78:0/2748164576 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10152130 con 0x7f7d1006cd70 2023-10-14T09:17:30.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d157cd640 1 --2- 172.21.15.78:0/2748164576 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d100a8360 0x7f7d100a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:30.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d167cf640 1 --2- 172.21.15.78:0/2748164576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d1006cd70 0x7f7d1006d1f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009e50 tx=0x7f7d0801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a189c4f9b1a14f82 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:30.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d14fcc640 1 -- 172.21.15.78:0/2748164576 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d080a5810 con 0x7f7d1006cd70 2023-10-14T09:17:30.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d14fcc640 1 -- 172.21.15.78:0/2748164576 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d080a5970 con 0x7f7d1006cd70 2023-10-14T09:17:30.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d14fcc640 1 -- 172.21.15.78:0/2748164576 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d080a5d00 con 0x7f7d1006cd70 2023-10-14T09:17:30.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d18232640 1 -- 172.21.15.78:0/2748164576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d1006cd70 msgr2=0x7f7d1006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d18232640 1 --2- 172.21.15.78:0/2748164576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d1006cd70 0x7f7d1006d1f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009e50 tx=0x7f7d0801c950 comp rx=0 tx=0).stop 2023-10-14T09:17:30.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d18232640 1 -- 172.21.15.78:0/2748164576 shutdown_connections 2023-10-14T09:17:30.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d18232640 1 --2- 172.21.15.78:0/2748164576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d1006cd70 0x7f7d1006d1f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d18232640 1 --2- 172.21.15.78:0/2748164576 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d100a8360 0x7f7d100a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.641+0000 7f7d18232640 1 -- 172.21.15.78:0/2748164576 >> 172.21.15.78:0/2748164576 conn(0x7f7d100c1cc0 msgr2=0x7f7d100c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:30.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 -- 172.21.15.78:0/2748164576 shutdown_connections 2023-10-14T09:17:30.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 -- 172.21.15.78:0/2748164576 wait complete. 2023-10-14T09:17:30.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 Processor -- start 2023-10-14T09:17:30.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 -- start start 2023-10-14T09:17:30.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d1006cd70 0x7f7d10131ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d100a8360 0x7f7d1014c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1013b050 0x7f7d101efda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1012e8e0 con 0x7f7d100a8360 2023-10-14T09:17:30.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1014af60 con 0x7f7d1013b050 2023-10-14T09:17:30.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d10148bf0 con 0x7f7d1006cd70 2023-10-14T09:17:30.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d157cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d100a8360 0x7f7d1014c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d157cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d100a8360 0x7f7d1014c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38982/0 (socket says 172.21.15.78:38982) 2023-10-14T09:17:30.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d157cd640 1 -- 172.21.15.78:0/2823903132 learned_addr learned my addr 172.21.15.78:0/2823903132 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:30.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d167cf640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1013b050 0x7f7d101efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d15fce640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d1006cd70 0x7f7d10131ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d157cd640 1 -- 172.21.15.78:0/2823903132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d1006cd70 msgr2=0x7f7d10131ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d157cd640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d1006cd70 0x7f7d10131ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d157cd640 1 -- 172.21.15.78:0/2823903132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1013b050 msgr2=0x7f7d101efda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d157cd640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1013b050 0x7f7d101efda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d157cd640 1 -- 172.21.15.78:0/2823903132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d08009b30 con 0x7f7d100a8360 2023-10-14T09:17:30.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d15fce640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d1006cd70 0x7f7d10131ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:30.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d157cd640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d100a8360 0x7f7d1014c180 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000c7f0 tx=0x7f7d0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:30.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d067fc640 1 -- 172.21.15.78:0/2823903132 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000cea0 con 0x7f7d100a8360 2023-10-14T09:17:30.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d067fc640 1 -- 172.21.15.78:0/2823903132 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d00007a30 con 0x7f7d100a8360 2023-10-14T09:17:30.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 -- 172.21.15.78:0/2823903132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d10148ed0 con 0x7f7d100a8360 2023-10-14T09:17:30.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d067fc640 1 -- 172.21.15.78:0/2823903132 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00007de0 con 0x7f7d100a8360 2023-10-14T09:17:30.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.645+0000 7f7d18232640 1 -- 172.21.15.78:0/2823903132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1014c6c0 con 0x7f7d100a8360 2023-10-14T09:17:30.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.649+0000 7f7d18232640 1 -- 172.21.15.78:0/2823903132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d10074180 con 0x7f7d100a8360 2023-10-14T09:17:30.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.649+0000 7f7d067fc640 1 -- 172.21.15.78:0/2823903132 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7d000113f0 con 0x7f7d100a8360 2023-10-14T09:17:30.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.649+0000 7f7d067fc640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7cf40664a0 0x7f7cf4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.649+0000 7f7d067fc640 1 -- 172.21.15.78:0/2823903132 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d00083f50 con 0x7f7d100a8360 2023-10-14T09:17:30.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.649+0000 7f7d15fce640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7cf40664a0 0x7f7cf4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.649+0000 7f7d15fce640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7cf40664a0 0x7f7cf4068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c000f70 tx=0x7f7d0c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:30.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.653+0000 7f7d067fc640 1 -- 172.21.15.78:0/2823903132 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d00051470 con 0x7f7d100a8360 2023-10-14T09:17:30.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 -- 172.21.15.78:0/2823903132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d100c0e80 con 0x7f7d100a8360 2023-10-14T09:17:30.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d067fc640 1 -- 172.21.15.78:0/2823903132 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f7d00054a90 con 0x7f7d100a8360 2023-10-14T09:17:30.810 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:30.811 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 -- 172.21.15.78:0/2823903132 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7cf40664a0 msgr2=0x7f7cf4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7cf40664a0 0x7f7cf4068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c000f70 tx=0x7f7d0c009040 comp rx=0 tx=0).stop 2023-10-14T09:17:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 -- 172.21.15.78:0/2823903132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d100a8360 msgr2=0x7f7d1014c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d100a8360 0x7f7d1014c180 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000c7f0 tx=0x7f7d0000ccb0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 -- 172.21.15.78:0/2823903132 shutdown_connections 2023-10-14T09:17:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7d1013b050 0x7f7d101efda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d100a8360 0x7f7d1014c180 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7cf40664a0 0x7f7cf4068960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 --2- 172.21.15.78:0/2823903132 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7d1006cd70 0x7f7d10131ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 -- 172.21.15.78:0/2823903132 >> 172.21.15.78:0/2823903132 conn(0x7f7d100c1cc0 msgr2=0x7f7d100aa990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 -- 172.21.15.78:0/2823903132 shutdown_connections 2023-10-14T09:17:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.805+0000 7f7d18232640 1 -- 172.21.15.78:0/2823903132 wait complete. 2023-10-14T09:17:30.831 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T09:17:30.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:30.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.961+0000 7f8693765640 1 Processor -- start 2023-10-14T09:17:30.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.961+0000 7f8693765640 1 -- start start 2023-10-14T09:17:30.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8693765640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f868c070110 0x7f868c071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8693765640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f868c158e10 0x7f868c0bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8693765640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c158980 con 0x7f868c06d640 2023-10-14T09:17:30.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8693765640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c1580b0 con 0x7f868c158e10 2023-10-14T09:17:30.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8693765640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c06db40 con 0x7f868c070110 2023-10-14T09:17:30.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8690d00640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f868c06d640 0x7f868c155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33846/0 (socket says 172.21.15.78:33846) 2023-10-14T09:17:30.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8690d00640 1 -- 172.21.15.78:0/1885120396 learned_addr learned my addr 172.21.15.78:0/1885120396 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:30.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8691501640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f868c070110 0x7f868c071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8691d02640 1 --2- 172.21.15.78:0/1885120396 >> v2:172.21.15.157:3300/0 conn(0x7f868c158e10 0x7f868c0bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226528005 0 0) 0x7f868c158980 con 0x7f868c06d640 2023-10-14T09:17:30.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8678003530 con 0x7f868c06d640 2023-10-14T09:17:30.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2678348770 0 0) 0x7f8678003530 con 0x7f868c06d640 2023-10-14T09:17:30.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f868c070110 msgr2=0x7f868c071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:30.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f868c070110 0x7f868c071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 >> v2:172.21.15.157:3300/0 conn(0x7f868c158e10 msgr2=0x7f868c0bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:30.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 --2- 172.21.15.78:0/1885120396 >> v2:172.21.15.157:3300/0 conn(0x7f868c158e10 0x7f868c0bfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c158330 con 0x7f868c06d640 2023-10-14T09:17:30.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f867c001680 con 0x7f868c06d640 2023-10-14T09:17:30.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8691501640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f868c070110 0x7f868c071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:30.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 >> v1:172.21.15.78:6789/0 conn(0x7f868c06d640 legacy=0x7f868c155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8678003980 0x7f8678003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86780047d0 0x7f8678004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f868c070110 0x7f8678005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c1580b0 con 0x7f86780047d0 2023-10-14T09:17:30.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c06db40 con 0x7f8678003980 2023-10-14T09:17:30.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867800b990 con 0x7f868c070110 2023-10-14T09:17:30.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8690d00640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86780047d0 0x7f8678004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8691501640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8678003980 0x7f8678003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8691d02640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f868c070110 0x7f8678005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8690d00640 1 -- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f868c070110 msgr2=0x7f8678005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:30.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8690d00640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f868c070110 0x7f8678005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8690d00640 1 -- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8678003980 msgr2=0x7f8678003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:30.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8690d00640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8678003980 0x7f8678003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8690d00640 1 -- 172.21.15.78:0/1885120396 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8688009420 con 0x7f86780047d0 2023-10-14T09:17:30.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.965+0000 7f8691d02640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f868c070110 0x7f8678005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:30.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8690d00640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86780047d0 0x7f8678004c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f867c00c240 tx=0x7f867c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68a5540ada00249 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:30.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0a8d00 con 0x7f86780047d0 2023-10-14T09:17:30.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c0a8e60 con 0x7f86780047d0 2023-10-14T09:17:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8683fff640 1 -- 172.21.15.78:0/1885120396 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c005ae0 con 0x7f86780047d0 2023-10-14T09:17:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8693765640 1 -- 172.21.15.78:0/1885120396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86780047d0 msgr2=0x7f8678004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8693765640 1 --2- 172.21.15.78:0/1885120396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86780047d0 0x7f8678004c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f867c00c240 tx=0x7f867c01f3d0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8691d02640 1 -- 172.21.15.78:0/1885120396 reap_dead start 2023-10-14T09:17:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8693765640 1 -- 172.21.15.78:0/1885120396 shutdown_connections 2023-10-14T09:17:30.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8693765640 1 -- 172.21.15.78:0/1885120396 >> 172.21.15.78:0/1885120396 conn(0x7f868c0c1cc0 msgr2=0x7f868c0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8693765640 1 -- 172.21.15.78:0/1885120396 shutdown_connections 2023-10-14T09:17:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8693765640 1 -- 172.21.15.78:0/1885120396 wait complete. 2023-10-14T09:17:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.969+0000 7f8693765640 1 Processor -- start 2023-10-14T09:17:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8693765640 1 -- start start 2023-10-14T09:17:30.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8693765640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780047d0 0x7f868c0c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8693765640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c147ab0 0x7f868c0aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8693765640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f868c0ab190 0x7f868c0a8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8693765640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0aae40 con 0x7f868c147ab0 2023-10-14T09:17:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8693765640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c1ed520 con 0x7f868c0ab190 2023-10-14T09:17:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8693765640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c1ed7c0 con 0x7f86780047d0 2023-10-14T09:17:30.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8690d00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c147ab0 0x7f868c0aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8690d00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c147ab0 0x7f868c0aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39012/0 (socket says 172.21.15.78:39012) 2023-10-14T09:17:30.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8690d00640 1 -- 172.21.15.78:0/945758903 learned_addr learned my addr 172.21.15.78:0/945758903 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:30.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8691501640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780047d0 0x7f868c0c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8691d02640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f868c0ab190 0x7f868c0a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8690d00640 1 -- 172.21.15.78:0/945758903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780047d0 msgr2=0x7f868c0c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8690d00640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780047d0 0x7f868c0c2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8690d00640 1 -- 172.21.15.78:0/945758903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f868c0ab190 msgr2=0x7f868c0a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8690d00640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f868c0ab190 0x7f868c0a8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8690d00640 1 -- 172.21.15.78:0/945758903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c155d90 con 0x7f868c147ab0 2023-10-14T09:17:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8690d00640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c147ab0 0x7f868c0aa330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f867c0ae040 tx=0x7f8678005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8681ffb640 1 -- 172.21.15.78:0/945758903 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0049f0 con 0x7f868c147ab0 2023-10-14T09:17:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8681ffb640 1 -- 172.21.15.78:0/945758903 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c0b6070 con 0x7f868c147ab0 2023-10-14T09:17:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8681ffb640 1 -- 172.21.15.78:0/945758903 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c004db0 con 0x7f868c147ab0 2023-10-14T09:17:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8693765640 1 -- 172.21.15.78:0/945758903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c0aab80 con 0x7f868c147ab0 2023-10-14T09:17:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8693765640 1 -- 172.21.15.78:0/945758903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c1476b0 con 0x7f868c147ab0 2023-10-14T09:17:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.973+0000 7f8693765640 1 -- 172.21.15.78:0/945758903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c1478a0 con 0x7f868c147ab0 2023-10-14T09:17:30.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.977+0000 7f8681ffb640 1 -- 172.21.15.78:0/945758903 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f867c007070 con 0x7f868c147ab0 2023-10-14T09:17:30.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.977+0000 7f8681ffb640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f86700664a0 0x7f8670068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:30.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.977+0000 7f8681ffb640 1 -- 172.21.15.78:0/945758903 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f867c0b8070 con 0x7f868c147ab0 2023-10-14T09:17:30.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.977+0000 7f8691501640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f86700664a0 0x7f8670068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:30.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.977+0000 7f8691501640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f86700664a0 0x7f8670068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86880093f0 tx=0x7f8688008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:30.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:30.981+0000 7f8681ffb640 1 -- 172.21.15.78:0/945758903 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f867c0ee540 con 0x7f868c147ab0 2023-10-14T09:17:31.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.133+0000 7f8693765640 1 -- 172.21.15.78:0/945758903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f868c155be0 con 0x7f868c147ab0 2023-10-14T09:17:31.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.133+0000 7f8681ffb640 1 -- 172.21.15.78:0/945758903 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f867c0c2020 con 0x7f868c147ab0 2023-10-14T09:17:31.140 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:31.141 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:31.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 -- 172.21.15.78:0/945758903 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f86700664a0 msgr2=0x7f8670068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f86700664a0 0x7f8670068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86880093f0 tx=0x7f8688008040 comp rx=0 tx=0).stop 2023-10-14T09:17:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 -- 172.21.15.78:0/945758903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c147ab0 msgr2=0x7f868c0aa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c147ab0 0x7f868c0aa330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f867c0ae040 tx=0x7f8678005800 comp rx=0 tx=0).stop 2023-10-14T09:17:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 -- 172.21.15.78:0/945758903 shutdown_connections 2023-10-14T09:17:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f868c0ab190 0x7f868c0a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c147ab0 0x7f868c0aa330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f86700664a0 0x7f8670068960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 --2- 172.21.15.78:0/945758903 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86780047d0 0x7f868c0c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 -- 172.21.15.78:0/945758903 >> 172.21.15.78:0/945758903 conn(0x7f868c0c1cc0 msgr2=0x7f868c1565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 -- 172.21.15.78:0/945758903 shutdown_connections 2023-10-14T09:17:31.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.137+0000 7f8693765640 1 -- 172.21.15.78:0/945758903 wait complete. 2023-10-14T09:17:31.161 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T09:17:31.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T09:17:31.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T09:17:31.163 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-14T09:17:31.163 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-14T09:17:31.164 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-14T09:17:31.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-14T09:17:31.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-14T09:17:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.401+0000 7f494f69c640 1 Processor -- start 2023-10-14T09:17:31.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.401+0000 7f494f69c640 1 -- start start 2023-10-14T09:17:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494f69c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4948158d00 0x7f49480c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494f69c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49480c4590 0x7f49481597b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494f69c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4948159cf0 0x7f494806a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494f69c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49480c54a0 con 0x7f4948159cf0 2023-10-14T09:17:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494f69c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49480c5140 con 0x7f4948158d00 2023-10-14T09:17:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494f69c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49480c8590 con 0x7f49480c4590 2023-10-14T09:17:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494dc39640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4948159cf0 0x7f494806a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494cc37640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49480c4590 0x7f49481597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494dc39640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4948159cf0 0x7f494806a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39024/0 (socket says 172.21.15.78:39024) 2023-10-14T09:17:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494dc39640 1 -- 172.21.15.78:0/3855119654 learned_addr learned my addr 172.21.15.78:0/3855119654 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494d438640 1 --2- 172.21.15.78:0/3855119654 >> v2:172.21.15.157:3300/0 conn(0x7f4948158d00 0x7f49480c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494dc39640 1 -- 172.21.15.78:0/3855119654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49480c4590 msgr2=0x7f49481597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494dc39640 1 --2- 172.21.15.78:0/3855119654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49480c4590 0x7f49481597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494dc39640 1 -- 172.21.15.78:0/3855119654 >> v2:172.21.15.157:3300/0 conn(0x7f4948158d00 msgr2=0x7f49480c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494dc39640 1 --2- 172.21.15.78:0/3855119654 >> v2:172.21.15.157:3300/0 conn(0x7f4948158d00 0x7f49480c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f494dc39640 1 -- 172.21.15.78:0/3855119654 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49480bc480 con 0x7f4948159cf0 2023-10-14T09:17:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f3f3bc6b640 1 Processor -- start 2023-10-14T09:17:31.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.405+0000 7f3f3bc6b640 1 -- start start 2023-10-14T09:17:31.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3bc6b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3f34153da0 0x7f3f341532d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3bc6b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3f34153810 0x7f3f340bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f39206640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3f34153da0 0x7f3f341532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3a208640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3f34153810 0x7f3f340bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3a208640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3f34153810 0x7f3f340bfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39038/0 (socket says 172.21.15.78:39038) 2023-10-14T09:17:31.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f39206640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3f34153da0 0x7f3f341532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:47926/0 (socket says 172.21.15.78:47926) 2023-10-14T09:17:31.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3a208640 1 -- 172.21.15.78:0/3936787887 learned_addr learned my addr 172.21.15.78:0/3936787887 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/3936787887 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f340706c0 con 0x7f3f34149cf0 2023-10-14T09:17:31.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/3936787887 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3406c8f0 con 0x7f3f34153810 2023-10-14T09:17:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/3936787887 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f34070960 con 0x7f3f34153da0 2023-10-14T09:17:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3a208640 1 -- 172.21.15.78:0/3936787887 >> v2:172.21.15.157:3300/0 conn(0x7f3f34153da0 msgr2=0x7f3f341532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3a208640 1 --2- 172.21.15.78:0/3936787887 >> v2:172.21.15.157:3300/0 conn(0x7f3f34153da0 0x7f3f341532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3a208640 1 -- 172.21.15.78:0/3936787887 >> v1:172.21.15.157:6789/0 conn(0x7f3f34149cf0 legacy=0x7f3f3406fc10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:17:31.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f3f3a208640 1 -- 172.21.15.78:0/3936787887 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3406cb90 con 0x7f3f34153810 2023-10-14T09:17:31.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.409+0000 7f494dc39640 1 --2- 172.21.15.78:0/3855119654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4948159cf0 0x7f494806a730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f49480ac1a0 tx=0x7f494001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932b1332154884f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f31252ad640 1 Processor -- start 2023-10-14T09:17:31.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f31252ad640 1 -- start start 2023-10-14T09:17:31.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f493ffff640 1 -- 172.21.15.78:0/3855119654 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49400a5820 con 0x7f4948159cf0 2023-10-14T09:17:31.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f493ffff640 1 -- 172.21.15.78:0/3855119654 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49400a5980 con 0x7f4948159cf0 2023-10-14T09:17:31.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f493ffff640 1 -- 172.21.15.78:0/3855119654 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49400a5d10 con 0x7f4948159cf0 2023-10-14T09:17:31.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f31252ad640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f312013ce70 0x7f3120071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f3f3a208640 1 --2- 172.21.15.78:0/3936787887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f34153810 0x7f3f340bfbc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f3406f1c0 tx=0x7f3f2c01ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aad9207a7e7c256 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f494f69c640 1 -- 172.21.15.78:0/3855119654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4948159cf0 msgr2=0x7f494806a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f494f69c640 1 --2- 172.21.15.78:0/3855119654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4948159cf0 0x7f494806a730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f49480ac1a0 tx=0x7f494001c9e0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f311ffff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f312013ce70 0x7f3120071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f311ffff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f312013ce70 0x7f3120071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:47942/0 (socket says 172.21.15.78:47942) 2023-10-14T09:17:31.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f311ffff640 1 -- 172.21.15.78:0/2837758813 learned_addr learned my addr 172.21.15.78:0/2837758813 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f31252ad640 1 -- 172.21.15.78:0/2837758813 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312013d250 con 0x7f3120154830 2023-10-14T09:17:31.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f31252ad640 1 -- 172.21.15.78:0/2837758813 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3120070210 con 0x7f312006f9c0 2023-10-14T09:17:31.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f31252ad640 1 -- 172.21.15.78:0/2837758813 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3120153b40 con 0x7f312013ce70 2023-10-14T09:17:31.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f494f69c640 1 -- 172.21.15.78:0/3855119654 shutdown_connections 2023-10-14T09:17:31.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f494f69c640 1 --2- 172.21.15.78:0/3855119654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4948159cf0 0x7f494806a730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f494f69c640 1 --2- 172.21.15.78:0/3855119654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f49480c4590 0x7f49481597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f494f69c640 1 --2- 172.21.15.78:0/3855119654 >> v2:172.21.15.157:3300/0 conn(0x7f4948158d00 0x7f49480c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.413+0000 7f494f69c640 1 -- 172.21.15.78:0/3855119654 >> 172.21.15.78:0/3855119654 conn(0x7f49480c6060 msgr2=0x7f49480c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654982656 0 0) 0x7f3120070210 con 0x7f312006f9c0 2023-10-14T09:17:31.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f3f38a05640 1 -- 172.21.15.78:0/3936787887 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00b2d0 con 0x7f3f34153810 2023-10-14T09:17:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f310c003530 con 0x7f312006f9c0 2023-10-14T09:17:31.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f3f38a05640 1 -- 172.21.15.78:0/3936787887 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c00b430 con 0x7f3f34153810 2023-10-14T09:17:31.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f3f38a05640 1 -- 172.21.15.78:0/3936787887 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0a7a70 con 0x7f3f34153810 2023-10-14T09:17:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645850498 0 0) 0x7f312013d250 con 0x7f3120154830 2023-10-14T09:17:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3120070210 con 0x7f3120154830 2023-10-14T09:17:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2202316127 0 0) 0x7f310c003530 con 0x7f312006f9c0 2023-10-14T09:17:31.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 >> v2:172.21.15.157:3300/0 conn(0x7f312013ce70 msgr2=0x7f3120071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 --2- 172.21.15.78:0/2837758813 >> v2:172.21.15.157:3300/0 conn(0x7f312013ce70 0x7f3120071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 >> v1:172.21.15.78:6789/0 conn(0x7f3120154830 legacy=0x7f312006cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312006ff30 con 0x7f312006f9c0 2023-10-14T09:17:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f3108001680 con 0x7f312006f9c0 2023-10-14T09:17:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 >> v1:172.21.15.157:6789/0 conn(0x7f312006f9c0 legacy=0x7f31200bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 --2- 172.21.15.78:0/2837758813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f310c004bc0 0x7f310c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 --2- 172.21.15.78:0/2837758813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f310c003770 0x7f310c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 --2- 172.21.15.78:0/2837758813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f310c004130 0x7f310c0141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3120153b40 con 0x7f310c003770 2023-10-14T09:17:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c014870 con 0x7f310c004130 2023-10-14T09:17:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c014a30 con 0x7f310c004bc0 2023-10-14T09:17:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f3124aac640 1 --2- 172.21.15.78:0/2837758813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f310c004130 0x7f310c0141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f494f69c640 1 -- 172.21.15.78:0/3855119654 shutdown_connections 2023-10-14T09:17:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f494f69c640 1 -- 172.21.15.78:0/3855119654 wait complete. 2023-10-14T09:17:31.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f494f69c640 1 Processor -- start 2023-10-14T09:17:31.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f98ab59e640 1 Processor -- start 2023-10-14T09:17:31.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311ffff640 1 --2- 172.21.15.78:0/2837758813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f310c004bc0 0x7f310c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f311f7fe640 1 --2- 172.21.15.78:0/2837758813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f310c003770 0x7f310c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f3124aac640 1 -- 172.21.15.78:0/2837758813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f310c004bc0 msgr2=0x7f310c004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f3124aac640 1 --2- 172.21.15.78:0/2837758813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f310c004bc0 0x7f310c004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f3124aac640 1 -- 172.21.15.78:0/2837758813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f310c003770 msgr2=0x7f310c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f3124aac640 1 --2- 172.21.15.78:0/2837758813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f310c003770 0x7f310c003bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f3124aac640 1 -- 172.21.15.78:0/2837758813 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312006ff30 con 0x7f310c004130 2023-10-14T09:17:31.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7fdfee4d6640 1 Processor -- start 2023-10-14T09:17:31.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f494f69c640 1 -- start start 2023-10-14T09:17:31.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/3936787887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f34153810 msgr2=0x7f3f340bfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f3f3bc6b640 1 --2- 172.21.15.78:0/3936787887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f34153810 0x7f3f340bfbc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f3406f1c0 tx=0x7f3f2c01ea70 comp rx=0 tx=0).stop 2023-10-14T09:17:31.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.417+0000 7f98ab59e640 1 -- start start 2023-10-14T09:17:31.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7fdfee4d6640 1 -- start start 2023-10-14T09:17:31.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f86703d9640 1 Processor -- start 2023-10-14T09:17:31.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/3936787887 shutdown_connections 2023-10-14T09:17:31.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f3f3bc6b640 1 --2- 172.21.15.78:0/3936787887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f34153810 0x7f3f340bfbc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f3f3bc6b640 1 --2- 172.21.15.78:0/3936787887 >> v2:172.21.15.157:3300/0 conn(0x7f3f34153da0 0x7f3f341532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/3936787887 >> 172.21.15.78:0/3936787887 conn(0x7f3f340c1cc0 msgr2=0x7f3f340c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f86703d9640 1 -- start start 2023-10-14T09:17:31.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98ab59e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f98ac06cca0 0x7f98ac158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f494f69c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49480c4590 0x7f49481612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f494f69c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4948158d00 0x7f49480707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98ab59e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0bf9c0 0x7f98ac070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98ab59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98ac0707a0 0x7f98ac14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98ab59e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac158f40 con 0x7f98ac0707a0 2023-10-14T09:17:31.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98ab59e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac071130 con 0x7f98ac06cca0 2023-10-14T09:17:31.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98ab59e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac071410 con 0x7f98ac0bf9c0 2023-10-14T09:17:31.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f494f69c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4948159cf0 0x7f4948070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98a9d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0bf9c0 0x7f98ac070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98a9d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0bf9c0 0x7f98ac070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37178/0 (socket says 172.21.15.78:37178) 2023-10-14T09:17:31.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98a9d9b640 1 -- 172.21.15.78:0/480184063 learned_addr learned my addr 172.21.15.78:0/480184063 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f0030646640 1 Processor -- start 2023-10-14T09:17:31.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f494d438640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49480c4590 0x7f49481612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f494d438640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49480c4590 0x7f49481612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:47976/0 (socket says 172.21.15.78:47976) 2023-10-14T09:17:31.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f494d438640 1 -- 172.21.15.78:0/2135155059 learned_addr learned my addr 172.21.15.78:0/2135155059 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f494cc37640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4948158d00 0x7f49480707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49481fd3f0 con 0x7f4948159cf0 2023-10-14T09:17:31.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49481fc520 con 0x7f49480c4590 2023-10-14T09:17:31.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98aa59c640 1 --2- 172.21.15.78:0/480184063 >> v2:172.21.15.157:3300/0 conn(0x7f98ac06cca0 0x7f98ac158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7fdfee4d6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdfe8149cf0 0x7fdfe806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7fdfee4d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdfe8153da0 0x7fdfe81532d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f0030646640 1 -- start start 2023-10-14T09:17:31.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98a9d9b640 1 -- 172.21.15.78:0/480184063 >> v2:172.21.15.157:3300/0 conn(0x7f98ac06cca0 msgr2=0x7f98ac158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98a9d9b640 1 --2- 172.21.15.78:0/480184063 >> v2:172.21.15.157:3300/0 conn(0x7f98ac06cca0 0x7f98ac158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98a9d9b640 1 -- 172.21.15.78:0/480184063 >> v2:172.21.15.78:3300/0 conn(0x7f98ac0707a0 msgr2=0x7f98ac14e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98a9d9b640 1 --2- 172.21.15.78:0/480184063 >> v2:172.21.15.78:3300/0 conn(0x7f98ac0707a0 0x7f98ac14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f98a9d9b640 1 -- 172.21.15.78:0/480184063 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0716f0 con 0x7f98ac0bf9c0 2023-10-14T09:17:31.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4948158360 con 0x7f4948158d00 2023-10-14T09:17:31.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7fdfee4d6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe80706c0 con 0x7fdfe8153810 2023-10-14T09:17:31.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7fdfe7fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdfe8149cf0 0x7fdfe806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7fdfe7fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdfe8149cf0 0x7fdfe806fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:47986/0 (socket says 172.21.15.78:47986) 2023-10-14T09:17:31.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7fdfe7fff640 1 -- 172.21.15.78:0/3515242453 learned_addr learned my addr 172.21.15.78:0/3515242453 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7fdfee4d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe806c8f0 con 0x7fdfe8153da0 2023-10-14T09:17:31.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7fdfee4d6640 1 -- 172.21.15.78:0/3515242453 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe8070960 con 0x7fdfe8149cf0 2023-10-14T09:17:31.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f86703d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8668149cf0 0x7f866806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.421+0000 7f86703d9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8668153da0 0x7f86681532d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f494cc37640 1 -- 172.21.15.78:0/2135155059 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49480c4590 msgr2=0x7f49481612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f494cc37640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49480c4590 0x7f49481612b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f494cc37640 1 -- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4948159cf0 msgr2=0x7f4948070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f494dc39640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4948159cf0 0x7f4948070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f86703d9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86680706c0 con 0x7f8668153810 2023-10-14T09:17:31.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f86703d9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866806c8f0 con 0x7f8668153da0 2023-10-14T09:17:31.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f86703d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8668070960 con 0x7f8668149cf0 2023-10-14T09:17:31.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7fdfe7fff640 1 -- 172.21.15.78:0/3515242453 >> v2:172.21.15.78:3300/0 conn(0x7fdfe8153da0 msgr2=0x7fdfe81532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7fdfe7fff640 1 --2- 172.21.15.78:0/3515242453 >> v2:172.21.15.78:3300/0 conn(0x7fdfe8153da0 0x7fdfe81532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7fdfe7fff640 1 -- 172.21.15.78:0/3515242453 >> v1:172.21.15.78:6789/0 conn(0x7fdfe8153810 legacy=0x7fdfe80bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866e175640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8668149cf0 0x7f866806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866e976640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f8668153810 0x7f86680bfbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51674/0 (socket says 172.21.15.78:51674) 2023-10-14T09:17:31.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866e976640 1 -- 172.21.15.78:0/2418315273 learned_addr learned my addr 172.21.15.78:0/2418315273 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:31.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7fdfe7fff640 1 -- 172.21.15.78:0/3515242453 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe806cb90 con 0x7fdfe8149cf0 2023-10-14T09:17:31.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f7445b2a640 1 Processor -- start 2023-10-14T09:17:31.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f494cc37640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4948159cf0 0x7f4948070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f494cc37640 1 -- 172.21.15.78:0/2135155059 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4940009b30 con 0x7f4948158d00 2023-10-14T09:17:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f494d438640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49480c4590 0x7f49481612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/3936787887 shutdown_connections 2023-10-14T09:17:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/3936787887 wait complete. 2023-10-14T09:17:31.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f3124aac640 1 -- 172.21.15.78:0/2837758813 reap_dead start 2023-10-14T09:17:31.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f3124aac640 1 --2- 172.21.15.78:0/2837758813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f310c004130 0x7f310c0141a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f310800c160 tx=0x7f310801cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0869ab408162a01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f0030646640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00200e26e0 0x7f00200debe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f0030646640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0020051f50 0x7f00200df120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f7445b2a640 1 -- start start 2023-10-14T09:17:31.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f494dc39640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4948159cf0 0x7f4948070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:31.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f0030646640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00200df660 con 0x7f0020039570 2023-10-14T09:17:31.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f0030646640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0020052670 con 0x7f0020051f50 2023-10-14T09:17:31.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f0030646640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00200de6e0 con 0x7f00200e26e0 2023-10-14T09:17:31.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866d173640 1 -- 172.21.15.78:0/2418315273 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700754132 0 0) 0x7f86680706c0 con 0x7f8668153810 2023-10-14T09:17:31.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866d173640 1 -- 172.21.15.78:0/2418315273 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8654003530 con 0x7f8668153810 2023-10-14T09:17:31.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f494cc37640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4948158d00 0x7f49480707c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f493800d520 tx=0x7f493800d9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f002e3e2640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0020039570 0x7f0020035af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51684/0 (socket says 172.21.15.78:51684) 2023-10-14T09:17:31.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f002e3e2640 1 -- 172.21.15.78:0/3942025810 learned_addr learned my addr 172.21.15.78:0/3942025810 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:31.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080a5820 con 0x7f310c004130 2023-10-14T09:17:31.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31080a5980 con 0x7f310c004130 2023-10-14T09:17:31.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f311effd640 1 -- 172.21.15.78:0/2837758813 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080a5d30 con 0x7f310c004130 2023-10-14T09:17:31.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f002ebe3640 1 --2- 172.21.15.78:0/3942025810 >> v2:172.21.15.78:3300/0 conn(0x7f0020051f50 0x7f00200df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f002dbe1640 1 --2- 172.21.15.78:0/3942025810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00200e26e0 0x7f00200debe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866d974640 1 --2- 172.21.15.78:0/2418315273 >> v2:172.21.15.78:3300/0 conn(0x7f8668153da0 0x7f86681532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866e175640 1 -- 172.21.15.78:0/2418315273 >> v2:172.21.15.78:3300/0 conn(0x7f8668153da0 msgr2=0x7f86681532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866d173640 1 -- 172.21.15.78:0/2418315273 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3259499156 0 0) 0x7f8654003530 con 0x7f8668153810 2023-10-14T09:17:31.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866e175640 1 --2- 172.21.15.78:0/2418315273 >> v2:172.21.15.78:3300/0 conn(0x7f8668153da0 0x7f86681532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866e175640 1 -- 172.21.15.78:0/2418315273 >> v1:172.21.15.157:6789/0 conn(0x7f8668153810 legacy=0x7f86680bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866e175640 1 -- 172.21.15.78:0/2418315273 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866806cb90 con 0x7f8668149cf0 2023-10-14T09:17:31.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f493dffb640 1 -- 172.21.15.78:0/2135155059 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4938014620 con 0x7f4948158d00 2023-10-14T09:17:31.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f493dffb640 1 -- 172.21.15.78:0/2135155059 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4938014780 con 0x7f4948158d00 2023-10-14T09:17:31.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f493dffb640 1 -- 172.21.15.78:0/2135155059 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4938014b30 con 0x7f4948158d00 2023-10-14T09:17:31.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f3f3bc6b640 1 Processor -- start 2023-10-14T09:17:31.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f31252ad640 1 -- 172.21.15.78:0/2837758813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f310c004130 msgr2=0x7f310c0141a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f31252ad640 1 --2- 172.21.15.78:0/2837758813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f310c004130 0x7f310c0141a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f310800c160 tx=0x7f310801cb20 comp rx=0 tx=0).stop 2023-10-14T09:17:31.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f002dbe1640 1 -- 172.21.15.78:0/3942025810 >> v2:172.21.15.78:3300/0 conn(0x7f0020051f50 msgr2=0x7f00200df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f002d3e0640 1 -- 172.21.15.78:0/3942025810 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596056186 0 0) 0x7f00200df660 con 0x7f0020039570 2023-10-14T09:17:31.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f002dbe1640 1 --2- 172.21.15.78:0/3942025810 >> v2:172.21.15.78:3300/0 conn(0x7f0020051f50 0x7f00200df120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f002dbe1640 1 -- 172.21.15.78:0/3942025810 >> v1:172.21.15.157:6789/0 conn(0x7f0020039570 legacy=0x7f0020035af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f002dbe1640 1 -- 172.21.15.78:0/3942025810 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200e2be0 con 0x7f00200e26e0 2023-10-14T09:17:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f002ebe3640 1 --2- 172.21.15.78:0/3942025810 >> v2:172.21.15.78:3300/0 conn(0x7f0020051f50 0x7f00200df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f866d974640 1 --2- 172.21.15.78:0/2418315273 >> v2:172.21.15.78:3300/0 conn(0x7f8668153da0 0x7f86681532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:31.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f7445b2a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7440157370 0x7f74401549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f7445b2a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74400bedc0 con 0x7f74400be570 2023-10-14T09:17:31.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f7445b2a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74401578e0 con 0x7f74400be950 2023-10-14T09:17:31.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f7445b2a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744006ffd0 con 0x7f7440157370 2023-10-14T09:17:31.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f743ffff640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f74400be950 0x7f7440071830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51694/0 (socket says 172.21.15.78:51694) 2023-10-14T09:17:31.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f743ffff640 1 -- 172.21.15.78:0/1491785536 learned_addr learned my addr 172.21.15.78:0/1491785536 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:31.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f743effd640 1 --2- 172.21.15.78:0/1491785536 >> v2:172.21.15.157:3300/0 conn(0x7f7440157370 0x7f74401549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f3f3bc6b640 1 -- start start 2023-10-14T09:17:31.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f743e7fc640 1 -- 172.21.15.78:0/1491785536 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148199842 0 0) 0x7f74401578e0 con 0x7f74400be950 2023-10-14T09:17:31.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f743e7fc640 1 -- 172.21.15.78:0/1491785536 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7428003530 con 0x7f74400be950 2023-10-14T09:17:31.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.425+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49481fc770 con 0x7f4948158d00 2023-10-14T09:17:31.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f743effd640 1 -- 172.21.15.78:0/1491785536 >> v1:172.21.15.157:6789/0 conn(0x7f74400be950 legacy=0x7f7440071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f743effd640 1 -- 172.21.15.78:0/1491785536 >> v1:172.21.15.78:6789/0 conn(0x7f74400be570 legacy=0x7f7440071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f743effd640 1 -- 172.21.15.78:0/1491785536 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7440157bc0 con 0x7f7440157370 2023-10-14T09:17:31.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f3bc6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f34149cf0 0x7f3f341fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49481fcd30 con 0x7f4948158d00 2023-10-14T09:17:31.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f3bc6b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f34153810 0x7f3f341fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f98a9d9b640 1 --2- 172.21.15.78:0/480184063 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0bf9c0 0x7f98ac070260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f98ac06d540 tx=0x7f98a401c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd3076aefceb7e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f3bc6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f34153da0 0x7f3f341fa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f39206640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f34153810 0x7f3f341fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7fdfe7fff640 1 --2- 172.21.15.78:0/3515242453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfe8149cf0 0x7fdfe806fc10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdfe806f210 tx=0x7fdfd801c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed6fa6b8c49a6084 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f39206640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f34153810 0x7f3f341fa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48012/0 (socket says 172.21.15.78:48012) 2023-10-14T09:17:31.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f39206640 1 -- 172.21.15.78:0/1509413000 learned_addr learned my addr 172.21.15.78:0/1509413000 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f31252ad640 1 -- 172.21.15.78:0/2837758813 shutdown_connections 2023-10-14T09:17:31.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f31252ad640 1 --2- 172.21.15.78:0/2837758813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f310c004130 0x7f310c0141a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f31252ad640 1 -- 172.21.15.78:0/2837758813 >> 172.21.15.78:0/2837758813 conn(0x7f31200c1ac0 msgr2=0x7f31200c1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f3a208640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f34153da0 0x7f3f341fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f39a07640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f34149cf0 0x7f3f341fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/1509413000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f340aacc0 con 0x7f3f34149cf0 2023-10-14T09:17:31.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f98a959a640 1 -- 172.21.15.78:0/480184063 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40a5820 con 0x7f98ac0bf9c0 2023-10-14T09:17:31.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/1509413000 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f341faa80 con 0x7f3f34153810 2023-10-14T09:17:31.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/1509413000 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f341fd030 con 0x7f3f34153da0 2023-10-14T09:17:31.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f98a959a640 1 -- 172.21.15.78:0/480184063 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a40a5980 con 0x7f98ac0bf9c0 2023-10-14T09:17:31.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7fdfe6ffd640 1 -- 172.21.15.78:0/3515242453 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd80ab610 con 0x7fdfe8149cf0 2023-10-14T09:17:31.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7fdfe6ffd640 1 -- 172.21.15.78:0/3515242453 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd80ab770 con 0x7fdfe8149cf0 2023-10-14T09:17:31.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7fdfe6ffd640 1 -- 172.21.15.78:0/3515242453 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd80abb00 con 0x7fdfe8149cf0 2023-10-14T09:17:31.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f98a959a640 1 -- 172.21.15.78:0/480184063 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40a5d10 con 0x7f98ac0bf9c0 2023-10-14T09:17:31.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f866e175640 1 --2- 172.21.15.78:0/2418315273 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8668149cf0 0x7f866806fc10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86600097c0 tx=0x7f866001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=538b79e005b0370b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f493dffb640 1 -- 172.21.15.78:0/2135155059 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4938014c90 con 0x7f4948158d00 2023-10-14T09:17:31.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49480c4e60 con 0x7f4948158d00 2023-10-14T09:17:31.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f39206640 1 -- 172.21.15.78:0/1509413000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f34153da0 msgr2=0x7f3f341fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f39206640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f34153da0 0x7f3f341fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f39206640 1 -- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f34149cf0 msgr2=0x7f3f341fcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f39206640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f34149cf0 0x7f3f341fcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f3f39206640 1 -- 172.21.15.78:0/1509413000 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c00bd40 con 0x7f3f34153810 2023-10-14T09:17:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f98ab59e640 1 -- 172.21.15.78:0/480184063 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0bf9c0 msgr2=0x7f98ac070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f98ab59e640 1 --2- 172.21.15.78:0/480184063 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0bf9c0 0x7f98ac070260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f98ac06d540 tx=0x7f98a401c9a0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7fdfee4d6640 1 -- 172.21.15.78:0/3515242453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfe8149cf0 msgr2=0x7fdfe806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7fdfee4d6640 1 --2- 172.21.15.78:0/3515242453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfe8149cf0 0x7fdfe806fc10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdfe806f210 tx=0x7fdfd801c4c0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f866d173640 1 -- 172.21.15.78:0/2418315273 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658001a00 con 0x7f8668149cf0 2023-10-14T09:17:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f31252ad640 1 -- 172.21.15.78:0/2837758813 shutdown_connections 2023-10-14T09:17:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.429+0000 7f31252ad640 1 -- 172.21.15.78:0/2837758813 wait complete. 2023-10-14T09:17:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f31252ad640 1 Processor -- start 2023-10-14T09:17:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f98ab59e640 1 -- 172.21.15.78:0/480184063 shutdown_connections 2023-10-14T09:17:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f98ab59e640 1 --2- 172.21.15.78:0/480184063 >> v2:172.21.15.78:3300/0 conn(0x7f98ac0707a0 0x7f98ac14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f98ab59e640 1 --2- 172.21.15.78:0/480184063 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0bf9c0 0x7f98ac070260 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f98ab59e640 1 --2- 172.21.15.78:0/480184063 >> v2:172.21.15.157:3300/0 conn(0x7f98ac06cca0 0x7f98ac158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f98ab59e640 1 -- 172.21.15.78:0/480184063 >> 172.21.15.78:0/480184063 conn(0x7f98ac0c1ac0 msgr2=0x7f98ac0c1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f98ab59e640 1 -- 172.21.15.78:0/480184063 shutdown_connections 2023-10-14T09:17:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f98ab59e640 1 -- 172.21.15.78:0/480184063 wait complete. 2023-10-14T09:17:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7fdfee4d6640 1 -- 172.21.15.78:0/3515242453 shutdown_connections 2023-10-14T09:17:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7fdfee4d6640 1 --2- 172.21.15.78:0/3515242453 >> v2:172.21.15.78:3300/0 conn(0x7fdfe8153da0 0x7fdfe81532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7fdfee4d6640 1 --2- 172.21.15.78:0/3515242453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfe8149cf0 0x7fdfe806fc10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7fdfee4d6640 1 -- 172.21.15.78:0/3515242453 >> 172.21.15.78:0/3515242453 conn(0x7fdfe80c1cc0 msgr2=0x7fdfe80c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7fdfee4d6640 1 -- 172.21.15.78:0/3515242453 shutdown_connections 2023-10-14T09:17:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7fdfee4d6640 1 -- 172.21.15.78:0/3515242453 wait complete. 2023-10-14T09:17:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f002dbe1640 1 --2- 172.21.15.78:0/3942025810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00200e26e0 0x7f00200debe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f00240097c0 tx=0x7f002401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f5cccfcedf1b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f002d3e0640 1 -- 172.21.15.78:0/3942025810 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240ac640 con 0x7f00200e26e0 2023-10-14T09:17:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f866d173640 1 -- 172.21.15.78:0/2418315273 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600a7050 con 0x7f8668149cf0 2023-10-14T09:17:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f866d173640 1 -- 172.21.15.78:0/2418315273 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600ab620 con 0x7f8668149cf0 2023-10-14T09:17:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f743effd640 1 --2- 172.21.15.78:0/1491785536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7440157370 0x7f74401549c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74300097c0 tx=0x7f743001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc8310c1af793eb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f743e7fc640 1 -- 172.21.15.78:0/1491785536 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300ad680 con 0x7f7440157370 2023-10-14T09:17:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f743e7fc640 1 -- 172.21.15.78:0/1491785536 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74300ad7e0 con 0x7f7440157370 2023-10-14T09:17:31.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f743e7fc640 1 -- 172.21.15.78:0/1491785536 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300adb70 con 0x7f7440157370 2023-10-14T09:17:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f002d3e0640 1 -- 172.21.15.78:0/3942025810 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00240ac7a0 con 0x7f00200e26e0 2023-10-14T09:17:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f002d3e0640 1 -- 172.21.15.78:0/3942025810 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240acb30 con 0x7f00200e26e0 2023-10-14T09:17:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f86703d9640 1 -- 172.21.15.78:0/2418315273 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8668149cf0 msgr2=0x7f866806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f86703d9640 1 --2- 172.21.15.78:0/2418315273 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8668149cf0 0x7f866806fc10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86600097c0 tx=0x7f866001c330 comp rx=0 tx=0).stop 2023-10-14T09:17:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f7445b2a640 1 -- 172.21.15.78:0/1491785536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7440157370 msgr2=0x7f74401549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f7445b2a640 1 --2- 172.21.15.78:0/1491785536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7440157370 0x7f74401549c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74300097c0 tx=0x7f743001c380 comp rx=0 tx=0).stop 2023-10-14T09:17:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f7445b2a640 1 -- 172.21.15.78:0/1491785536 shutdown_connections 2023-10-14T09:17:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f7445b2a640 1 --2- 172.21.15.78:0/1491785536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7440157370 0x7f74401549c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f7445b2a640 1 -- 172.21.15.78:0/1491785536 >> 172.21.15.78:0/1491785536 conn(0x7f74400c1cc0 msgr2=0x7f74400c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f493dffb640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f492c0664f0 0x7f492c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f493dffb640 1 -- 172.21.15.78:0/2135155059 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49380835b0 con 0x7f4948158d00 2023-10-14T09:17:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f493dffb640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] conn(0x7f492c06e710 0x7f492c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f493dffb640 1 -- 172.21.15.78:0/2135155059 --> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f492c0711e0 con 0x7f492c06e710 2023-10-14T09:17:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f493dffb640 1 -- 172.21.15.78:0/2135155059 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4938083900 con 0x7f4948158d00 2023-10-14T09:17:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f7445b2a640 1 -- 172.21.15.78:0/1491785536 shutdown_connections 2023-10-14T09:17:31.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f7445b2a640 1 -- 172.21.15.78:0/1491785536 wait complete. 2023-10-14T09:17:31.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f0030646640 1 -- 172.21.15.78:0/3942025810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00200e26e0 msgr2=0x7f00200debe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f0030646640 1 --2- 172.21.15.78:0/3942025810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00200e26e0 0x7f00200debe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f00240097c0 tx=0x7f002401c3e0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f494dc39640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] conn(0x7f492c06e710 0x7f492c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f3f39206640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f34153810 0x7f3f341fa000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400e870 tx=0x7f3f2400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f3f2a7fc640 1 -- 172.21.15.78:0/1509413000 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240094d0 con 0x7f3f34153810 2023-10-14T09:17:31.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f3f2a7fc640 1 -- 172.21.15.78:0/1509413000 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2400c940 con 0x7f3f34153810 2023-10-14T09:17:31.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f3f2a7fc640 1 -- 172.21.15.78:0/1509413000 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400ccd0 con 0x7f3f34153810 2023-10-14T09:17:31.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/1509413000 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f341fc3e0 con 0x7f3f34153810 2023-10-14T09:17:31.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/1509413000 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f341f8c20 con 0x7f3f34153810 2023-10-14T09:17:31.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f31252ad640 1 -- start start 2023-10-14T09:17:31.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f31252ad640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f310c004130 0x7f31200c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f31252ad640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f312006cea0 0x7f3120134640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f0030646640 1 -- 172.21.15.78:0/3942025810 shutdown_connections 2023-10-14T09:17:31.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f0030646640 1 --2- 172.21.15.78:0/3942025810 >> v2:172.21.15.78:3300/0 conn(0x7f0020051f50 0x7f00200df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f0030646640 1 --2- 172.21.15.78:0/3942025810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00200e26e0 0x7f00200debe0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f0030646640 1 -- 172.21.15.78:0/3942025810 >> 172.21.15.78:0/3942025810 conn(0x7f0020050ad0 msgr2=0x7f0020050ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7fdfee4d6640 1 Processor -- start 2023-10-14T09:17:31.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f494d438640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f492c0664f0 0x7f492c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f31252ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3120134b80 0x7f31200a8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f31252ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31200a8140 con 0x7f3120134b80 2023-10-14T09:17:31.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f31252ad640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31200aa0b0 con 0x7f310c004130 2023-10-14T09:17:31.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f31252ad640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31200c3d90 con 0x7f312006cea0 2023-10-14T09:17:31.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f312006cea0 0x7f3120134640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f311f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f312006cea0 0x7f3120134640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37234/0 (socket says 172.21.15.78:37234) 2023-10-14T09:17:31.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f311f7fe640 1 -- 172.21.15.78:0/351795347 learned_addr learned my addr 172.21.15.78:0/351795347 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f3124aac640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3120134b80 0x7f31200a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98ab59e640 1 Processor -- start 2023-10-14T09:17:31.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98ab59e640 1 -- start start 2023-10-14T09:17:31.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f7445b2a640 1 Processor -- start 2023-10-14T09:17:31.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfee4d6640 1 -- start start 2023-10-14T09:17:31.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f311ffff640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f310c004130 0x7f31200c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f86703d9640 1 -- 172.21.15.78:0/2418315273 shutdown_connections 2023-10-14T09:17:31.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f86703d9640 1 --2- 172.21.15.78:0/2418315273 >> v2:172.21.15.78:3300/0 conn(0x7f8668153da0 0x7f86681532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f86703d9640 1 --2- 172.21.15.78:0/2418315273 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8668149cf0 0x7f866806fc10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f86703d9640 1 -- 172.21.15.78:0/2418315273 >> 172.21.15.78:0/2418315273 conn(0x7f86680c1cc0 msgr2=0x7f86680c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f7445b2a640 1 -- start start 2023-10-14T09:17:31.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f86703d9640 1 -- 172.21.15.78:0/2418315273 shutdown_connections 2023-10-14T09:17:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f7445b2a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74400be570 0x7f7440134d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98ab59e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98ac06cca0 0x7f98ac1fc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f7445b2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74400be950 0x7f7440150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f7445b2a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7440157370 0x7f7440150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f7445b2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74401efec0 con 0x7f74400be950 2023-10-14T09:17:31.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f7445b2a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74401331d0 con 0x7f7440157370 2023-10-14T09:17:31.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98ab59e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0707a0 0x7f98ac155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f7445b2a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74401ef520 con 0x7f74400be570 2023-10-14T09:17:31.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98ab59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98ac0bf9c0 0x7f98ac14b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfee4d6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfe8149cf0 0x7fdfe81f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfee4d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8153810 0x7fdfe8142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfee4d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfe8153da0 0x7fdfe8142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfee4d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe81f4c40 con 0x7fdfe8153810 2023-10-14T09:17:31.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfee4d6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe81432c0 con 0x7fdfe8149cf0 2023-10-14T09:17:31.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfee4d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe81f4960 con 0x7fdfe8153da0 2023-10-14T09:17:31.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98ab59e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac1fcff0 con 0x7f98ac0bf9c0 2023-10-14T09:17:31.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98ab59e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac1582d0 con 0x7f98ac06cca0 2023-10-14T09:17:31.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98ab59e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac153680 con 0x7f98ac0707a0 2023-10-14T09:17:31.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f86703d9640 1 -- 172.21.15.78:0/2418315273 wait complete. 2023-10-14T09:17:31.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98a9d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0707a0 0x7f98ac155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f494d438640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f492c0664f0 0x7f492c0689b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4944009f70 tx=0x7f4944009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f743f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74400be570 0x7f7440134d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/1509413000 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3f340c0510 con 0x7f3f34153810 2023-10-14T09:17:31.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f743f7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74400be570 0x7f7440134d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37246/0 (socket says 172.21.15.78:37246) 2023-10-14T09:17:31.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f743f7fe640 1 -- 172.21.15.78:0/2809669631 learned_addr learned my addr 172.21.15.78:0/2809669631 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98aa59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98ac06cca0 0x7f98ac1fc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98aa59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98ac06cca0 0x7f98ac1fc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48028/0 (socket says 172.21.15.78:48028) 2023-10-14T09:17:31.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98aa59c640 1 -- 172.21.15.78:0/2211961495 learned_addr learned my addr 172.21.15.78:0/2211961495 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfeca73640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfe8153da0 0x7fdfe8142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfeca73640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfe8153da0 0x7fdfe8142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37266/0 (socket says 172.21.15.78:37266) 2023-10-14T09:17:31.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfeca73640 1 -- 172.21.15.78:0/55636964 learned_addr learned my addr 172.21.15.78:0/55636964 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f743ffff640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7440157370 0x7f7440150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfe7fff640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfe8149cf0 0x7fdfe81f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f0030646640 1 -- 172.21.15.78:0/3942025810 shutdown_connections 2023-10-14T09:17:31.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.433+0000 7f0030646640 1 -- 172.21.15.78:0/3942025810 wait complete. 2023-10-14T09:17:31.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f0030646640 1 Processor -- start 2023-10-14T09:17:31.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98a9d9b640 1 -- 172.21.15.78:0/2211961495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98ac06cca0 msgr2=0x7f98ac1fc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98a9d9b640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98ac06cca0 0x7f98ac1fc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98a9d9b640 1 -- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98ac0bf9c0 msgr2=0x7f98ac14b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98a9d9b640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98ac0bf9c0 0x7f98ac14b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f743f7fe640 1 -- 172.21.15.78:0/2809669631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7440157370 msgr2=0x7f7440150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f98a9d9b640 1 -- 172.21.15.78:0/2211961495 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a4009b30 con 0x7f98ac0707a0 2023-10-14T09:17:31.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f743f7fe640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7440157370 0x7f7440150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f743f7fe640 1 -- 172.21.15.78:0/2809669631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74400be950 msgr2=0x7f7440150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f743f7fe640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74400be950 0x7f7440150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f743f7fe640 1 -- 172.21.15.78:0/2809669631 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430009420 con 0x7f74400be570 2023-10-14T09:17:31.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f3124aac640 1 -- 172.21.15.78:0/351795347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f312006cea0 msgr2=0x7f3120134640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f3124aac640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f312006cea0 0x7f3120134640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f3124aac640 1 -- 172.21.15.78:0/351795347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f310c004130 msgr2=0x7f31200c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f3124aac640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f310c004130 0x7f31200c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f3124aac640 1 -- 172.21.15.78:0/351795347 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3120135030 con 0x7f3120134b80 2023-10-14T09:17:31.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfeca73640 1 -- 172.21.15.78:0/55636964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfe8149cf0 msgr2=0x7fdfe81f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f86703d9640 1 Processor -- start 2023-10-14T09:17:31.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfeca73640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfe8149cf0 0x7fdfe81f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfeca73640 1 -- 172.21.15.78:0/55636964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8153810 msgr2=0x7fdfe8142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfeca73640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfe8153810 0x7fdfe8142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7fdfeca73640 1 -- 172.21.15.78:0/55636964 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80094d0 con 0x7fdfe8153da0 2023-10-14T09:17:31.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f743f7fe640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74400be570 0x7f7440134d70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f743800ba50 tx=0x7f743800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7fdfeca73640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfe8153da0 0x7fdfe8142d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000c780 tx=0x7fdfe000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f98a9d9b640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0707a0 0x7f98ac155160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f98a40ab000 tx=0x7f98a4019740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7fdfe4ff9640 1 -- 172.21.15.78:0/55636964 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0003d90 con 0x7fdfe8153da0 2023-10-14T09:17:31.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7fdfe4ff9640 1 -- 172.21.15.78:0/55636964 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe000ce90 con 0x7fdfe8153da0 2023-10-14T09:17:31.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f311f7fe640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f312006cea0 0x7f3120134640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:31.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7fdfe4ff9640 1 -- 172.21.15.78:0/55636964 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00052b0 con 0x7fdfe8153da0 2023-10-14T09:17:31.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7fdfee4d6640 1 -- 172.21.15.78:0/55636964 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe815ced0 con 0x7fdfe8153da0 2023-10-14T09:17:31.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f7427fff640 1 -- 172.21.15.78:0/2809669631 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800cc10 con 0x7f74400be570 2023-10-14T09:17:31.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f7427fff640 1 -- 172.21.15.78:0/2809669631 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743800cd70 con 0x7f74400be570 2023-10-14T09:17:31.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f7427fff640 1 -- 172.21.15.78:0/2809669631 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438014680 con 0x7f74400be570 2023-10-14T09:17:31.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f7445b2a640 1 -- 172.21.15.78:0/2809669631 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74401ef800 con 0x7f74400be570 2023-10-14T09:17:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f989affd640 1 -- 172.21.15.78:0/2211961495 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40b8670 con 0x7f98ac0707a0 2023-10-14T09:17:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f989affd640 1 -- 172.21.15.78:0/2211961495 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a40b87d0 con 0x7f98ac0707a0 2023-10-14T09:17:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f989affd640 1 -- 172.21.15.78:0/2211961495 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40b8b60 con 0x7f98ac0707a0 2023-10-14T09:17:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f3124aac640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3120134b80 0x7f31200a8560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31200c1980 tx=0x7f310c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7fdfee4d6640 1 -- 172.21.15.78:0/55636964 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe80aa590 con 0x7fdfe8153da0 2023-10-14T09:17:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.437+0000 7f3f2a7fc640 1 -- 172.21.15.78:0/1509413000 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3f24013470 con 0x7f3f34153810 2023-10-14T09:17:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f3f2a7fc640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3f18066570 0x7f3f18068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f3f2a7fc640 1 -- 172.21.15.78:0/1509413000 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f24083ed0 con 0x7f3f34153810 2023-10-14T09:17:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f3f2a7fc640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] conn(0x7f3f1806e790 0x7f3f18070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f3f2a7fc640 1 -- 172.21.15.78:0/1509413000 --> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f18071260 con 0x7f3f1806e790 2023-10-14T09:17:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f3f2a7fc640 1 -- 172.21.15.78:0/1509413000 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f240864f0 con 0x7f3f34153810 2023-10-14T09:17:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f86703d9640 1 -- start start 2023-10-14T09:17:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f86703d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668149cf0 0x7f866814dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f86703d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8668153810 0x7f8668152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f86703d9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8668153da0 0x7f86681f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f86703d9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86681f4ef0 con 0x7f8668149cf0 2023-10-14T09:17:31.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f86703d9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668146bf0 con 0x7f8668153da0 2023-10-14T09:17:31.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f86703d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866814f620 con 0x7f8668153810 2023-10-14T09:17:31.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f0030646640 1 -- start start 2023-10-14T09:17:31.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866e976640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8668153da0 0x7f86681f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866e175640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668149cf0 0x7f866814dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866e976640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8668153da0 0x7f86681f3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48046/0 (socket says 172.21.15.78:48046) 2023-10-14T09:17:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866e976640 1 -- 172.21.15.78:0/2850626092 learned_addr learned my addr 172.21.15.78:0/2850626092 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f494dc39640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] conn(0x7f492c06e710 0x7f492c070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f98ab59e640 1 -- 172.21.15.78:0/2211961495 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac1fcd10 con 0x7f98ac0707a0 2023-10-14T09:17:31.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f98ab59e640 1 -- 172.21.15.78:0/2211961495 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac0aaf20 con 0x7f98ac0707a0 2023-10-14T09:17:31.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f7445b2a640 1 -- 172.21.15.78:0/2809669631 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7440151490 con 0x7f74400be570 2023-10-14T09:17:31.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7fdfee4d6640 1 -- 172.21.15.78:0/55636964 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdfe8070c40 con 0x7fdfe8153da0 2023-10-14T09:17:31.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f311cff9640 1 -- 172.21.15.78:0/351795347 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080b2070 con 0x7f3120134b80 2023-10-14T09:17:31.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f31252ad640 1 -- 172.21.15.78:0/351795347 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31200a7aa0 con 0x7f3120134b80 2023-10-14T09:17:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866d974640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8668153810 0x7f8668152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866e175640 1 -- 172.21.15.78:0/2850626092 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8668153810 msgr2=0x7f8668152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866e175640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8668153810 0x7f8668152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866e175640 1 -- 172.21.15.78:0/2850626092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8668153da0 msgr2=0x7f86681f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866e175640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8668153da0 0x7f86681f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866e175640 1 -- 172.21.15.78:0/2850626092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660009420 con 0x7f8668149cf0 2023-10-14T09:17:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866e976640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8668153da0 0x7f86681f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f866e175640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668149cf0 0x7f866814dba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f86600ab000 tx=0x7f866001ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f3f39a07640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3f18066570 0x7f3f18068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f31252ad640 1 -- 172.21.15.78:0/351795347 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31200c4bd0 con 0x7f3120134b80 2023-10-14T09:17:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.441+0000 7f3f3a208640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] conn(0x7f3f1806e790 0x7f3f18070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f8666ffd640 1 -- 172.21.15.78:0/2850626092 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600b7650 con 0x7f8668149cf0 2023-10-14T09:17:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f8666ffd640 1 -- 172.21.15.78:0/2850626092 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600b77b0 con 0x7f8668149cf0 2023-10-14T09:17:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f8666ffd640 1 -- 172.21.15.78:0/2850626092 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600b7b40 con 0x7f8668149cf0 2023-10-14T09:17:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7fdfe4ff9640 1 -- 172.21.15.78:0/55636964 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdfe0006b20 con 0x7fdfe8153da0 2023-10-14T09:17:31.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f311cff9640 1 -- 172.21.15.78:0/351795347 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108005070 con 0x7f3120134b80 2023-10-14T09:17:31.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f7445b2a640 1 -- 172.21.15.78:0/2809669631 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7440070b70 con 0x7f74400be570 2023-10-14T09:17:31.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f7427fff640 1 -- 172.21.15.78:0/2809669631 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7438007370 con 0x7f74400be570 2023-10-14T09:17:31.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f31167fc640 1 -- 172.21.15.78:0/351795347 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3120154030 con 0x7f3120134b80 2023-10-14T09:17:31.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f98ab59e640 1 -- 172.21.15.78:0/2211961495 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98ac14ee00 con 0x7f98ac0707a0 2023-10-14T09:17:31.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f0030646640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0020039570 0x7f00200da330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f0030646640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0020051f50 0x7f0020038210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f0030646640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00200e26e0 0x7f0020033b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f0030646640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0020037d80 con 0x7f0020051f50 2023-10-14T09:17:31.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f0030646640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200da870 con 0x7f0020039570 2023-10-14T09:17:31.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f0030646640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00200e0e60 con 0x7f00200e26e0 2023-10-14T09:17:31.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f3f3a208640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] conn(0x7f3f1806e790 0x7f3f18070bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f493dffb640 1 -- 172.21.15.78:0/2135155059 <== osd.0 v2:172.21.15.78:6800/2033199867 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f492c0711e0 con 0x7f492c06e710 2023-10-14T09:17:31.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f989affd640 1 -- 172.21.15.78:0/2211961495 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f98a40b8cc0 con 0x7f98ac0707a0 2023-10-14T09:17:31.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7fdfe4ff9640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdfd40664a0 0x7fdfd4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f002e3e2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0020039570 0x7f00200da330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f002e3e2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0020039570 0x7f00200da330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48048/0 (socket says 172.21.15.78:48048) 2023-10-14T09:17:31.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f002e3e2640 1 -- 172.21.15.78:0/3456718780 learned_addr learned my addr 172.21.15.78:0/3456718780 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f002ebe3640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00200e26e0 0x7f0020033b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f86703d9640 1 -- 172.21.15.78:0/2850626092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866815ced0 con 0x7f8668149cf0 2023-10-14T09:17:31.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f86703d9640 1 -- 172.21.15.78:0/2850626092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866814fbe0 con 0x7f8668149cf0 2023-10-14T09:17:31.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f3f39a07640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3f18066570 0x7f3f18068a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009890 tx=0x7f3f30008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f7427fff640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f742c066520 0x7f742c0689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f7427fff640 1 -- 172.21.15.78:0/2809669631 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7438083790 con 0x7f74400be570 2023-10-14T09:17:31.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7fdfe4ff9640 1 -- 172.21.15.78:0/55636964 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfe00541f0 con 0x7fdfe8153da0 2023-10-14T09:17:31.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7fdfe4ff9640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] conn(0x7fdfd406e640 0x7fdfd4070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f002ebe3640 1 -- 172.21.15.78:0/3456718780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0020039570 msgr2=0x7f00200da330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f002ebe3640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0020039570 0x7f00200da330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f002ebe3640 1 -- 172.21.15.78:0/3456718780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0020051f50 msgr2=0x7f0020038210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T09:17:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f86703d9640 1 -- 172.21.15.78:0/2850626092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8668070c40 con 0x7f8668149cf0 2023-10-14T09:17:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7fdfe4ff9640 1 -- 172.21.15.78:0/55636964 --> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfd4071110 con 0x7fdfd406e640 2023-10-14T09:17:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7fdfe4ff9640 1 -- 172.21.15.78:0/55636964 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfe0050530 con 0x7fdfe8153da0 2023-10-14T09:17:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7fdfe7fff640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdfd40664a0 0x7fdfd4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f989affd640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f988c066570 0x7f988c068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f989affd640 1 -- 172.21.15.78:0/2211961495 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98a411efc0 con 0x7f98ac0707a0 2023-10-14T09:17:31.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f989affd640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] conn(0x7f988c06e710 0x7f988c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f989affd640 1 -- 172.21.15.78:0/2211961495 --> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f988c0711e0 con 0x7f988c06e710 2023-10-14T09:17:31.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7fdfe77fe640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] conn(0x7fdfd406e640 0x7fdfd4070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f743effd640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f742c066520 0x7f742c0689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f7427fff640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] conn(0x7f742c06e740 0x7f742c070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f7427fff640 1 -- 172.21.15.78:0/2809669631 --> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f742c071210 con 0x7f742c06e740 2023-10-14T09:17:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f7427fff640 1 -- 172.21.15.78:0/2809669631 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7438083b10 con 0x7f74400be570 2023-10-14T09:17:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f743ffff640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] conn(0x7f742c06e740 0x7f742c070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f98aad9d640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] conn(0x7f988c06e710 0x7f988c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f98aa59c640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f988c066570 0x7f988c068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7fdfe77fe640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] conn(0x7fdfd406e640 0x7fdfd4070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f311cff9640 1 -- 172.21.15.78:0/351795347 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080a5820 con 0x7f3120134b80 2023-10-14T09:17:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f002ebe3640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0020051f50 0x7f0020038210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f002ebe3640 1 -- 172.21.15.78:0/3456718780 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024009420 con 0x7f00200e26e0 2023-10-14T09:17:31.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.445+0000 7f002ebe3640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00200e26e0 0x7f0020033b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f001800c5e0 tx=0x7f001800caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f001effd640 1 -- 172.21.15.78:0/3456718780 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018011800 con 0x7f00200e26e0 2023-10-14T09:17:31.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f001effd640 1 -- 172.21.15.78:0/3456718780 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00180119a0 con 0x7f00200e26e0 2023-10-14T09:17:31.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f001effd640 1 -- 172.21.15.78:0/3456718780 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0018011d50 con 0x7f00200e26e0 2023-10-14T09:17:31.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f0030646640 1 -- 172.21.15.78:0/3456718780 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0020038750 con 0x7f00200e26e0 2023-10-14T09:17:31.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f0030646640 1 -- 172.21.15.78:0/3456718780 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0020037450 con 0x7f00200e26e0 2023-10-14T09:17:31.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f311cff9640 1 -- 172.21.15.78:0/351795347 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3108003600 con 0x7f3120134b80 2023-10-14T09:17:31.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f8666ffd640 1 -- 172.21.15.78:0/2850626092 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f86600b7ca0 con 0x7f8668149cf0 2023-10-14T09:17:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f3f2a7fc640 1 -- 172.21.15.78:0/1509413000 <== osd.1 v2:172.21.15.78:6817/2815629814 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3f18071260 con 0x7f3f1806e790 2023-10-14T09:17:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7fdfe4ff9640 1 -- 172.21.15.78:0/55636964 <== osd.4 v2:172.21.15.157:6816/1674405437 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fdfd4071110 con 0x7fdfd406e640 2023-10-14T09:17:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f743ffff640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] conn(0x7f742c06e740 0x7f742c070b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f743effd640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f742c066520 0x7f742c0689e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74300af000 tx=0x7f7430004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7fdfe7fff640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdfd40664a0 0x7fdfd4068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80af000 tx=0x7fdfd80b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f8666ffd640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f864c0664f0 0x7f864c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f8666ffd640 1 -- 172.21.15.78:0/2850626092 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f866011e9f0 con 0x7f8668149cf0 2023-10-14T09:17:31.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f98aa59c640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f988c066570 0x7f988c068a30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009c20 tx=0x7f98a0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f8666ffd640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] conn(0x7f864c06e710 0x7f864c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f989affd640 1 -- 172.21.15.78:0/2211961495 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98a40ec4b0 con 0x7f98ac0707a0 2023-10-14T09:17:31.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f7427fff640 1 -- 172.21.15.78:0/2809669631 <== osd.7 v2:172.21.15.157:6824/782145234 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f742c071210 con 0x7f742c06e740 2023-10-14T09:17:31.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f8666ffd640 1 -- 172.21.15.78:0/2850626092 --> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f864c0711e0 con 0x7f864c06e710 2023-10-14T09:17:31.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f8666ffd640 1 -- 172.21.15.78:0/2850626092 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f866011ed60 con 0x7f8668149cf0 2023-10-14T09:17:31.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f311cff9640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f31000664d0 0x7f3100068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f311cff9640 1 -- 172.21.15.78:0/351795347 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f310811d230 con 0x7f3120134b80 2023-10-14T09:17:31.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f311cff9640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] conn(0x7f310006e670 0x7f3100070a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f866e976640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] conn(0x7f864c06e710 0x7f864c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f001cff9640 1 -- 172.21.15.78:0/3456718780 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0020039950 con 0x7f00200e26e0 2023-10-14T09:17:31.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f866d974640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f864c0664f0 0x7f864c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.449+0000 7f98aad9d640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] conn(0x7f988c06e710 0x7f988c070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f311cff9640 1 -- 172.21.15.78:0/351795347 --> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3100071140 con 0x7f310006e670 2023-10-14T09:17:31.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f311ffff640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f31000664d0 0x7f3100068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f001effd640 1 -- 172.21.15.78:0/3456718780 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0018022350 con 0x7f00200e26e0 2023-10-14T09:17:31.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f866e976640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] conn(0x7f864c06e710 0x7f864c070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f001effd640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f000c066570 0x7f000c068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f001effd640 1 -- 172.21.15.78:0/3456718780 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0018083dc0 con 0x7f00200e26e0 2023-10-14T09:17:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f001effd640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] conn(0x7f000c06e790 0x7f000c070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f001effd640 1 -- 172.21.15.78:0/3456718780 --> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f000c071260 con 0x7f000c06e790 2023-10-14T09:17:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f001effd640 1 -- 172.21.15.78:0/3456718780 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00180863e0 con 0x7f00200e26e0 2023-10-14T09:17:31.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f002e3e2640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f000c066570 0x7f000c068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f311f7fe640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] conn(0x7f310006e670 0x7f3100070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f002dbe1640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] conn(0x7f000c06e790 0x7f000c070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f311f7fe640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] conn(0x7f310006e670 0x7f3100070a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f866d974640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f864c0664f0 0x7f864c0689b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f865c006fd0 tx=0x7f865c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f8666ffd640 1 -- 172.21.15.78:0/2850626092 <== osd.6 v2:172.21.15.157:6808/3274328420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f864c0711e0 con 0x7f864c06e710 2023-10-14T09:17:31.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f989affd640 1 -- 172.21.15.78:0/2211961495 <== osd.3 v2:172.21.15.78:6816/3754005469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f988c0711e0 con 0x7f988c06e710 2023-10-14T09:17:31.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f311cff9640 1 -- 172.21.15.78:0/351795347 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31080ea5a0 con 0x7f3120134b80 2023-10-14T09:17:31.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f002dbe1640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] conn(0x7f000c06e790 0x7f000c070bb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f311cff9640 1 -- 172.21.15.78:0/351795347 <== osd.2 v2:172.21.15.78:6808/1585824417 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3100071140 con 0x7f310006e670 2023-10-14T09:17:31.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.453+0000 7f311ffff640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f31000664d0 0x7f3100068990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3118006cd0 tx=0x7f3118008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.457+0000 7f002e3e2640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f000c066570 0x7f000c068a30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0028069780 tx=0x7f0028061b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.457+0000 7f001effd640 1 -- 172.21.15.78:0/3456718780 <== osd.5 v2:172.21.15.157:6800/1064939114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f000c071260 con 0x7f000c06e790 2023-10-14T09:17:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7f3f3bc6b640 1 -- 172.21.15.78:0/1509413000 --> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3f34074180 con 0x7f3f1806e790 2023-10-14T09:17:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7f3f2a7fc640 1 -- 172.21.15.78:0/1509413000 <== osd.1 v2:172.21.15.78:6817/2815629814 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3f34074180 con 0x7f3f1806e790 2023-10-14T09:17:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7fdfee4d6640 1 -- 172.21.15.78:0/55636964 --> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdfe80aa7b0 con 0x7fdfd406e640 2023-10-14T09:17:31.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7f98ab59e640 1 -- 172.21.15.78:0/2211961495 --> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98ac074110 con 0x7f988c06e710 2023-10-14T09:17:31.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7fdfe4ff9640 1 -- 172.21.15.78:0/55636964 <== osd.4 v2:172.21.15.157:6816/1674405437 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdfe80aa7b0 con 0x7fdfd406e640 2023-10-14T09:17:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7f3f17fff640 1 -- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] conn(0x7f3f1806e790 msgr2=0x7f3f18070bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7f3f17fff640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] conn(0x7f3f1806e790 0x7f3f18070bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7f3f17fff640 1 -- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3f18066570 msgr2=0x7f3f18068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7f3f17fff640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3f18066570 0x7f3f18068a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009890 tx=0x7f3f30008040 comp rx=0 tx=0).stop 2023-10-14T09:17:31.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7f3f17fff640 1 -- 172.21.15.78:0/1509413000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f34153810 msgr2=0x7f3f341fa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7f3f17fff640 1 --2- 172.21.15.78:0/1509413000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f34153810 0x7f3f341fa000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400e870 tx=0x7f3f2400ed30 comp rx=0 tx=0).stop 2023-10-14T09:17:31.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7f3f3a208640 1 -- 172.21.15.78:0/1509413000 reap_dead start 2023-10-14T09:17:31.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7f3f17fff640 1 -- 172.21.15.78:0/1509413000 shutdown_connections 2023-10-14T09:17:31.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f3f17fff640 1 -- 172.21.15.78:0/1509413000 >> 172.21.15.78:0/1509413000 conn(0x7f3f340c1cc0 msgr2=0x7f3f3413fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7fdfee4d6640 1 -- 172.21.15.78:0/55636964 >> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] conn(0x7fdfd406e640 msgr2=0x7fdfd4070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.477+0000 7fdfee4d6640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] conn(0x7fdfd406e640 0x7fdfd4070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7fdfee4d6640 1 -- 172.21.15.78:0/55636964 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdfd40664a0 msgr2=0x7fdfd4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7fdfee4d6640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdfd40664a0 0x7fdfd4068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80af000 tx=0x7fdfd80b6040 comp rx=0 tx=0).stop 2023-10-14T09:17:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7fdfee4d6640 1 -- 172.21.15.78:0/55636964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfe8153da0 msgr2=0x7fdfe8142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7fdfee4d6640 1 --2- 172.21.15.78:0/55636964 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfe8153da0 0x7fdfe8142d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000c780 tx=0x7fdfe000cc40 comp rx=0 tx=0).stop 2023-10-14T09:17:31.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f3f17fff640 1 -- 172.21.15.78:0/1509413000 shutdown_connections 2023-10-14T09:17:31.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f3f17fff640 1 -- 172.21.15.78:0/1509413000 wait complete. 2023-10-14T09:17:31.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7fdfeca73640 1 -- 172.21.15.78:0/55636964 reap_dead start 2023-10-14T09:17:31.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f86703d9640 1 -- 172.21.15.78:0/2850626092 --> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8668074180 con 0x7f864c06e710 2023-10-14T09:17:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f989affd640 1 -- 172.21.15.78:0/2211961495 <== osd.3 v2:172.21.15.78:6816/3754005469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f98ac074110 con 0x7f988c06e710 2023-10-14T09:17:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 --> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4948074180 con 0x7f492c06e710 2023-10-14T09:17:31.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7fdfee4d6640 1 -- 172.21.15.78:0/55636964 shutdown_connections 2023-10-14T09:17:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7fdfee4d6640 1 -- 172.21.15.78:0/55636964 >> 172.21.15.78:0/55636964 conn(0x7fdfe80c1cc0 msgr2=0x7fdfe80c06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f98ab59e640 1 -- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] conn(0x7f988c06e710 msgr2=0x7f988c070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f98ab59e640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] conn(0x7f988c06e710 0x7f988c070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f8666ffd640 1 -- 172.21.15.78:0/2850626092 <== osd.6 v2:172.21.15.157:6808/3274328420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8668074180 con 0x7f864c06e710 2023-10-14T09:17:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f98ab59e640 1 -- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f988c066570 msgr2=0x7f988c068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f98ab59e640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f988c066570 0x7f988c068a30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009c20 tx=0x7f98a0009190 comp rx=0 tx=0).stop 2023-10-14T09:17:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f98ab59e640 1 -- 172.21.15.78:0/2211961495 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0707a0 msgr2=0x7f98ac155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f98ab59e640 1 --2- 172.21.15.78:0/2211961495 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98ac0707a0 0x7f98ac155160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f98a40ab000 tx=0x7f98a4019740 comp rx=0 tx=0).stop 2023-10-14T09:17:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f7445b2a640 1 -- 172.21.15.78:0/2809669631 --> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f744013d3a0 con 0x7f742c06e740 2023-10-14T09:17:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f98aad9d640 1 -- 172.21.15.78:0/2211961495 reap_dead start 2023-10-14T09:17:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7fdfee4d6640 1 -- 172.21.15.78:0/55636964 shutdown_connections 2023-10-14T09:17:31.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7fdfee4d6640 1 -- 172.21.15.78:0/55636964 wait complete. 2023-10-14T09:17:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f98ab59e640 1 -- 172.21.15.78:0/2211961495 shutdown_connections 2023-10-14T09:17:31.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f86703d9640 1 -- 172.21.15.78:0/2850626092 >> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] conn(0x7f864c06e710 msgr2=0x7f864c070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f86703d9640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] conn(0x7f864c06e710 0x7f864c070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f98ab59e640 1 -- 172.21.15.78:0/2211961495 >> 172.21.15.78:0/2211961495 conn(0x7f98ac0c1ac0 msgr2=0x7f98ac15a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f7427fff640 1 -- 172.21.15.78:0/2809669631 <== osd.7 v2:172.21.15.157:6824/782145234 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f74340047f0 con 0x7f742c06e740 2023-10-14T09:17:31.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f86703d9640 1 -- 172.21.15.78:0/2850626092 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f864c0664f0 msgr2=0x7f864c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f86703d9640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f864c0664f0 0x7f864c0689b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f865c006fd0 tx=0x7f865c008040 comp rx=0 tx=0).stop 2023-10-14T09:17:31.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f86703d9640 1 -- 172.21.15.78:0/2850626092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668149cf0 msgr2=0x7f866814dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f86703d9640 1 --2- 172.21.15.78:0/2850626092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8668149cf0 0x7f866814dba0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f86600ab000 tx=0x7f866001ab70 comp rx=0 tx=0).stop 2023-10-14T09:17:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f866e976640 1 -- 172.21.15.78:0/2850626092 reap_dead start 2023-10-14T09:17:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f98ab59e640 1 -- 172.21.15.78:0/2211961495 shutdown_connections 2023-10-14T09:17:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f98ab59e640 1 -- 172.21.15.78:0/2211961495 wait complete. 2023-10-14T09:17:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f86703d9640 1 -- 172.21.15.78:0/2850626092 shutdown_connections 2023-10-14T09:17:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f86703d9640 1 -- 172.21.15.78:0/2850626092 >> 172.21.15.78:0/2850626092 conn(0x7f86680c1cc0 msgr2=0x7f86680c06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f493dffb640 1 -- 172.21.15.78:0/2135155059 <== osd.0 v2:172.21.15.78:6800/2033199867 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4948074180 con 0x7f492c06e710 2023-10-14T09:17:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f7445b2a640 1 -- 172.21.15.78:0/2809669631 >> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] conn(0x7f742c06e740 msgr2=0x7f742c070b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f86703d9640 1 -- 172.21.15.78:0/2850626092 shutdown_connections 2023-10-14T09:17:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f7445b2a640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] conn(0x7f742c06e740 0x7f742c070b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f7445b2a640 1 -- 172.21.15.78:0/2809669631 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f742c066520 msgr2=0x7f742c0689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f7445b2a640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f742c066520 0x7f742c0689e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74300af000 tx=0x7f7430004740 comp rx=0 tx=0).stop 2023-10-14T09:17:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f7445b2a640 1 -- 172.21.15.78:0/2809669631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74400be570 msgr2=0x7f7440134d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f7445b2a640 1 --2- 172.21.15.78:0/2809669631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74400be570 0x7f7440134d70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f743800ba50 tx=0x7f743800bf10 comp rx=0 tx=0).stop 2023-10-14T09:17:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.481+0000 7f743ffff640 1 -- 172.21.15.78:0/2809669631 reap_dead start 2023-10-14T09:17:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f7445b2a640 1 -- 172.21.15.78:0/2809669631 shutdown_connections 2023-10-14T09:17:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f7445b2a640 1 -- 172.21.15.78:0/2809669631 >> 172.21.15.78:0/2809669631 conn(0x7f74400c1cc0 msgr2=0x7f74400bfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f86703d9640 1 -- 172.21.15.78:0/2850626092 wait complete. 2023-10-14T09:17:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] conn(0x7f492c06e710 msgr2=0x7f492c070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f494f69c640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] conn(0x7f492c06e710 0x7f492c070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f7445b2a640 1 -- 172.21.15.78:0/2809669631 shutdown_connections 2023-10-14T09:17:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f7445b2a640 1 -- 172.21.15.78:0/2809669631 wait complete. 2023-10-14T09:17:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f492c0664f0 msgr2=0x7f492c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f494f69c640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f492c0664f0 0x7f492c0689b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4944009f70 tx=0x7f4944009190 comp rx=0 tx=0).stop 2023-10-14T09:17:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4948158d00 msgr2=0x7f49480707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f494f69c640 1 --2- 172.21.15.78:0/2135155059 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4948158d00 0x7f49480707c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f493800d520 tx=0x7f493800d9e0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f494dc39640 1 -- 172.21.15.78:0/2135155059 reap_dead start 2023-10-14T09:17:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 shutdown_connections 2023-10-14T09:17:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 >> 172.21.15.78:0/2135155059 conn(0x7f49480c6060 msgr2=0x7f49480c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 shutdown_connections 2023-10-14T09:17:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f31167fc640 1 -- 172.21.15.78:0/351795347 --> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3120153d50 con 0x7f310006e670 2023-10-14T09:17:31.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f311cff9640 1 -- 172.21.15.78:0/351795347 <== osd.2 v2:172.21.15.78:6808/1585824417 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3110010aa0 con 0x7f310006e670 2023-10-14T09:17:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f494f69c640 1 -- 172.21.15.78:0/2135155059 wait complete. 2023-10-14T09:17:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.489+0000 7f31167fc640 1 -- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] conn(0x7f310006e670 msgr2=0x7f3100070a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.489+0000 7f31167fc640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] conn(0x7f310006e670 0x7f3100070a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.485+0000 7f001cff9640 1 -- 172.21.15.78:0/3456718780 --> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f002004f030 con 0x7f000c06e790 2023-10-14T09:17:31.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.489+0000 7f001effd640 1 -- 172.21.15.78:0/3456718780 <== osd.5 v2:172.21.15.157:6800/1064939114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f00240ac910 con 0x7f000c06e790 2023-10-14T09:17:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.489+0000 7f001cff9640 1 -- 172.21.15.78:0/3456718780 >> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] conn(0x7f000c06e790 msgr2=0x7f000c070bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.489+0000 7f001cff9640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] conn(0x7f000c06e790 0x7f000c070bb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.489+0000 7f001cff9640 1 -- 172.21.15.78:0/3456718780 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f000c066570 msgr2=0x7f000c068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.489+0000 7f001cff9640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f000c066570 0x7f000c068a30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0028069780 tx=0x7f0028061b20 comp rx=0 tx=0).stop 2023-10-14T09:17:31.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.489+0000 7f001cff9640 1 -- 172.21.15.78:0/3456718780 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00200e26e0 msgr2=0x7f0020033b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.489+0000 7f001cff9640 1 --2- 172.21.15.78:0/3456718780 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f00200e26e0 0x7f0020033b60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f001800c5e0 tx=0x7f001800caa0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.493+0000 7f002ebe3640 1 -- 172.21.15.78:0/3456718780 reap_dead start 2023-10-14T09:17:31.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.493+0000 7f001cff9640 1 -- 172.21.15.78:0/3456718780 shutdown_connections 2023-10-14T09:17:31.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.493+0000 7f001cff9640 1 -- 172.21.15.78:0/3456718780 >> 172.21.15.78:0/3456718780 conn(0x7f0020050ad0 msgr2=0x7f00200ddec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.493+0000 7f001cff9640 1 -- 172.21.15.78:0/3456718780 shutdown_connections 2023-10-14T09:17:31.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.493+0000 7f31167fc640 1 -- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f31000664d0 msgr2=0x7f3100068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.493+0000 7f31167fc640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f31000664d0 0x7f3100068990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3118006cd0 tx=0x7f3118008040 comp rx=0 tx=0).stop 2023-10-14T09:17:31.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.493+0000 7f31167fc640 1 -- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3120134b80 msgr2=0x7f31200a8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.493+0000 7f31167fc640 1 --2- 172.21.15.78:0/351795347 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3120134b80 0x7f31200a8560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31200c1980 tx=0x7f310c005800 comp rx=0 tx=0).stop 2023-10-14T09:17:31.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.493+0000 7f3124aac640 1 -- 172.21.15.78:0/351795347 reap_dead start 2023-10-14T09:17:31.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.497+0000 7f001cff9640 1 -- 172.21.15.78:0/3456718780 wait complete. 2023-10-14T09:17:31.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.497+0000 7f31167fc640 1 -- 172.21.15.78:0/351795347 shutdown_connections 2023-10-14T09:17:31.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.497+0000 7f31167fc640 1 -- 172.21.15.78:0/351795347 >> 172.21.15.78:0/351795347 conn(0x7f31200c1ac0 msgr2=0x7f3120152aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.497+0000 7f31167fc640 1 -- 172.21.15.78:0/351795347 shutdown_connections 2023-10-14T09:17:31.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.497+0000 7f31167fc640 1 -- 172.21.15.78:0/351795347 wait complete. 2023-10-14T09:17:31.608 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-10-14T09:17:31.609 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T09:17:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-10-14T09:17:31.610 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T09:17:31.611 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-10-14T09:17:31.611 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T09:17:31.612 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-10-14T09:17:31.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T09:17:31.613 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-10-14T09:17:31.614 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T09:17:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-10-14T09:17:31.615 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T09:17:31.616 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-10-14T09:17:31.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T09:17:31.617 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-10-14T09:17:31.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T09:17:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.885+0000 7f4619f65640 1 Processor -- start 2023-10-14T09:17:31.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4619f65640 1 -- start start 2023-10-14T09:17:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4619f65640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46140c4fa0 0x7f4614157e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4619f65640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f461406b500 0x7f4614153d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4619f65640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46141579c0 con 0x7f46140c5670 2023-10-14T09:17:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4619f65640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461406c540 con 0x7f461406b500 2023-10-14T09:17:31.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4619f65640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46140c4c30 con 0x7f46140c4fa0 2023-10-14T09:17:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4612ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46140c4fa0 0x7f4614157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f46137fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f46140c5670 0x7f46140c74e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51698/0 (socket says 172.21.15.78:51698) 2023-10-14T09:17:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f46137fe640 1 -- 172.21.15.78:0/4282685417 learned_addr learned my addr 172.21.15.78:0/4282685417 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:31.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4613fff640 1 --2- 172.21.15.78:0/4282685417 >> v2:172.21.15.157:3300/0 conn(0x7f461406b500 0x7f4614153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4612ffd640 1 -- 172.21.15.78:0/4282685417 >> v2:172.21.15.157:3300/0 conn(0x7f461406b500 msgr2=0x7f4614153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4612ffd640 1 --2- 172.21.15.78:0/4282685417 >> v2:172.21.15.157:3300/0 conn(0x7f461406b500 0x7f4614153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4612ffd640 1 -- 172.21.15.78:0/4282685417 >> v1:172.21.15.157:6789/0 conn(0x7f46140c5670 legacy=0x7f46140c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f4612ffd640 1 -- 172.21.15.78:0/4282685417 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46140c4950 con 0x7f46140c4fa0 2023-10-14T09:17:31.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.889+0000 7f46127fc640 1 -- 172.21.15.78:0/4282685417 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521883267 0 0) 0x7f46141579c0 con 0x7f46140c5670 2023-10-14T09:17:31.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f4612ffd640 1 --2- 172.21.15.78:0/4282685417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46140c4fa0 0x7f4614157e50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46080097c0 tx=0x7f460801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ab98d8dcd192a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f46127fc640 1 -- 172.21.15.78:0/4282685417 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46080ac620 con 0x7f46140c4fa0 2023-10-14T09:17:31.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f46127fc640 1 -- 172.21.15.78:0/4282685417 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46080ac780 con 0x7f46140c4fa0 2023-10-14T09:17:31.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f46127fc640 1 -- 172.21.15.78:0/4282685417 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46080acb10 con 0x7f46140c4fa0 2023-10-14T09:17:31.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f4619f65640 1 -- 172.21.15.78:0/4282685417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46140c4fa0 msgr2=0x7f4614157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f4619f65640 1 --2- 172.21.15.78:0/4282685417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46140c4fa0 0x7f4614157e50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46080097c0 tx=0x7f460801c3e0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7fc7d786b640 1 Processor -- start 2023-10-14T09:17:31.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f4619f65640 1 -- 172.21.15.78:0/4282685417 shutdown_connections 2023-10-14T09:17:31.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f4619f65640 1 --2- 172.21.15.78:0/4282685417 >> v2:172.21.15.157:3300/0 conn(0x7f461406b500 0x7f4614153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f4619f65640 1 --2- 172.21.15.78:0/4282685417 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46140c4fa0 0x7f4614157e50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f4619f65640 1 -- 172.21.15.78:0/4282685417 >> 172.21.15.78:0/4282685417 conn(0x7f46140c6060 msgr2=0x7f46140c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f5b28691640 1 Processor -- start 2023-10-14T09:17:31.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f4619f65640 1 -- 172.21.15.78:0/4282685417 shutdown_connections 2023-10-14T09:17:31.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f5b28691640 1 -- start start 2023-10-14T09:17:31.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7fc7d786b640 1 -- start start 2023-10-14T09:17:31.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f5b28691640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5b201572f0 0x7f5b20154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b28691640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b200be950 0x7f5b20071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b28691640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b20070c90 con 0x7f5b200be570 2023-10-14T09:17:31.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b28691640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b200bee00 con 0x7f5b201572f0 2023-10-14T09:17:31.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b28691640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b20157860 con 0x7f5b200be950 2023-10-14T09:17:31.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7d786b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7d0153da0 0x7fc7d0149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7d786b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d014a230 con 0x7fc7d01532d0 2023-10-14T09:17:31.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7d786b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d00706c0 con 0x7fc7d00c27e0 2023-10-14T09:17:31.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7d786b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d006c8f0 con 0x7fc7d0153da0 2023-10-14T09:17:31.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.897+0000 7f4619f65640 1 -- 172.21.15.78:0/4282685417 wait complete. 2023-10-14T09:17:31.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f4619f65640 1 Processor -- start 2023-10-14T09:17:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7d5607640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc7d00c27e0 0x7fc7d006fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51730/0 (socket says 172.21.15.78:51730) 2023-10-14T09:17:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7d5607640 1 -- 172.21.15.78:0/2236852362 learned_addr learned my addr 172.21.15.78:0/2236852362 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512785030 0 0) 0x7fc7d00706c0 con 0x7fc7d00c27e0 2023-10-14T09:17:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7c0003530 con 0x7fc7d00c27e0 2023-10-14T09:17:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7d4e06640 1 --2- 172.21.15.78:0/2236852362 >> v2:172.21.15.78:3300/0 conn(0x7fc7d0153da0 0x7fc7d0149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2013281116 0 0) 0x7fc7c0003530 con 0x7fc7d00c27e0 2023-10-14T09:17:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 >> v2:172.21.15.78:3300/0 conn(0x7fc7d0153da0 msgr2=0x7fc7d0149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 --2- 172.21.15.78:0/2236852362 >> v2:172.21.15.78:3300/0 conn(0x7fc7d0153da0 0x7fc7d0149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 >> v1:172.21.15.78:6789/0 conn(0x7fc7d01532d0 legacy=0x7fc7d00bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d0070960 con 0x7fc7d00c27e0 2023-10-14T09:17:31.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7fc7c4001680 con 0x7fc7d00c27e0 2023-10-14T09:17:31.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 >> v1:172.21.15.157:6789/0 conn(0x7fc7d00c27e0 legacy=0x7fc7d006fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 --2- 172.21.15.78:0/2236852362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc7c0003980 0x7fc7c0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 --2- 172.21.15.78:0/2236852362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c00047d0 0x7fc7c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 --2- 172.21.15.78:0/2236852362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7c00052b0 0x7fc7c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d006c8f0 con 0x7fc7c00047d0 2023-10-14T09:17:31.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c000c160 con 0x7fc7c00052b0 2023-10-14T09:17:31.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c000c320 con 0x7fc7c0003980 2023-10-14T09:17:31.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f4619f65640 1 -- start start 2023-10-14T09:17:31.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f4619f65640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f461406b500 0x7f46140c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f4619f65640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46140c4fa0 0x7f46140c2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f4619f65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46140c5670 0x7f46140bd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f4619f65640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46140c3130 con 0x7f46140c5670 2023-10-14T09:17:31.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f4619f65640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46140be2d0 con 0x7f46140c4fa0 2023-10-14T09:17:31.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f4619f65640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46140c3310 con 0x7f461406b500 2023-10-14T09:17:31.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7d5607640 1 --2- 172.21.15.78:0/2236852362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc7c0003980 0x7fc7c0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7fc7d5e08640 1 --2- 172.21.15.78:0/2236852362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7c00052b0 0x7fc7c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b26c2e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b200be950 0x7f5b20071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b26c2e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b200be950 0x7f5b20071830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48078/0 (socket says 172.21.15.78:48078) 2023-10-14T09:17:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b26c2e640 1 -- 172.21.15.78:0/3097911597 learned_addr learned my addr 172.21.15.78:0/3097911597 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b2642d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f5b200be570 0x7f5b20071120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51714/0 (socket says 172.21.15.78:51714) 2023-10-14T09:17:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b25c2c640 1 --2- 172.21.15.78:0/3097911597 >> v2:172.21.15.78:3300/0 conn(0x7f5b201572f0 0x7f5b20154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b26c2e640 1 -- 172.21.15.78:0/3097911597 >> v2:172.21.15.78:3300/0 conn(0x7f5b201572f0 msgr2=0x7f5b20154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b26c2e640 1 --2- 172.21.15.78:0/3097911597 >> v2:172.21.15.78:3300/0 conn(0x7f5b201572f0 0x7f5b20154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b26c2e640 1 -- 172.21.15.78:0/3097911597 >> v1:172.21.15.157:6789/0 conn(0x7f5b200be570 legacy=0x7f5b20071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f5b26c2e640 1 -- 172.21.15.78:0/3097911597 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b20157b40 con 0x7f5b200be950 2023-10-14T09:17:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f4613fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46140c5670 0x7f46140bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f4613fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46140c5670 0x7f46140bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39180/0 (socket says 172.21.15.78:39180) 2023-10-14T09:17:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.901+0000 7f4613fff640 1 -- 172.21.15.78:0/3416868284 learned_addr learned my addr 172.21.15.78:0/3416868284 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f4613fff640 1 -- 172.21.15.78:0/3416868284 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f461406b500 msgr2=0x7f46140c26b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T09:17:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f4613fff640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f461406b500 0x7f46140c26b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f4613fff640 1 -- 172.21.15.78:0/3416868284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46140c4fa0 msgr2=0x7f46140c2bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T09:17:31.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f4613fff640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46140c4fa0 0x7f46140c2bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f4613fff640 1 -- 172.21.15.78:0/3416868284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4608009420 con 0x7f46140c5670 2023-10-14T09:17:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7fc7d4e06640 1 --2- 172.21.15.78:0/2236852362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c00047d0 0x7fc7c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f5b25c2c640 1 --2- 172.21.15.78:0/3097911597 >> v2:172.21.15.78:3300/0 conn(0x7f5b201572f0 0x7f5b20154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7fc7d5e08640 1 -- 172.21.15.78:0/2236852362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc7c0003980 msgr2=0x7fc7c0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7fc7d5e08640 1 --2- 172.21.15.78:0/2236852362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc7c0003980 0x7fc7c0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7fc7d5e08640 1 -- 172.21.15.78:0/2236852362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c00047d0 msgr2=0x7fc7c0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7fc7d5e08640 1 --2- 172.21.15.78:0/2236852362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c00047d0 0x7fc7c0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7fc7d5e08640 1 -- 172.21.15.78:0/2236852362 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c0003530 con 0x7fc7c00052b0 2023-10-14T09:17:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f8b7310f640 1 Processor -- start 2023-10-14T09:17:31.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f8b7310f640 1 -- start start 2023-10-14T09:17:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f4613fff640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46140c5670 0x7f46140bd640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f460c007d90 tx=0x7f460c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f45fbfff640 1 -- 172.21.15.78:0/3416868284 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c014420 con 0x7f46140c5670 2023-10-14T09:17:31.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f45fbfff640 1 -- 172.21.15.78:0/3416868284 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c0145a0 con 0x7f46140c5670 2023-10-14T09:17:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f45fbfff640 1 -- 172.21.15.78:0/3416868284 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c014950 con 0x7f46140c5670 2023-10-14T09:17:31.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f8b7310f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b6c0af0d0 0x7f8b6c158f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f8b7310f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8b6c0c89b0 0x7f8b6c0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f8b7310f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b6c0c6580 0x7f8b6c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f8b7310f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6c1594d0 con 0x7f8b6c0af0d0 2023-10-14T09:17:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f8b7310f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6c0c5d50 con 0x7f8b6c0c89b0 2023-10-14T09:17:31.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.905+0000 7f8b7310f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c071390 con 0x7f8b6c0c6580 2023-10-14T09:17:31.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f8b70eab640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b6c0af0d0 0x7f8b6c158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f8b70eab640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8b6c0af0d0 0x7f8b6c158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39202/0 (socket says 172.21.15.78:39202) 2023-10-14T09:17:31.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f8b70eab640 1 -- 172.21.15.78:0/1628581958 learned_addr learned my addr 172.21.15.78:0/1628581958 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f4619f65640 1 -- 172.21.15.78:0/3416868284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46140c35f0 con 0x7f46140c5670 2023-10-14T09:17:31.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f4619f65640 1 -- 172.21.15.78:0/3416868284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46140bd120 con 0x7f46140c5670 2023-10-14T09:17:31.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f8b6bfff640 1 --2- 172.21.15.78:0/1628581958 >> v2:172.21.15.157:3300/0 conn(0x7f8b6c0c89b0 0x7f8b6c0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f5f69c3a640 1 Processor -- start 2023-10-14T09:17:31.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7fc7d5e08640 1 -- 172.21.15.78:0/2236852362 reap_dead start 2023-10-14T09:17:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f8b6bfff640 1 -- 172.21.15.78:0/1628581958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b6c0c6580 msgr2=0x7f8b6c0c7710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:17:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f8b6bfff640 1 --2- 172.21.15.78:0/1628581958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b6c0c6580 0x7f8b6c0c7710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f8b6bfff640 1 -- 172.21.15.78:0/1628581958 >> v2:172.21.15.78:3300/0 conn(0x7f8b6c0af0d0 msgr2=0x7f8b6c158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f8b6bfff640 1 --2- 172.21.15.78:0/1628581958 >> v2:172.21.15.78:3300/0 conn(0x7f8b6c0af0d0 0x7f8b6c158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f8b6bfff640 1 -- 172.21.15.78:0/1628581958 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c070dd0 con 0x7f8b6c0c89b0 2023-10-14T09:17:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f5f69c3a640 1 -- start start 2023-10-14T09:17:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f5b26c2e640 1 --2- 172.21.15.78:0/3097911597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b200be950 0x7f5b20071830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b2006e790 tx=0x7f5b180251d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18c66084acbd98d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f4619f65640 1 -- 172.21.15.78:0/3416868284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46140bd310 con 0x7f46140c5670 2023-10-14T09:17:31.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f90eaed6640 1 Processor -- start 2023-10-14T09:17:31.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f5b2542b640 1 -- 172.21.15.78:0/3097911597 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b180b4400 con 0x7f5b200be950 2023-10-14T09:17:31.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f5b2542b640 1 -- 172.21.15.78:0/3097911597 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b180b0050 con 0x7f5b200be950 2023-10-14T09:17:31.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f5b2542b640 1 -- 172.21.15.78:0/3097911597 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b180b4780 con 0x7f5b200be950 2023-10-14T09:17:31.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f5f69c3a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 0x7f5f64158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7fc7d5e08640 1 --2- 172.21.15.78:0/2236852362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7c00052b0 0x7fc7c000b990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8007fd0 tx=0x7fc7c801c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3807fb46c7e4b44c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f5f69c3a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5f6414e4b0 0x7f5f6414e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f5f69c3a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f64071130 con 0x7f5f640bf9c0 2023-10-14T09:17:31.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f5f69c3a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f64158f40 con 0x7f5f6414e4b0 2023-10-14T09:17:31.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f5f69c3a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64071410 con 0x7f5f6406cca0 2023-10-14T09:17:31.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.909+0000 7f90eaed6640 1 -- start start 2023-10-14T09:17:31.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c80052d0 con 0x7fc7c00052b0 2023-10-14T09:17:31.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5b28691640 1 -- 172.21.15.78:0/3097911597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b200be950 msgr2=0x7f5b20071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5b28691640 1 --2- 172.21.15.78:0/3097911597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b200be950 0x7f5b20071830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b2006e790 tx=0x7f5b180251d0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5f68c38640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 0x7f5f64158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5f68c38640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 0x7f5f64158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37332/0 (socket says 172.21.15.78:37332) 2023-10-14T09:17:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5f68c38640 1 -- 172.21.15.78:0/3806619309 learned_addr learned my addr 172.21.15.78:0/3806619309 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5f69439640 1 --2- 172.21.15.78:0/3806619309 >> v2:172.21.15.157:3300/0 conn(0x7f5f6414e4b0 0x7f5f6414e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5b28691640 1 -- 172.21.15.78:0/3097911597 shutdown_connections 2023-10-14T09:17:31.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5b28691640 1 --2- 172.21.15.78:0/3097911597 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b200be950 0x7f5b20071830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5b28691640 1 --2- 172.21.15.78:0/3097911597 >> v2:172.21.15.78:3300/0 conn(0x7f5b201572f0 0x7f5b20154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5b28691640 1 -- 172.21.15.78:0/3097911597 >> 172.21.15.78:0/3097911597 conn(0x7f5b200c1cc0 msgr2=0x7f5b200c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90eaed6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f90e4153e80 0x7f90e40c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90eaed6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e40c6910 0x7f90e40c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c80a7050 con 0x7fc7c00052b0 2023-10-14T09:17:31.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7fc7cffff640 1 -- 172.21.15.78:0/2236852362 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8003600 con 0x7fc7c00052b0 2023-10-14T09:17:31.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90eaed6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e406c470 con 0x7f90e414ddb0 2023-10-14T09:17:31.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5b28691640 1 -- 172.21.15.78:0/3097911597 shutdown_connections 2023-10-14T09:17:31.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90eaed6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e40c64f0 con 0x7f90e4153e80 2023-10-14T09:17:31.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90eaed6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40c5300 con 0x7f90e40c6910 2023-10-14T09:17:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90e9473640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e40c6910 0x7f90e40c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90e9473640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e40c6910 0x7f90e40c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37340/0 (socket says 172.21.15.78:37340) 2023-10-14T09:17:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90e9473640 1 -- 172.21.15.78:0/1334678546 learned_addr learned my addr 172.21.15.78:0/1334678546 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7fc7d786b640 1 -- 172.21.15.78:0/2236852362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7c00052b0 msgr2=0x7fc7c000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7fc7d786b640 1 --2- 172.21.15.78:0/2236852362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7c00052b0 0x7fc7c000b990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8007fd0 tx=0x7fc7c801c3b0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f45fbfff640 1 -- 172.21.15.78:0/3416868284 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f460c014ab0 con 0x7f46140c5670 2023-10-14T09:17:31.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f45fbfff640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f46000664a0 0x7f4600068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f45fbfff640 1 -- 172.21.15.78:0/3416868284 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f460c084760 con 0x7f46140c5670 2023-10-14T09:17:31.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f46137fe640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f46000664a0 0x7f4600068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5f69439640 1 -- 172.21.15.78:0/3806619309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 msgr2=0x7f5f64158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5f69439640 1 --2- 172.21.15.78:0/3806619309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 0x7f5f64158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5f69439640 1 -- 172.21.15.78:0/3806619309 >> v1:172.21.15.157:6789/0 conn(0x7f5f640bf9c0 legacy=0x7f5f64070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5f69439640 1 -- 172.21.15.78:0/3806619309 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640716f0 con 0x7f5f6414e4b0 2023-10-14T09:17:31.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7fc7d786b640 1 -- 172.21.15.78:0/2236852362 shutdown_connections 2023-10-14T09:17:31.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7fc7d786b640 1 --2- 172.21.15.78:0/2236852362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7c00052b0 0x7fc7c000b990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7fc7d786b640 1 -- 172.21.15.78:0/2236852362 >> 172.21.15.78:0/2236852362 conn(0x7fc7d00c1cc0 msgr2=0x7fc7d00c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5b28691640 1 -- 172.21.15.78:0/3097911597 wait complete. 2023-10-14T09:17:31.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f0eab73e640 1 Processor -- start 2023-10-14T09:17:31.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f5b28691640 1 Processor -- start 2023-10-14T09:17:31.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90e9473640 1 -- 172.21.15.78:0/1334678546 >> v2:172.21.15.157:3300/0 conn(0x7f90e4153e80 msgr2=0x7f90e40c7780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:17:31.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90e9473640 1 --2- 172.21.15.78:0/1334678546 >> v2:172.21.15.157:3300/0 conn(0x7f90e4153e80 0x7f90e40c7780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90e9473640 1 -- 172.21.15.78:0/1334678546 >> v1:172.21.15.78:6789/0 conn(0x7f90e414ddb0 legacy=0x7f90e406bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f90e9473640 1 -- 172.21.15.78:0/1334678546 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e406c750 con 0x7f90e40c6910 2023-10-14T09:17:31.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7bf1446640 1 Processor -- start 2023-10-14T09:17:31.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.913+0000 7f8b6bfff640 1 --2- 172.21.15.78:0/1628581958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0c89b0 0x7f8b6c0c6040 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0ac1a0 tx=0x7f8b6001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d396949d379ad05 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f0eab73e640 1 -- start start 2023-10-14T09:17:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b28691640 1 -- start start 2023-10-14T09:17:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7bf1446640 1 -- start start 2023-10-14T09:17:31.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f8b6b7fe640 1 -- 172.21.15.78:0/1628581958 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b600a4ea0 con 0x7f8b6c0c89b0 2023-10-14T09:17:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f8b6b7fe640 1 -- 172.21.15.78:0/1628581958 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b600a7050 con 0x7f8b6c0c89b0 2023-10-14T09:17:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f8b6b7fe640 1 -- 172.21.15.78:0/1628581958 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0c8460 con 0x7f8b6c0c89b0 2023-10-14T09:17:31.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f46137fe640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f46000664a0 0x7f4600068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4604001530 tx=0x7f4604007970 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7fc7d786b640 1 -- 172.21.15.78:0/2236852362 shutdown_connections 2023-10-14T09:17:31.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7fc7d786b640 1 -- 172.21.15.78:0/2236852362 wait complete. 2023-10-14T09:17:31.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b28691640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b200be570 0x7f5b200bcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7bf1446640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 0x7f7bec071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7bf1446640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bec158980 con 0x7f7bec158e10 2023-10-14T09:17:31.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b28691640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b200be950 0x7f5b201358e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7bf1446640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bec1580b0 con 0x7f7bec070110 2023-10-14T09:17:31.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5f69439640 1 --2- 172.21.15.78:0/3806619309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f6414e4b0 0x7f5f6414e920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5f540097c0 tx=0x7f5f5401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfaa26c53909bb81 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7bf1446640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec06db40 con 0x7f7bec06d640 2023-10-14T09:17:31.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7beaffd640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7bec070110 0x7f7bec155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51746/0 (socket says 172.21.15.78:51746) 2023-10-14T09:17:31.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7beaffd640 1 -- 172.21.15.78:0/4135408452 learned_addr learned my addr 172.21.15.78:0/4135408452 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:31.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7bea7fc640 1 --2- 172.21.15.78:0/4135408452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 0x7f7bec071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b28691640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b201572f0 0x7f5b20135e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b28691640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b200bd1e0 con 0x7f5b201572f0 2023-10-14T09:17:31.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b28691640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2006c380 con 0x7f5b200be570 2023-10-14T09:17:31.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b28691640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b201eacf0 con 0x7f5b200be950 2023-10-14T09:17:31.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b2642d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b200be570 0x7f5b200bcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5f637fe640 1 -- 172.21.15.78:0/3806619309 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540ab600 con 0x7f5f6414e4b0 2023-10-14T09:17:31.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f8b7310f640 1 -- 172.21.15.78:0/1628581958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0c89b0 msgr2=0x7f8b6c0c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f8b7310f640 1 --2- 172.21.15.78:0/1628581958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0c89b0 0x7f8b6c0c6040 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0ac1a0 tx=0x7f8b6001c360 comp rx=0 tx=0).stop 2023-10-14T09:17:31.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5f637fe640 1 -- 172.21.15.78:0/3806619309 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f540a7050 con 0x7f5f6414e4b0 2023-10-14T09:17:31.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b2642d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b200be570 0x7f5b200bcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48104/0 (socket says 172.21.15.78:48104) 2023-10-14T09:17:31.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b2642d640 1 -- 172.21.15.78:0/1823821358 learned_addr learned my addr 172.21.15.78:0/1823821358 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5f637fe640 1 -- 172.21.15.78:0/3806619309 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540ab600 con 0x7f5f6414e4b0 2023-10-14T09:17:31.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b26c2e640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b201572f0 0x7f5b20135e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f5b25c2c640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b200be950 0x7f5b201358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7bea7fc640 1 -- 172.21.15.78:0/4135408452 >> v1:172.21.15.157:6789/0 conn(0x7f7bec070110 legacy=0x7f7bec155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7bea7fc640 1 -- 172.21.15.78:0/4135408452 >> v1:172.21.15.78:6789/0 conn(0x7f7bec158e10 legacy=0x7f7bec0bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7be9ffb640 1 -- 172.21.15.78:0/4135408452 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613527625 0 0) 0x7f7bec1580b0 con 0x7f7bec070110 2023-10-14T09:17:31.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f7bea7fc640 1 -- 172.21.15.78:0/4135408452 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec158330 con 0x7f7bec06d640 2023-10-14T09:17:31.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f0eab73e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0ea414ddb0 0x7f0ea40c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f0eab73e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ea4153e80 0x7f0ea406bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f0eab73e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea40c6910 0x7f0ea40c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f0eab73e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea40c64f0 con 0x7f0ea414ddb0 2023-10-14T09:17:31.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f0eab73e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea40c5300 con 0x7f0ea4153e80 2023-10-14T09:17:31.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f0eab73e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea406c470 con 0x7f0ea40c6910 2023-10-14T09:17:31.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f0ea8cd9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ea4153e80 0x7f0ea406bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f0ea8cd9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ea4153e80 0x7f0ea406bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48120/0 (socket says 172.21.15.78:48120) 2023-10-14T09:17:31.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f0ea8cd9640 1 -- 172.21.15.78:0/948272761 learned_addr learned my addr 172.21.15.78:0/948272761 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.917+0000 7f0ea9cdb640 1 --2- 172.21.15.78:0/948272761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea40c6910 0x7f0ea40c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f0ea8cd9640 1 -- 172.21.15.78:0/948272761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea40c6910 msgr2=0x7f0ea40c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f0ea8cd9640 1 --2- 172.21.15.78:0/948272761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea40c6910 0x7f0ea40c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f0ea8cd9640 1 -- 172.21.15.78:0/948272761 >> v2:172.21.15.78:3300/0 conn(0x7f0ea414ddb0 msgr2=0x7f0ea40c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:31.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f0ea8cd9640 1 --2- 172.21.15.78:0/948272761 >> v2:172.21.15.78:3300/0 conn(0x7f0ea414ddb0 0x7f0ea40c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f0ea8cd9640 1 -- 172.21.15.78:0/948272761 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea406c750 con 0x7f0ea4153e80 2023-10-14T09:17:31.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5f69c3a640 1 -- 172.21.15.78:0/3806619309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f6414e4b0 msgr2=0x7f5f6414e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5f69c3a640 1 --2- 172.21.15.78:0/3806619309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f6414e4b0 0x7f5f6414e920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5f540097c0 tx=0x7f5f5401c330 comp rx=0 tx=0).stop 2023-10-14T09:17:31.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f90e9473640 1 --2- 172.21.15.78:0/1334678546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e40c6910 0x7f90e40c3fe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009e50 tx=0x7f90dc01c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3bb2577584812a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b26c2e640 1 -- 172.21.15.78:0/1823821358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b200be950 msgr2=0x7f5b201358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b26c2e640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b200be950 0x7f5b201358e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b26c2e640 1 -- 172.21.15.78:0/1823821358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b200be570 msgr2=0x7f5b200bcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b26c2e640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b200be570 0x7f5b200bcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b26c2e640 1 -- 172.21.15.78:0/1823821358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b18009b30 con 0x7f5b201572f0 2023-10-14T09:17:31.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b25c2c640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b200be950 0x7f5b201358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:31.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f8b7310f640 1 -- 172.21.15.78:0/1628581958 shutdown_connections 2023-10-14T09:17:31.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f8b7310f640 1 --2- 172.21.15.78:0/1628581958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b6c0c6580 0x7f8b6c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f8b7310f640 1 --2- 172.21.15.78:0/1628581958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0c89b0 0x7f8b6c0c6040 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f8b7310f640 1 --2- 172.21.15.78:0/1628581958 >> v2:172.21.15.78:3300/0 conn(0x7f8b6c0af0d0 0x7f8b6c158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f8b7310f640 1 -- 172.21.15.78:0/1628581958 >> 172.21.15.78:0/1628581958 conn(0x7f8b6c0ab1f0 msgr2=0x7f8b6c0ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f90e37fe640 1 -- 172.21.15.78:0/1334678546 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0a5640 con 0x7f90e40c6910 2023-10-14T09:17:31.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f90e37fe640 1 -- 172.21.15.78:0/1334678546 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc0a57a0 con 0x7f90e40c6910 2023-10-14T09:17:31.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f90e37fe640 1 -- 172.21.15.78:0/1334678546 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0a5b30 con 0x7f90e40c6910 2023-10-14T09:17:31.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d786b640 1 Processor -- start 2023-10-14T09:17:31.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d786b640 1 -- start start 2023-10-14T09:17:31.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b26c2e640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b201572f0 0x7f5b20135e20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5b180b3000 tx=0x7f5b18021f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f8b7310f640 1 -- 172.21.15.78:0/1628581958 shutdown_connections 2023-10-14T09:17:31.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5f69c3a640 1 -- 172.21.15.78:0/3806619309 shutdown_connections 2023-10-14T09:17:31.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5f69c3a640 1 --2- 172.21.15.78:0/3806619309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f6414e4b0 0x7f5f6414e920 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5f69c3a640 1 --2- 172.21.15.78:0/3806619309 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 0x7f5f64158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5f69c3a640 1 -- 172.21.15.78:0/3806619309 >> 172.21.15.78:0/3806619309 conn(0x7f5f640c1ac0 msgr2=0x7f5f640c1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b16ffd640 1 -- 172.21.15.78:0/1823821358 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b180b4e40 con 0x7f5b201572f0 2023-10-14T09:17:31.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b16ffd640 1 -- 172.21.15.78:0/1823821358 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b18009510 con 0x7f5b201572f0 2023-10-14T09:17:31.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b16ffd640 1 -- 172.21.15.78:0/1823821358 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b180bf660 con 0x7f5b201572f0 2023-10-14T09:17:31.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b28691640 1 -- 172.21.15.78:0/1823821358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b201eafd0 con 0x7f5b201572f0 2023-10-14T09:17:31.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5b28691640 1 -- 172.21.15.78:0/1823821358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b201eb590 con 0x7f5b201572f0 2023-10-14T09:17:31.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d786b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c00052b0 0x7fc7d01ed890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f90eaed6640 1 -- 172.21.15.78:0/1334678546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e40c6910 msgr2=0x7f90e40c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f90eaed6640 1 --2- 172.21.15.78:0/1334678546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e40c6910 0x7f90e40c3fe0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009e50 tx=0x7f90dc01c8d0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d786b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc7d00c3040 0x7fc7d0137e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d786b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7d013d790 0x7fc7d01f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d786b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00c38f0 con 0x7fc7c00052b0 2023-10-14T09:17:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d786b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d01efd30 con 0x7fc7d013d790 2023-10-14T09:17:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d786b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d0149530 con 0x7fc7d00c3040 2023-10-14T09:17:31.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5f69c3a640 1 -- 172.21.15.78:0/3806619309 shutdown_connections 2023-10-14T09:17:31.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d5607640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c00052b0 0x7fc7d01ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d4e06640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc7d00c3040 0x7fc7d0137e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d4e06640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc7d00c3040 0x7fc7d0137e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37366/0 (socket says 172.21.15.78:37366) 2023-10-14T09:17:31.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d4e06640 1 -- 172.21.15.78:0/3011832609 learned_addr learned my addr 172.21.15.78:0/3011832609 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f7bea7fc640 1 --2- 172.21.15.78:0/4135408452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 0x7f7bec071e10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7be00097f0 tx=0x7f7be001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a5d6432e9467308 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f7be9ffb640 1 -- 172.21.15.78:0/4135408452 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be00ab600 con 0x7f7bec06d640 2023-10-14T09:17:31.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f8b7310f640 1 -- 172.21.15.78:0/1628581958 wait complete. 2023-10-14T09:17:31.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f8b7310f640 1 Processor -- start 2023-10-14T09:17:31.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7fc7d4e06640 1 -- 172.21.15.78:0/3011832609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7d013d790 msgr2=0x7fc7d01f01c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T09:17:31.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f7be9ffb640 1 -- 172.21.15.78:0/4135408452 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be00a7050 con 0x7f7bec06d640 2023-10-14T09:17:31.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f7be9ffb640 1 -- 172.21.15.78:0/4135408452 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be00ab600 con 0x7f7bec06d640 2023-10-14T09:17:31.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7fc7d4e06640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7d013d790 0x7fc7d01f01c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7fc7d4e06640 1 -- 172.21.15.78:0/3011832609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c00052b0 msgr2=0x7fc7d01ed890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7fc7d4e06640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c00052b0 0x7fc7d01ed890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7fc7d4e06640 1 -- 172.21.15.78:0/3011832609 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d00c4930 con 0x7fc7d00c3040 2023-10-14T09:17:31.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b7310f640 1 -- start start 2023-10-14T09:17:31.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7fc7d4e06640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc7d00c3040 0x7fc7d0137e20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009cb0 tx=0x7fc7bc007700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:31.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f90eaed6640 1 -- 172.21.15.78:0/1334678546 shutdown_connections 2023-10-14T09:17:31.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f90eaed6640 1 --2- 172.21.15.78:0/1334678546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e40c6910 0x7f90e40c3fe0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f90eaed6640 1 --2- 172.21.15.78:0/1334678546 >> v2:172.21.15.157:3300/0 conn(0x7f90e4153e80 0x7f90e40c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f90eaed6640 1 -- 172.21.15.78:0/1334678546 >> 172.21.15.78:0/1334678546 conn(0x7f90e40ab1f0 msgr2=0x7f90e40ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f5b28691640 1 -- 172.21.15.78:0/1823821358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b201e77b0 con 0x7f5b201572f0 2023-10-14T09:17:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f45fbfff640 1 -- 172.21.15.78:0/3416868284 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f460c051c70 con 0x7f46140c5670 2023-10-14T09:17:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f7bf1446640 1 -- 172.21.15.78:0/4135408452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 msgr2=0x7f7bec071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f7bf1446640 1 --2- 172.21.15.78:0/4135408452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 0x7f7bec071e10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7be00097f0 tx=0x7f7be001c450 comp rx=0 tx=0).stop 2023-10-14T09:17:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7fc7cdffb640 1 -- 172.21.15.78:0/3011832609 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc014610 con 0x7fc7d00c3040 2023-10-14T09:17:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7fc7cdffb640 1 -- 172.21.15.78:0/3011832609 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc00f050 con 0x7fc7d00c3040 2023-10-14T09:17:31.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7fc7cdffb640 1 -- 172.21.15.78:0/3011832609 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0149b0 con 0x7fc7d00c3040 2023-10-14T09:17:31.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7fc7d786b640 1 -- 172.21.15.78:0/3011832609 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d00c4c10 con 0x7fc7d00c3040 2023-10-14T09:17:31.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7fc7d786b640 1 -- 172.21.15.78:0/3011832609 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d01ef9c0 con 0x7fc7d00c3040 2023-10-14T09:17:31.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.921+0000 7f5f69c3a640 1 -- 172.21.15.78:0/3806619309 wait complete. 2023-10-14T09:17:31.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b7310f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6c0af0d0 0x7f8b6c161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f5f69c3a640 1 Processor -- start 2023-10-14T09:17:31.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b7310f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b6c0c6580 0x7f8b6c1f16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f7bf1446640 1 -- 172.21.15.78:0/4135408452 shutdown_connections 2023-10-14T09:17:31.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f7bf1446640 1 --2- 172.21.15.78:0/4135408452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 0x7f7bec071e10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f7bf1446640 1 -- 172.21.15.78:0/4135408452 >> 172.21.15.78:0/4135408452 conn(0x7f7bec0c1cc0 msgr2=0x7f7bec0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:31.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b70eab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6c0af0d0 0x7f8b6c161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7fc7d786b640 1 -- 172.21.15.78:0/3011832609 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d01efb80 con 0x7fc7d00c3040 2023-10-14T09:17:31.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f5b16ffd640 1 -- 172.21.15.78:0/1823821358 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b180bb040 con 0x7f5b201572f0 2023-10-14T09:17:31.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b70eab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6c0af0d0 0x7f8b6c161fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39230/0 (socket says 172.21.15.78:39230) 2023-10-14T09:17:31.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b7310f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0c89b0 0x7f8b6c1f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b7310f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c1f2140 con 0x7f8b6c0af0d0 2023-10-14T09:17:31.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b7310f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0aaed0 con 0x7f8b6c0c89b0 2023-10-14T09:17:31.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b7310f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c1f2350 con 0x7f8b6c0c6580 2023-10-14T09:17:31.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b716ac640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0c89b0 0x7f8b6c1f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:31.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b716ac640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0c89b0 0x7f8b6c1f1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48144/0 (socket says 172.21.15.78:48144) 2023-10-14T09:17:31.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f8b716ac640 1 -- 172.21.15.78:0/2286339289 learned_addr learned my addr 172.21.15.78:0/2286339289 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:31.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f7bf1446640 1 -- 172.21.15.78:0/4135408452 shutdown_connections 2023-10-14T09:17:31.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f7bf1446640 1 -- 172.21.15.78:0/4135408452 wait complete. 2023-10-14T09:17:31.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b716ac640 1 -- 172.21.15.78:0/2286339289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b6c0c6580 msgr2=0x7f8b6c1f16c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T09:17:31.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b716ac640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b6c0c6580 0x7f8b6c1f16c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b716ac640 1 -- 172.21.15.78:0/2286339289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6c0af0d0 msgr2=0x7f8b6c161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:31.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b716ac640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6c0af0d0 0x7f8b6c161fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:31.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b716ac640 1 -- 172.21.15.78:0/2286339289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60009420 con 0x7f8b6c0c89b0 2023-10-14T09:17:31.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5b16ffd640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b04066570 0x7f5b04068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:31.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5b16ffd640 1 -- 172.21.15.78:0/1823821358 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b18127490 con 0x7f5b201572f0 2023-10-14T09:17:31.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f90eaed6640 1 -- 172.21.15.78:0/1334678546 shutdown_connections 2023-10-14T09:17:31.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f90eaed6640 1 -- 172.21.15.78:0/1334678546 wait complete. 2023-10-14T09:17:31.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f90eaed6640 1 Processor -- start 2023-10-14T09:17:31.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b70eab640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6c0af0d0 0x7f8b6c161fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:31.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f69c3a640 1 -- start start 2023-10-14T09:17:32.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b716ac640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0c89b0 0x7f8b6c1f1c00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400b990 tx=0x7f8b6400be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f90eaed6640 1 -- start start 2023-10-14T09:17:32.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.925+0000 7f0ea8cd9640 1 --2- 172.21.15.78:0/948272761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ea4153e80 0x7f0ea406bb70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ea406b8c0 tx=0x7f0e9401c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13192bf9e6c7f982 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f0e9bfff640 1 -- 172.21.15.78:0/948272761 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940ab600 con 0x7f0ea4153e80 2023-10-14T09:17:32.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f0e9bfff640 1 -- 172.21.15.78:0/948272761 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e940a7050 con 0x7f0ea4153e80 2023-10-14T09:17:32.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f0e9bfff640 1 -- 172.21.15.78:0/948272761 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940ab980 con 0x7f0ea4153e80 2023-10-14T09:17:32.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f0eab73e640 1 -- 172.21.15.78:0/948272761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ea4153e80 msgr2=0x7f0ea406bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f0eab73e640 1 --2- 172.21.15.78:0/948272761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ea4153e80 0x7f0ea406bb70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ea406b8c0 tx=0x7f0e9401c3b0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7fc7cdffb640 1 -- 172.21.15.78:0/3011832609 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc7bc014b10 con 0x7fc7d00c3040 2023-10-14T09:17:32.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7fc7cdffb640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc7b4066520 0x7fc7b40689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7fc7cdffb640 1 -- 172.21.15.78:0/3011832609 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7bc084430 con 0x7fc7d00c3040 2023-10-14T09:17:32.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5b2642d640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b04066570 0x7f5b04068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b697fa640 1 -- 172.21.15.78:0/2286339289 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6400cba0 con 0x7f8b6c0c89b0 2023-10-14T09:17:32.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b697fa640 1 -- 172.21.15.78:0/2286339289 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6400cd20 con 0x7f8b6c0c89b0 2023-10-14T09:17:32.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f69c3a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 0x7f5f640aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b697fa640 1 -- 172.21.15.78:0/2286339289 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64014680 con 0x7f8b6c0c89b0 2023-10-14T09:17:32.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f69c3a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f640bf9c0 0x7f5f6414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b7310f640 1 -- 172.21.15.78:0/2286339289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6c155190 con 0x7f8b6c0c89b0 2023-10-14T09:17:32.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7fc7d5607640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc7b4066520 0x7fc7b40689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f8b7310f640 1 -- 172.21.15.78:0/2286339289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6c155750 con 0x7f8b6c0c89b0 2023-10-14T09:17:32.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f0eab73e640 1 -- 172.21.15.78:0/948272761 shutdown_connections 2023-10-14T09:17:32.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f69c3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6414e4b0 0x7f5f6414b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f0eab73e640 1 --2- 172.21.15.78:0/948272761 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea40c6910 0x7f0ea40c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f0eab73e640 1 --2- 172.21.15.78:0/948272761 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ea4153e80 0x7f0ea406bb70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f69c3a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64154cd0 con 0x7f5f6414e4b0 2023-10-14T09:17:32.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f69c3a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6415c0b0 con 0x7f5f640bf9c0 2023-10-14T09:17:32.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f69c3a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6415c2c0 con 0x7f5f6406cca0 2023-10-14T09:17:32.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f68c38640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 0x7f5f640aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f0eab73e640 1 --2- 172.21.15.78:0/948272761 >> v2:172.21.15.78:3300/0 conn(0x7f0ea414ddb0 0x7f0ea40c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f68c38640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 0x7f5f640aa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37382/0 (socket says 172.21.15.78:37382) 2023-10-14T09:17:32.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f68c38640 1 -- 172.21.15.78:0/823594094 learned_addr learned my addr 172.21.15.78:0/823594094 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:32.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f69439640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6414e4b0 0x7f5f6414b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f68c38640 1 -- 172.21.15.78:0/823594094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f640bf9c0 msgr2=0x7f5f6414afa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T09:17:32.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f68c38640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f640bf9c0 0x7f5f6414afa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f68c38640 1 -- 172.21.15.78:0/823594094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6414e4b0 msgr2=0x7f5f6414b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f68c38640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6414e4b0 0x7f5f6414b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f68c38640 1 -- 172.21.15.78:0/823594094 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f54009420 con 0x7f5f6406cca0 2023-10-14T09:17:32.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f69439640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6414e4b0 0x7f5f6414b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:32.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f0eab73e640 1 -- 172.21.15.78:0/948272761 >> 172.21.15.78:0/948272761 conn(0x7f0ea40ab1f0 msgr2=0x7f0ea40ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:32.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.929+0000 7f5f68c38640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 0x7f5f640aa4b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00efc0 tx=0x7f5f5c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90eaed6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90e40c6910 0x7f90e40c1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90eaed6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e414ddb0 0x7f90e4155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90eaed6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90e4153e80 0x7f90e40beff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90eaed6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40be410 con 0x7f90e40c6910 2023-10-14T09:17:32.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90eaed6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40be5a0 con 0x7f90e4153e80 2023-10-14T09:17:32.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90eaed6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40beb60 con 0x7f90e414ddb0 2023-10-14T09:17:32.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e9473640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90e4153e80 0x7f90e40beff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f0eab73e640 1 -- 172.21.15.78:0/948272761 shutdown_connections 2023-10-14T09:17:32.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e9473640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90e4153e80 0x7f90e40beff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48156/0 (socket says 172.21.15.78:48156) 2023-10-14T09:17:32.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e9473640 1 -- 172.21.15.78:0/2622239155 learned_addr learned my addr 172.21.15.78:0/2622239155 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:32.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f0eab73e640 1 -- 172.21.15.78:0/948272761 wait complete. 2023-10-14T09:17:32.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7fc7d5607640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc7b4066520 0x7fc7b40689e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4001060 tx=0x7fc7c4007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e3fff640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e414ddb0 0x7f90e4155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f5b2642d640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b04066570 0x7f5b04068a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5b10000f70 tx=0x7f5b10007f10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f7bf1446640 1 Processor -- start 2023-10-14T09:17:32.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e9473640 1 -- 172.21.15.78:0/2622239155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e414ddb0 msgr2=0x7f90e4155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e9473640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e414ddb0 0x7f90e4155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e9473640 1 -- 172.21.15.78:0/2622239155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90e40c6910 msgr2=0x7f90e40c1780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T09:17:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e9473640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90e40c6910 0x7f90e40c1780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e9473640 1 -- 172.21.15.78:0/2622239155 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc009b30 con 0x7f90e4153e80 2023-10-14T09:17:32.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f7bf1446640 1 -- start start 2023-10-14T09:17:32.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f5f617fa640 1 -- 172.21.15.78:0/823594094 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00cda0 con 0x7f5f6406cca0 2023-10-14T09:17:32.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f5f617fa640 1 -- 172.21.15.78:0/823594094 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c00f040 con 0x7f5f6406cca0 2023-10-14T09:17:32.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f5f617fa640 1 -- 172.21.15.78:0/823594094 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0146a0 con 0x7f5f6406cca0 2023-10-14T09:17:32.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f5f69c3a640 1 -- 172.21.15.78:0/823594094 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f641f65e0 con 0x7f5f6406cca0 2023-10-14T09:17:32.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e9473640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90e4153e80 0x7f90e40beff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0af040 tx=0x7f90dc019670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f8b697fa640 1 -- 172.21.15.78:0/2286339289 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8b6401d3b0 con 0x7f8b6c0c89b0 2023-10-14T09:17:32.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f5f69c3a640 1 -- 172.21.15.78:0/823594094 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f640aa9f0 con 0x7f5f6406cca0 2023-10-14T09:17:32.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e17fa640 1 -- 172.21.15.78:0/2622239155 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0b8670 con 0x7f90e4153e80 2023-10-14T09:17:32.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e17fa640 1 -- 172.21.15.78:0/2622239155 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc0b87d0 con 0x7f90e4153e80 2023-10-14T09:17:32.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90e17fa640 1 -- 172.21.15.78:0/2622239155 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0b8b40 con 0x7f90e4153e80 2023-10-14T09:17:32.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90eaed6640 1 -- 172.21.15.78:0/2622239155 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e41f9b10 con 0x7f90e4153e80 2023-10-14T09:17:32.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.933+0000 7f90eaed6640 1 -- 172.21.15.78:0/2622239155 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e40be7f0 con 0x7f90e4153e80 2023-10-14T09:17:32.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7fc7cdffb640 1 -- 172.21.15.78:0/3011832609 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc7bc051a20 con 0x7fc7d00c3040 2023-10-14T09:17:32.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f5b16ffd640 1 -- 172.21.15.78:0/1823821358 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b180f4a30 con 0x7f5b201572f0 2023-10-14T09:17:32.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f8b697fa640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b500664f0 0x7f8b500689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f8b7310f640 1 -- 172.21.15.78:0/2286339289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6c074180 con 0x7f8b6c0c89b0 2023-10-14T09:17:32.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f8b70eab640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b500664f0 0x7f8b500689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f8b697fa640 1 -- 172.21.15.78:0/2286339289 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b64085cc0 con 0x7f8b6c0c89b0 2023-10-14T09:17:32.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f5f617fa640 1 -- 172.21.15.78:0/823594094 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5f5c014800 con 0x7f5f6406cca0 2023-10-14T09:17:32.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f5f69c3a640 1 -- 172.21.15.78:0/823594094 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6406d7a0 con 0x7f5f6406cca0 2023-10-14T09:17:32.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f0eab73e640 1 Processor -- start 2023-10-14T09:17:32.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f0eab73e640 1 -- start start 2023-10-14T09:17:32.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7bf1446640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 0x7f7bec146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7bf1446640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bec070110 0x7f7bec1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7bf1446640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec158e10 0x7f7bec156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7bf1446640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec13e7d0 con 0x7f7bec070110 2023-10-14T09:17:32.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7bf1446640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec1f35f0 con 0x7f7bec158e10 2023-10-14T09:17:32.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7bf1446640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec1f38d0 con 0x7f7bec06d640 2023-10-14T09:17:32.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f90eaed6640 1 -- 172.21.15.78:0/2622239155 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e4074180 con 0x7f90e4153e80 2023-10-14T09:17:32.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f5f617fa640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5f500664f0 0x7f5f500689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f90e17fa640 1 -- 172.21.15.78:0/2622239155 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f90dc0b8ca0 con 0x7f90e4153e80 2023-10-14T09:17:32.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f5f617fa640 1 -- 172.21.15.78:0/823594094 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f5c084570 con 0x7f5f6406cca0 2023-10-14T09:17:32.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f8b70eab640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b500664f0 0x7f8b500689b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c1550c0 tx=0x7f8b58008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7beaffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 0x7f7bec146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7beb7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec158e10 0x7f7bec156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7bea7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bec070110 0x7f7bec1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7bea7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bec070110 0x7f7bec1566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39258/0 (socket says 172.21.15.78:39258) 2023-10-14T09:17:32.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7bea7fc640 1 -- 172.21.15.78:0/960878179 learned_addr learned my addr 172.21.15.78:0/960878179 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:32.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7beaffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 0x7f7bec146d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37398/0 (socket says 172.21.15.78:37398) 2023-10-14T09:17:32.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f0eab73e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea40c6910 0x7f0ea414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f0eab73e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea414ddb0 0x7f0ea414f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f0eab73e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ea4153e80 0x7f0ea414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f0eab73e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea4158cb0 con 0x7f0ea40c6910 2023-10-14T09:17:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f0eab73e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea414ea80 con 0x7f0ea4153e80 2023-10-14T09:17:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f0eab73e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea414e7a0 con 0x7f0ea414ddb0 2023-10-14T09:17:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f5f63fff640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5f500664f0 0x7f5f500689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f90e17fa640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90c80664f0 0x7f90c80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.937+0000 7f7beb7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec158e10 0x7f7bec156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48172/0 (socket says 172.21.15.78:48172) 2023-10-14T09:17:32.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f0ea8cd9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea414ddb0 0x7f0ea414f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f0ea8cd9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea414ddb0 0x7f0ea414f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37414/0 (socket says 172.21.15.78:37414) 2023-10-14T09:17:32.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f0ea8cd9640 1 -- 172.21.15.78:0/700406362 learned_addr learned my addr 172.21.15.78:0/700406362 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:32.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f0ea9cdb640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ea4153e80 0x7f0ea414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7bea7fc640 1 -- 172.21.15.78:0/960878179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 msgr2=0x7f7bec146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7bea7fc640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 0x7f7bec146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7bea7fc640 1 -- 172.21.15.78:0/960878179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec158e10 msgr2=0x7f7bec156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7bea7fc640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec158e10 0x7f7bec156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7bea7fc640 1 -- 172.21.15.78:0/960878179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0009420 con 0x7f7bec070110 2023-10-14T09:17:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7beaffd640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 0x7f7bec146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f0ea94da640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea40c6910 0x7f0ea414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f90e8c72640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90c80664f0 0x7f90c80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f90e17fa640 1 -- 172.21.15.78:0/2622239155 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90dc11f450 con 0x7f90e4153e80 2023-10-14T09:17:32.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f0ea8cd9640 1 -- 172.21.15.78:0/700406362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ea4153e80 msgr2=0x7f0ea414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f0ea8cd9640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ea4153e80 0x7f0ea414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f0ea8cd9640 1 -- 172.21.15.78:0/700406362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea40c6910 msgr2=0x7f0ea414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f0ea8cd9640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea40c6910 0x7f0ea414f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f0ea8cd9640 1 -- 172.21.15.78:0/700406362 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940094d0 con 0x7f0ea414ddb0 2023-10-14T09:17:32.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f5f63fff640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5f500664f0 0x7f5f500689b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f6414d560 tx=0x7f5f58009a60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7bea7fc640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bec070110 0x7f7bec1566f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7be00ae040 tx=0x7f7be00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7bd37fe640 1 -- 172.21.15.78:0/960878179 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0003e60 con 0x7f7bec070110 2023-10-14T09:17:32.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7bd37fe640 1 -- 172.21.15.78:0/960878179 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be00b4400 con 0x7f7bec070110 2023-10-14T09:17:32.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7bd37fe640 1 -- 172.21.15.78:0/960878179 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be00b4790 con 0x7f7bec070110 2023-10-14T09:17:32.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7bf1446640 1 -- 172.21.15.78:0/960878179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec1f3bb0 con 0x7f7bec070110 2023-10-14T09:17:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f0ea8cd9640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea414ddb0 0x7f0ea414f8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0e9401cc50 tx=0x7f0e94019150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f7bf1446640 1 -- 172.21.15.78:0/960878179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bec147290 con 0x7f7bec070110 2023-10-14T09:17:32.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.941+0000 7f90e8c72640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90c80664f0 0x7f90c80689b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f90d0007fd0 tx=0x7f90d00079a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.945+0000 7f0e99ffb640 1 -- 172.21.15.78:0/700406362 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940b47b0 con 0x7f0ea414ddb0 2023-10-14T09:17:32.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.945+0000 7f0e99ffb640 1 -- 172.21.15.78:0/700406362 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e940b4910 con 0x7f0ea414ddb0 2023-10-14T09:17:32.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.945+0000 7f0e99ffb640 1 -- 172.21.15.78:0/700406362 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940b4cc0 con 0x7f0ea414ddb0 2023-10-14T09:17:32.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.945+0000 7f0eab73e640 1 -- 172.21.15.78:0/700406362 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea40c22c0 con 0x7f0ea414ddb0 2023-10-14T09:17:32.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.945+0000 7f7bf1446640 1 -- 172.21.15.78:0/960878179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bec074180 con 0x7f7bec070110 2023-10-14T09:17:32.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.945+0000 7f0eab73e640 1 -- 172.21.15.78:0/700406362 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea40c2880 con 0x7f0ea414ddb0 2023-10-14T09:17:32.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.945+0000 7f5f617fa640 1 -- 172.21.15.78:0/823594094 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5f5c051a90 con 0x7f5f6406cca0 2023-10-14T09:17:32.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.945+0000 7f90e17fa640 1 -- 172.21.15.78:0/2622239155 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90dc0ec940 con 0x7f90e4153e80 2023-10-14T09:17:32.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.945+0000 7f7bd37fe640 1 -- 172.21.15.78:0/960878179 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7be00b2040 con 0x7f7bec070110 2023-10-14T09:17:32.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.945+0000 7f0e877fe640 1 -- 172.21.15.78:0/700406362 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e80005260 con 0x7f0ea414ddb0 2023-10-14T09:17:32.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.949+0000 7f7bd37fe640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7bd80665a0 0x7f7bd8068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.949+0000 7f7bd37fe640 1 -- 172.21.15.78:0/960878179 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7be011e040 con 0x7f7bec070110 2023-10-14T09:17:32.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.949+0000 7f7beaffd640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7bd80665a0 0x7f7bd8068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.949+0000 7f8b697fa640 1 -- 172.21.15.78:0/2286339289 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8b64089060 con 0x7f8b6c0c89b0 2023-10-14T09:17:32.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.949+0000 7f7beaffd640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7bd80665a0 0x7f7bd8068a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc007fd0 tx=0x7f7bdc007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.949+0000 7f0e99ffb640 1 -- 172.21.15.78:0/700406362 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0e940b5440 con 0x7f0ea414ddb0 2023-10-14T09:17:32.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.953+0000 7f0e99ffb640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e88066570 0x7f0e88068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:32.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.953+0000 7f0e99ffb640 1 -- 172.21.15.78:0/700406362 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e9411ef70 con 0x7f0ea414ddb0 2023-10-14T09:17:32.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.953+0000 7f0ea94da640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e88066570 0x7f0e88068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:32.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.953+0000 7f0ea94da640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e88066570 0x7f0e88068a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009990 tx=0x7f0ea0009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:32.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.957+0000 7f0e99ffb640 1 -- 172.21.15.78:0/700406362 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e940ec630 con 0x7f0ea414ddb0 2023-10-14T09:17:32.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:31.957+0000 7f7bd37fe640 1 -- 172.21.15.78:0/960878179 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7be00eb650 con 0x7f7bec070110 2023-10-14T09:17:32.252 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-10-14T09:17:32.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.245+0000 7f4619f65640 1 -- 172.21.15.78:0/3416868284 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4614074180 con 0x7f46140c5670 2023-10-14T09:17:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.245+0000 7f45fbfff640 1 -- 172.21.15.78:0/3416868284 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f460c055290 con 0x7f46140c5670 2023-10-14T09:17:32.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 -- 172.21.15.78:0/3416868284 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f46000664a0 msgr2=0x7f4600068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f46000664a0 0x7f4600068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4604001530 tx=0x7f4604007970 comp rx=0 tx=0).stop 2023-10-14T09:17:32.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 -- 172.21.15.78:0/3416868284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46140c5670 msgr2=0x7f46140bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46140c5670 0x7f46140bd640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f460c007d90 tx=0x7f460c00e4b0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 -- 172.21.15.78:0/3416868284 shutdown_connections 2023-10-14T09:17:32.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46140c5670 0x7f46140bd640 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46140c4fa0 0x7f46140c2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f46000664a0 0x7f4600068960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 --2- 172.21.15.78:0/3416868284 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f461406b500 0x7f46140c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 -- 172.21.15.78:0/3416868284 >> 172.21.15.78:0/3416868284 conn(0x7f46140c6060 msgr2=0x7f461414acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:32.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 -- 172.21.15.78:0/3416868284 shutdown_connections 2023-10-14T09:17:32.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.253+0000 7f4619f65640 1 -- 172.21.15.78:0/3416868284 wait complete. 2023-10-14T09:17:32.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.257+0000 7fc7d786b640 1 -- 172.21.15.78:0/3011832609 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc7d01efea0 con 0x7fc7d00c3040 2023-10-14T09:17:32.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.257+0000 7fc7cdffb640 1 -- 172.21.15.78:0/3011832609 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7bc055040 con 0x7fc7d00c3040 2023-10-14T09:17:32.264 INFO:teuthology.orchestra.run.smithi078.stdout:55834574852 2023-10-14T09:17:32.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 -- 172.21.15.78:0/3011832609 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc7b4066520 msgr2=0x7fc7b40689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc7b4066520 0x7fc7b40689e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4001060 tx=0x7fc7c4007040 comp rx=0 tx=0).stop 2023-10-14T09:17:32.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 -- 172.21.15.78:0/3011832609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc7d00c3040 msgr2=0x7fc7d0137e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc7d00c3040 0x7fc7d0137e20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009cb0 tx=0x7fc7bc007700 comp rx=0 tx=0).stop 2023-10-14T09:17:32.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 -- 172.21.15.78:0/3011832609 shutdown_connections 2023-10-14T09:17:32.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7d013d790 0x7fc7d01f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc7b4066520 0x7fc7b40689e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc7d00c3040 0x7fc7d0137e20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 --2- 172.21.15.78:0/3011832609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c00052b0 0x7fc7d01ed890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 -- 172.21.15.78:0/3011832609 >> 172.21.15.78:0/3011832609 conn(0x7fc7d00c1cc0 msgr2=0x7fc7d015bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 -- 172.21.15.78:0/3011832609 shutdown_connections 2023-10-14T09:17:32.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.265+0000 7fc7d786b640 1 -- 172.21.15.78:0/3011832609 wait complete. 2023-10-14T09:17:32.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.269+0000 7f5b28691640 1 -- 172.21.15.78:0/1823821358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5b20074180 con 0x7f5b201572f0 2023-10-14T09:17:32.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.269+0000 7f5b16ffd640 1 -- 172.21.15.78:0/1823821358 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b180f8050 con 0x7f5b201572f0 2023-10-14T09:17:32.276 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-10-14T09:17:32.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.269+0000 7f90eaed6640 1 -- 172.21.15.78:0/2622239155 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f90e40c86e0 con 0x7f90e4153e80 2023-10-14T09:17:32.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f90e17fa640 1 -- 172.21.15.78:0/2622239155 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90dc0eff60 con 0x7f90e4153e80 2023-10-14T09:17:32.280 INFO:teuthology.orchestra.run.smithi078.stdout:55834574852 2023-10-14T09:17:32.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f5b28691640 1 -- 172.21.15.78:0/1823821358 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b04066570 msgr2=0x7f5b04068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f5b28691640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b04066570 0x7f5b04068a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5b10000f70 tx=0x7f5b10007f10 comp rx=0 tx=0).stop 2023-10-14T09:17:32.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f5b28691640 1 -- 172.21.15.78:0/1823821358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b201572f0 msgr2=0x7f5b20135e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f5b28691640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b201572f0 0x7f5b20135e20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5b180b3000 tx=0x7f5b18021f70 comp rx=0 tx=0).stop 2023-10-14T09:17:32.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f5f69c3a640 1 -- 172.21.15.78:0/823594094 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5f64074110 con 0x7f5f6406cca0 2023-10-14T09:17:32.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f5b28691640 1 -- 172.21.15.78:0/1823821358 shutdown_connections 2023-10-14T09:17:32.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f5b28691640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b201572f0 0x7f5b20135e20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f5b28691640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b04066570 0x7f5b04068a30 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5b10000f70 tx=0x7f5b10007f10 comp rx=0 tx=0).stop 2023-10-14T09:17:32.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f5b28691640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b200be950 0x7f5b201358e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f5b28691640 1 --2- 172.21.15.78:0/1823821358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b200be570 0x7f5b200bcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.273+0000 7f5b28691640 1 -- 172.21.15.78:0/1823821358 >> 172.21.15.78:0/1823821358 conn(0x7f5b200c1cc0 msgr2=0x7f5b20136f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:32.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f5b28691640 1 -- 172.21.15.78:0/1823821358 shutdown_connections 2023-10-14T09:17:32.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f5b28691640 1 -- 172.21.15.78:0/1823821358 wait complete. 2023-10-14T09:17:32.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f8b7310f640 1 -- 172.21.15.78:0/2286339289 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8b6c0c8720 con 0x7f8b6c0c89b0 2023-10-14T09:17:32.284 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-10-14T09:17:32.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f5f617fa640 1 -- 172.21.15.78:0/823594094 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f5c0550b0 con 0x7f5f6406cca0 2023-10-14T09:17:32.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f8b697fa640 1 -- 172.21.15.78:0/2286339289 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b64019070 con 0x7f8b6c0c89b0 2023-10-14T09:17:32.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 -- 172.21.15.78:0/2622239155 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90c80664f0 msgr2=0x7f90c80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90c80664f0 0x7f90c80689b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f90d0007fd0 tx=0x7f90d00079a0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 -- 172.21.15.78:0/2622239155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90e4153e80 msgr2=0x7f90e40beff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90e4153e80 0x7f90e40beff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0af040 tx=0x7f90dc019670 comp rx=0 tx=0).stop 2023-10-14T09:17:32.287 INFO:teuthology.orchestra.run.smithi078.stdout:55834574852 2023-10-14T09:17:32.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 -- 172.21.15.78:0/2622239155 shutdown_connections 2023-10-14T09:17:32.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90e4153e80 0x7f90e40beff0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90c80664f0 0x7f90c80689b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90e414ddb0 0x7f90e4155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 --2- 172.21.15.78:0/2622239155 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90e40c6910 0x7f90e40c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 -- 172.21.15.78:0/2622239155 >> 172.21.15.78:0/2622239155 conn(0x7f90e40ab1f0 msgr2=0x7f90e414b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:32.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 -- 172.21.15.78:0/2622239155 shutdown_connections 2023-10-14T09:17:32.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f90eaed6640 1 -- 172.21.15.78:0/2622239155 wait complete. 2023-10-14T09:17:32.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f0e877fe640 1 -- 172.21.15.78:0/700406362 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0e800057e0 con 0x7f0ea414ddb0 2023-10-14T09:17:32.289 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-10-14T09:17:32.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.277+0000 7f0e99ffb640 1 -- 172.21.15.78:0/700406362 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e940efc50 con 0x7f0ea414ddb0 2023-10-14T09:17:32.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 -- 172.21.15.78:0/2286339289 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b500664f0 msgr2=0x7f8b500689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b500664f0 0x7f8b500689b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c1550c0 tx=0x7f8b58008040 comp rx=0 tx=0).stop 2023-10-14T09:17:32.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 -- 172.21.15.78:0/2286339289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0c89b0 msgr2=0x7f8b6c1f1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0c89b0 0x7f8b6c1f1c00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400b990 tx=0x7f8b6400be50 comp rx=0 tx=0).stop 2023-10-14T09:17:32.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 -- 172.21.15.78:0/823594094 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5f500664f0 msgr2=0x7f5f500689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5f500664f0 0x7f5f500689b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f6414d560 tx=0x7f5f58009a60 comp rx=0 tx=0).stop 2023-10-14T09:17:32.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 -- 172.21.15.78:0/823594094 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 msgr2=0x7f5f640aa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 0x7f5f640aa4b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00efc0 tx=0x7f5f5c00c490 comp rx=0 tx=0).stop 2023-10-14T09:17:32.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 -- 172.21.15.78:0/2286339289 shutdown_connections 2023-10-14T09:17:32.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b6c0c89b0 0x7f8b6c1f1c00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8b500664f0 0x7f8b500689b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8b6c0c6580 0x7f8b6c1f16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 --2- 172.21.15.78:0/2286339289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b6c0af0d0 0x7f8b6c161fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 -- 172.21.15.78:0/2286339289 >> 172.21.15.78:0/2286339289 conn(0x7f8b6c0ab1f0 msgr2=0x7f8b6c0c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:32.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 -- 172.21.15.78:0/823594094 shutdown_connections 2023-10-14T09:17:32.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6414e4b0 0x7f5f6414b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f640bf9c0 0x7f5f6414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5f500664f0 0x7f5f500689b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 --2- 172.21.15.78:0/823594094 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5f6406cca0 0x7f5f640aa4b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 -- 172.21.15.78:0/823594094 >> 172.21.15.78:0/823594094 conn(0x7f5f640c1ac0 msgr2=0x7f5f640c3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:32.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 -- 172.21.15.78:0/823594094 shutdown_connections 2023-10-14T09:17:32.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f5f69c3a640 1 -- 172.21.15.78:0/823594094 wait complete. 2023-10-14T09:17:32.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 -- 172.21.15.78:0/2286339289 shutdown_connections 2023-10-14T09:17:32.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.281+0000 7f8b7310f640 1 -- 172.21.15.78:0/2286339289 wait complete. 2023-10-14T09:17:32.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-14T09:17:32.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.289+0000 7f0e877fe640 1 -- 172.21.15.78:0/700406362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e88066570 msgr2=0x7f0e88068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.289+0000 7f0e877fe640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e88066570 0x7f0e88068a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009990 tx=0x7f0ea0009110 comp rx=0 tx=0).stop 2023-10-14T09:17:32.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.289+0000 7f0e877fe640 1 -- 172.21.15.78:0/700406362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea414ddb0 msgr2=0x7f0ea414f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.289+0000 7f0e877fe640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea414ddb0 0x7f0ea414f8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0e9401cc50 tx=0x7f0e94019150 comp rx=0 tx=0).stop 2023-10-14T09:17:32.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.289+0000 7f0e877fe640 1 -- 172.21.15.78:0/700406362 shutdown_connections 2023-10-14T09:17:32.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.289+0000 7f0e877fe640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ea4153e80 0x7f0ea414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.289+0000 7f0e877fe640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e88066570 0x7f0e88068a30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.289+0000 7f0e877fe640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ea414ddb0 0x7f0ea414f8f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.289+0000 7f0e877fe640 1 --2- 172.21.15.78:0/700406362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ea40c6910 0x7f0ea414f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.289+0000 7f0e877fe640 1 -- 172.21.15.78:0/700406362 >> 172.21.15.78:0/700406362 conn(0x7f0ea40ab1f0 msgr2=0x7f0ea40a9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:32.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.293+0000 7f0e877fe640 1 -- 172.21.15.78:0/700406362 shutdown_connections 2023-10-14T09:17:32.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.293+0000 7f0e877fe640 1 -- 172.21.15.78:0/700406362 wait complete. 2023-10-14T09:17:32.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.293+0000 7f7bf1446640 1 -- 172.21.15.78:0/960878179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7bec152cf0 con 0x7f7bec070110 2023-10-14T09:17:32.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-10-14T09:17:32.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.301+0000 7f7bd37fe640 1 -- 172.21.15.78:0/960878179 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7be00b0070 con 0x7f7bec070110 2023-10-14T09:17:32.308 INFO:teuthology.orchestra.run.smithi078.stdout:55834574852 2023-10-14T09:17:32.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.305+0000 7f7bf1446640 1 -- 172.21.15.78:0/960878179 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7bd80665a0 msgr2=0x7f7bd8068a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.305+0000 7f7bf1446640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7bd80665a0 0x7f7bd8068a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc007fd0 tx=0x7f7bdc007d60 comp rx=0 tx=0).stop 2023-10-14T09:17:32.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.305+0000 7f7bf1446640 1 -- 172.21.15.78:0/960878179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bec070110 msgr2=0x7f7bec1566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.305+0000 7f7bf1446640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bec070110 0x7f7bec1566f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7be00ae040 tx=0x7f7be00191f0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.305+0000 7f7bf1446640 1 -- 172.21.15.78:0/960878179 shutdown_connections 2023-10-14T09:17:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.305+0000 7f7bf1446640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec158e10 0x7f7bec156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.305+0000 7f7bf1446640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bec070110 0x7f7bec1566f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.305+0000 7f7bf1446640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7bd80665a0 0x7f7bd8068a60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.305+0000 7f7bf1446640 1 --2- 172.21.15.78:0/960878179 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec06d640 0x7f7bec146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:32.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.305+0000 7f7bf1446640 1 -- 172.21.15.78:0/960878179 >> 172.21.15.78:0/960878179 conn(0x7f7bec0c1cc0 msgr2=0x7f7bec152f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:32.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.309+0000 7f7bf1446640 1 -- 172.21.15.78:0/960878179 shutdown_connections 2023-10-14T09:17:32.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:32.309+0000 7f7bf1446640 1 -- 172.21.15.78:0/960878179 wait complete. 2023-10-14T09:17:32.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-14T09:17:32.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-10-14T09:17:32.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-10-14T09:17:32.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-10-14T09:17:32.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-14T09:17:32.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-10-14T09:17:33.298 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T09:17:33.304 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T09:17:33.322 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T09:17:33.328 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T09:17:33.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T09:17:33.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T09:17:33.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T09:17:33.339 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T09:17:33.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.509+0000 7f6e5d291640 1 Processor -- start 2023-10-14T09:17:33.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.509+0000 7f6e5d291640 1 -- start start 2023-10-14T09:17:33.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.513+0000 7f6e5d291640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e58138d40 0x7f6e580aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.513+0000 7f6e5d291640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6e58153120 0x7f6e580c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.513+0000 7f6e567fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6e58153120 0x7f6e580c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.513+0000 7f6e567fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6e58153120 0x7f6e580c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48202/0 (socket says 172.21.15.78:48202) 2023-10-14T09:17:33.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.513+0000 7f6e567fc640 1 -- 172.21.15.78:0/2352288819 learned_addr learned my addr 172.21.15.78:0/2352288819 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.513+0000 7f6e5d291640 1 -- 172.21.15.78:0/2352288819 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5806c5d0 con 0x7f6e580c5bb0 2023-10-14T09:17:33.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.513+0000 7f6e5d291640 1 -- 172.21.15.78:0/2352288819 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5814fb30 con 0x7f6e58138d40 2023-10-14T09:17:33.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.513+0000 7f6e5d291640 1 -- 172.21.15.78:0/2352288819 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e58153670 con 0x7f6e58153120 2023-10-14T09:17:33.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.517+0000 7f6e567fc640 1 -- 172.21.15.78:0/2352288819 >> v2:172.21.15.78:3300/0 conn(0x7f6e58138d40 msgr2=0x7f6e580aa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.517+0000 7f6e567fc640 1 --2- 172.21.15.78:0/2352288819 >> v2:172.21.15.78:3300/0 conn(0x7f6e58138d40 0x7f6e580aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.517+0000 7f6e567fc640 1 -- 172.21.15.78:0/2352288819 >> v1:172.21.15.78:6789/0 conn(0x7f6e580c5bb0 legacy=0x7f6e58150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.517+0000 7f6e567fc640 1 -- 172.21.15.78:0/2352288819 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e58153950 con 0x7f6e58153120 2023-10-14T09:17:33.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e567fc640 1 --2- 172.21.15.78:0/2352288819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e58153120 0x7f6e580c5670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6e580c1680 tx=0x7f6e5001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0ed80af8d84ba16 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e55ffb640 1 -- 172.21.15.78:0/2352288819 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e500a56e0 con 0x7f6e58153120 2023-10-14T09:17:33.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e55ffb640 1 -- 172.21.15.78:0/2352288819 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e500a5840 con 0x7f6e58153120 2023-10-14T09:17:33.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e55ffb640 1 -- 172.21.15.78:0/2352288819 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e500a5bd0 con 0x7f6e58153120 2023-10-14T09:17:33.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e5d291640 1 -- 172.21.15.78:0/2352288819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e58153120 msgr2=0x7f6e580c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e5d291640 1 --2- 172.21.15.78:0/2352288819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e58153120 0x7f6e580c5670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6e580c1680 tx=0x7f6e5001c950 comp rx=0 tx=0).stop 2023-10-14T09:17:33.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e5d291640 1 -- 172.21.15.78:0/2352288819 shutdown_connections 2023-10-14T09:17:33.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e5d291640 1 --2- 172.21.15.78:0/2352288819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e58153120 0x7f6e580c5670 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e5d291640 1 --2- 172.21.15.78:0/2352288819 >> v2:172.21.15.78:3300/0 conn(0x7f6e58138d40 0x7f6e580aa2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e5d291640 1 -- 172.21.15.78:0/2352288819 >> 172.21.15.78:0/2352288819 conn(0x7f6e58069e90 msgr2=0x7f6e5806a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e5d291640 1 -- 172.21.15.78:0/2352288819 shutdown_connections 2023-10-14T09:17:33.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.521+0000 7f6e5d291640 1 -- 172.21.15.78:0/2352288819 wait complete. 2023-10-14T09:17:33.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.525+0000 7f6e5d291640 1 Processor -- start 2023-10-14T09:17:33.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.525+0000 7f6e5d291640 1 -- start start 2023-10-14T09:17:33.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e5d291640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e580c5bb0 0x7f6e581eb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e5d291640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e58138d40 0x7f6e58134a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e5d291640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e58132ce0 0x7f6e581e8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e5d291640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e581e7df0 con 0x7f6e580c5bb0 2023-10-14T09:17:33.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e5d291640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e581eb7a0 con 0x7f6e58138d40 2023-10-14T09:17:33.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e5d291640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e581eba80 con 0x7f6e58132ce0 2023-10-14T09:17:33.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e577fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e58132ce0 0x7f6e581e8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e56ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e580c5bb0 0x7f6e581eb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e577fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e58132ce0 0x7f6e581e8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37426/0 (socket says 172.21.15.78:37426) 2023-10-14T09:17:33.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e577fe640 1 -- 172.21.15.78:0/3001741248 learned_addr learned my addr 172.21.15.78:0/3001741248 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e567fc640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e58138d40 0x7f6e58134a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e577fe640 1 -- 172.21.15.78:0/3001741248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e58138d40 msgr2=0x7f6e58134a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e577fe640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e58138d40 0x7f6e58134a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e577fe640 1 -- 172.21.15.78:0/3001741248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e580c5bb0 msgr2=0x7f6e581eb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e577fe640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e580c5bb0 0x7f6e581eb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e577fe640 1 -- 172.21.15.78:0/3001741248 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e50009b30 con 0x7f6e58132ce0 2023-10-14T09:17:33.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e567fc640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e58138d40 0x7f6e58134a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:33.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.529+0000 7f6e577fe640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e58132ce0 0x7f6e581e8280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00c390 tx=0x7f6e4c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.533+0000 7f6e3f7fe640 1 -- 172.21.15.78:0/3001741248 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c0052d0 con 0x7f6e58132ce0 2023-10-14T09:17:33.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.533+0000 7f6e3f7fe640 1 -- 172.21.15.78:0/3001741248 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c005430 con 0x7f6e58132ce0 2023-10-14T09:17:33.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.533+0000 7f6e3f7fe640 1 -- 172.21.15.78:0/3001741248 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c003870 con 0x7f6e58132ce0 2023-10-14T09:17:33.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.533+0000 7f6e5d291640 1 -- 172.21.15.78:0/3001741248 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e581ebd60 con 0x7f6e58132ce0 2023-10-14T09:17:33.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.533+0000 7f6e5d291640 1 -- 172.21.15.78:0/3001741248 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e58134f40 con 0x7f6e58132ce0 2023-10-14T09:17:33.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.533+0000 7f6e5d291640 1 -- 172.21.15.78:0/3001741248 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5806dc40 con 0x7f6e58132ce0 2023-10-14T09:17:33.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.537+0000 7f6e3f7fe640 1 -- 172.21.15.78:0/3001741248 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6e4c0039d0 con 0x7f6e58132ce0 2023-10-14T09:17:33.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.537+0000 7f6e3f7fe640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e440664d0 0x7f6e44068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.537+0000 7f6e3f7fe640 1 -- 172.21.15.78:0/3001741248 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e4c0832f0 con 0x7f6e58132ce0 2023-10-14T09:17:33.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.537+0000 7f6e56ffd640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e440664d0 0x7f6e44068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.541+0000 7f6e56ffd640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e440664d0 0x7f6e44068990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009990 tx=0x7f6e48009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.545+0000 7f6e3f7fe640 1 -- 172.21.15.78:0/3001741248 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6e4c050810 con 0x7f6e58132ce0 2023-10-14T09:17:33.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7f3adc96e640 1 Processor -- start 2023-10-14T09:17:33.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7f3adc96e640 1 -- start start 2023-10-14T09:17:33.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7ff6d6d72640 1 Processor -- start 2023-10-14T09:17:33.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7ff6d6d72640 1 -- start start 2023-10-14T09:17:33.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7f3adc96e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3ad80c25e0 0x7f3ad8071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7ff6d6d72640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d013cd20 0x7ff6d0153f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7ff6d6d72640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6d006fb70 0x7ff6d01544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7ff6d6d72640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d00703d0 con 0x7ff6d006cf00 2023-10-14T09:17:33.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7ff6d6d72640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d0071750 con 0x7ff6d006fb70 2023-10-14T09:17:33.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7ff6d6d72640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d0153ad0 con 0x7ff6d013cd20 2023-10-14T09:17:33.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7f3adc96e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3ad8071100 0x7f3ad806cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7f3adc96e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad8138810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7f3adc96e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad8150130 con 0x7f3ad80c25e0 2023-10-14T09:17:33.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7f3adc96e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad8150410 con 0x7f3ad8071100 2023-10-14T09:17:33.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7ff6d4b0e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d013cd20 0x7ff6d0153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7ff6d4b0e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d013cd20 0x7ff6d0153f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37432/0 (socket says 172.21.15.78:37432) 2023-10-14T09:17:33.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7f3adc96e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad81506f0 con 0x7f3ad806d2c0 2023-10-14T09:17:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7ff6d4b0e640 1 -- 172.21.15.78:0/2280785888 learned_addr learned my addr 172.21.15.78:0/2280785888 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7ff6cffff640 1 --2- 172.21.15.78:0/2280785888 >> v2:172.21.15.78:3300/0 conn(0x7ff6d006fb70 0x7ff6d01544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.589+0000 7ff6d4b0e640 1 -- 172.21.15.78:0/2280785888 >> v2:172.21.15.78:3300/0 conn(0x7ff6d006fb70 msgr2=0x7ff6d01544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.589+0000 7ff6d4b0e640 1 --2- 172.21.15.78:0/2280785888 >> v2:172.21.15.78:3300/0 conn(0x7ff6d006fb70 0x7ff6d01544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.589+0000 7ff6d4b0e640 1 -- 172.21.15.78:0/2280785888 >> v1:172.21.15.78:6789/0 conn(0x7ff6d006cf00 legacy=0x7ff6d006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.589+0000 7ff6d4b0e640 1 -- 172.21.15.78:0/2280785888 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d013d100 con 0x7ff6d013cd20 2023-10-14T09:17:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7f3ad7fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad8138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7f3ad7fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad8138810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37430/0 (socket says 172.21.15.78:37430) 2023-10-14T09:17:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.585+0000 7f3ad7fff640 1 -- 172.21.15.78:0/668630890 learned_addr learned my addr 172.21.15.78:0/668630890 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.589+0000 7f3ad7fff640 1 -- 172.21.15.78:0/668630890 >> v2:172.21.15.157:3300/0 conn(0x7f3ad8071100 msgr2=0x7f3ad806cd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:17:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.589+0000 7f3ad7fff640 1 --2- 172.21.15.78:0/668630890 >> v2:172.21.15.157:3300/0 conn(0x7f3ad8071100 0x7f3ad806cd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.589+0000 7f3ad7fff640 1 -- 172.21.15.78:0/668630890 >> v2:172.21.15.78:3300/0 conn(0x7f3ad80c25e0 msgr2=0x7f3ad8071770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:17:33.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.589+0000 7f3ad7fff640 1 --2- 172.21.15.78:0/668630890 >> v2:172.21.15.78:3300/0 conn(0x7f3ad80c25e0 0x7f3ad8071770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.589+0000 7f3ad7fff640 1 -- 172.21.15.78:0/668630890 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad81509d0 con 0x7f3ad806d2c0 2023-10-14T09:17:33.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6d4b0e640 1 --2- 172.21.15.78:0/2280785888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d013cd20 0x7ff6d0153f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009870 tx=0x7ff6bc01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d86edd97cb74446f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7f3ad7fff640 1 --2- 172.21.15.78:0/668630890 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad8138810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3ad806e140 tx=0x7f3ac801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21add74d316d491a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6cf7fe640 1 -- 172.21.15.78:0/2280785888 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0ab600 con 0x7ff6d013cd20 2023-10-14T09:17:33.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6cf7fe640 1 -- 172.21.15.78:0/2280785888 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc0ab760 con 0x7ff6d013cd20 2023-10-14T09:17:33.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6cf7fe640 1 -- 172.21.15.78:0/2280785888 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0abaf0 con 0x7ff6d013cd20 2023-10-14T09:17:33.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6d6d72640 1 -- 172.21.15.78:0/2280785888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d013cd20 msgr2=0x7ff6d0153f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6d6d72640 1 --2- 172.21.15.78:0/2280785888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d013cd20 0x7ff6d0153f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009870 tx=0x7ff6bc01c440 comp rx=0 tx=0).stop 2023-10-14T09:17:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7f3ad67fc640 1 -- 172.21.15.78:0/668630890 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80ab660 con 0x7f3ad806d2c0 2023-10-14T09:17:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7f3ad67fc640 1 -- 172.21.15.78:0/668630890 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac80ab7c0 con 0x7f3ad806d2c0 2023-10-14T09:17:33.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7f3ad67fc640 1 -- 172.21.15.78:0/668630890 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80abb50 con 0x7f3ad806d2c0 2023-10-14T09:17:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6d6d72640 1 -- 172.21.15.78:0/2280785888 shutdown_connections 2023-10-14T09:17:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6d6d72640 1 --2- 172.21.15.78:0/2280785888 >> v2:172.21.15.78:3300/0 conn(0x7ff6d006fb70 0x7ff6d01544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6d6d72640 1 --2- 172.21.15.78:0/2280785888 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d013cd20 0x7ff6d0153f90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6d6d72640 1 -- 172.21.15.78:0/2280785888 >> 172.21.15.78:0/2280785888 conn(0x7ff6d00c1ab0 msgr2=0x7ff6d00c1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7f3adc96e640 1 -- 172.21.15.78:0/668630890 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 msgr2=0x7f3ad8138810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7f3adc96e640 1 --2- 172.21.15.78:0/668630890 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad8138810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3ad806e140 tx=0x7f3ac801c4e0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa4496dc640 1 Processor -- start 2023-10-14T09:17:33.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa4496dc640 1 -- start start 2023-10-14T09:17:33.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7f3adc96e640 1 -- 172.21.15.78:0/668630890 shutdown_connections 2023-10-14T09:17:33.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7f3adc96e640 1 --2- 172.21.15.78:0/668630890 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad8138810 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7f3adc96e640 1 --2- 172.21.15.78:0/668630890 >> v2:172.21.15.157:3300/0 conn(0x7f3ad8071100 0x7f3ad806cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7f3adc96e640 1 --2- 172.21.15.78:0/668630890 >> v2:172.21.15.78:3300/0 conn(0x7f3ad80c25e0 0x7f3ad8071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7f3adc96e640 1 -- 172.21.15.78:0/668630890 >> 172.21.15.78:0/668630890 conn(0x7f3ad80c1ac0 msgr2=0x7f3ad80c1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6d6d72640 1 -- 172.21.15.78:0/2280785888 shutdown_connections 2023-10-14T09:17:33.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.593+0000 7ff6d6d72640 1 -- 172.21.15.78:0/2280785888 wait complete. 2023-10-14T09:17:33.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7f3adc96e640 1 -- 172.21.15.78:0/668630890 shutdown_connections 2023-10-14T09:17:33.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7f3adc96e640 1 -- 172.21.15.78:0/668630890 wait complete. 2023-10-14T09:17:33.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7ff6d6d72640 1 Processor -- start 2023-10-14T09:17:33.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7ff6d6d72640 1 -- start start 2023-10-14T09:17:33.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa4496dc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa43c0d4200 0x7fa43c0dac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa4496dc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa43c00e600 0x7fa43c00ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa4496dc640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c00e170 con 0x7fa43c043240 2023-10-14T09:17:33.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa4496dc640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c0db280 con 0x7fa43c0d4200 2023-10-14T09:17:33.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa4496dc640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c04a6d0 con 0x7fa43c00e600 2023-10-14T09:17:33.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7f3adc96e640 1 Processor -- start 2023-10-14T09:17:33.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa4437fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa43c043240 0x7fa43c007180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33926/0 (socket says 172.21.15.78:33926) 2023-10-14T09:17:33.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa4437fe640 1 -- 172.21.15.78:0/253950408 learned_addr learned my addr 172.21.15.78:0/253950408 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:33.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa448edb640 1 --2- 172.21.15.78:0/253950408 >> v2:172.21.15.157:3300/0 conn(0x7fa43c00e600 0x7fa43c00ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7ff6d6d72640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d006cf00 0x7ff6d0136fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7f3adc96e640 1 -- start start 2023-10-14T09:17:33.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa443fff640 1 --2- 172.21.15.78:0/253950408 >> v2:172.21.15.78:3300/0 conn(0x7fa43c0d4200 0x7fa43c0dac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7ff6d6d72640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d006fb70 0x7ff6d013b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7ff6d6d72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6d013cd20 0x7ff6d01efb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.597+0000 7fa442ffd640 1 -- 172.21.15.78:0/253950408 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186425787 0 0) 0x7fa43c00e170 con 0x7fa43c043240 2023-10-14T09:17:33.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7fa442ffd640 1 -- 172.21.15.78:0/253950408 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa434003530 con 0x7fa43c043240 2023-10-14T09:17:33.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7ff6d6d72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d01375b0 con 0x7ff6d013cd20 2023-10-14T09:17:33.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7ff6d4b0e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d006cf00 0x7ff6d0136fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7ff6d6d72640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d01f4040 con 0x7ff6d006fb70 2023-10-14T09:17:33.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7ff6d6d72640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d01f3ae0 con 0x7ff6d006cf00 2023-10-14T09:17:33.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7ff6cffff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d006fb70 0x7ff6d013b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3adc96e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7fa448edb640 1 -- 172.21.15.78:0/253950408 >> v2:172.21.15.78:3300/0 conn(0x7fa43c0d4200 msgr2=0x7fa43c0dac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7fa448edb640 1 --2- 172.21.15.78:0/253950408 >> v2:172.21.15.78:3300/0 conn(0x7fa43c0d4200 0x7fa43c0dac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7fa448edb640 1 -- 172.21.15.78:0/253950408 >> v1:172.21.15.78:6789/0 conn(0x7fa43c043240 legacy=0x7fa43c007180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7fa448edb640 1 -- 172.21.15.78:0/253950408 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c04a970 con 0x7fa43c00e600 2023-10-14T09:17:33.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7ff6d4b0e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d006cf00 0x7ff6d0136fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37444/0 (socket says 172.21.15.78:37444) 2023-10-14T09:17:33.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7ff6d4b0e640 1 -- 172.21.15.78:0/914924967 learned_addr learned my addr 172.21.15.78:0/914924967 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7ff6d530f640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6d013cd20 0x7ff6d01efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3ad77fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3adc96e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ad8071100 0x7f3ad8146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3ad77fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad814d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37452/0 (socket says 172.21.15.78:37452) 2023-10-14T09:17:33.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3adc96e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ad80c25e0 0x7f3ad812c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3adc96e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad812e300 con 0x7f3ad8071100 2023-10-14T09:17:33.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3adc96e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad80a9500 con 0x7f3ad80c25e0 2023-10-14T09:17:33.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3adc96e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad812e020 con 0x7f3ad806d2c0 2023-10-14T09:17:33.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3ad77fe640 1 -- 172.21.15.78:0/825426889 learned_addr learned my addr 172.21.15.78:0/825426889 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3ad6ffd640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ad8071100 0x7f3ad8146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3ad7fff640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ad80c25e0 0x7f3ad812c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3ad77fe640 1 -- 172.21.15.78:0/825426889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ad80c25e0 msgr2=0x7f3ad812c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3ad77fe640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ad80c25e0 0x7f3ad812c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3ad77fe640 1 -- 172.21.15.78:0/825426889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ad8071100 msgr2=0x7f3ad8146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6d4b0e640 1 -- 172.21.15.78:0/914924967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d006fb70 msgr2=0x7ff6d013b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3ad77fe640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ad8071100 0x7f3ad8146db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6d4b0e640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d006fb70 0x7ff6d013b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6d4b0e640 1 -- 172.21.15.78:0/914924967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6d013cd20 msgr2=0x7ff6d01efb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6d4b0e640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6d013cd20 0x7ff6d01efb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3ad77fe640 1 -- 172.21.15.78:0/825426889 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80094d0 con 0x7f3ad806d2c0 2023-10-14T09:17:33.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.601+0000 7f3ad77fe640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad814d2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000ba80 tx=0x7f3ad000bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f3abffff640 1 -- 172.21.15.78:0/825426889 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad000cc90 con 0x7f3ad806d2c0 2023-10-14T09:17:33.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6d4b0e640 1 -- 172.21.15.78:0/914924967 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc0094d0 con 0x7ff6d006cf00 2023-10-14T09:17:33.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6cffff640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d006fb70 0x7ff6d013b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:33.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f3abffff640 1 -- 172.21.15.78:0/825426889 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad000cdf0 con 0x7f3ad806d2c0 2023-10-14T09:17:33.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f3abffff640 1 -- 172.21.15.78:0/825426889 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0014680 con 0x7f3ad806d2c0 2023-10-14T09:17:33.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f3adc96e640 1 -- 172.21.15.78:0/825426889 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad81472f0 con 0x7f3ad806d2c0 2023-10-14T09:17:33.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6d530f640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6d013cd20 0x7ff6d01efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:33.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f3adc96e640 1 -- 172.21.15.78:0/825426889 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad80a9750 con 0x7f3ad806d2c0 2023-10-14T09:17:33.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f0be489b640 1 Processor -- start 2023-10-14T09:17:33.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7fe9ec9a1640 1 Processor -- start 2023-10-14T09:17:33.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7fe9ec9a1640 1 -- start start 2023-10-14T09:17:33.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f0be489b640 1 -- start start 2023-10-14T09:17:33.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6d4b0e640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d006cf00 0x7ff6d0136fd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0ad040 tx=0x7ff6bc0191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7fa448edb640 1 --2- 172.21.15.78:0/253950408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa43c00e600 0x7fa43c00ea60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0100e0 tx=0x7fa43801c2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a67f2a1533ea0f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f3abdffb640 1 -- 172.21.15.78:0/825426889 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab0005260 con 0x7f3ad806d2c0 2023-10-14T09:17:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7fa442ffd640 1 -- 172.21.15.78:0/253950408 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4380ab600 con 0x7fa43c00e600 2023-10-14T09:17:33.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7fa442ffd640 1 -- 172.21.15.78:0/253950408 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4380a7050 con 0x7fa43c00e600 2023-10-14T09:17:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7fa442ffd640 1 -- 172.21.15.78:0/253950408 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4380ab600 con 0x7fa43c00e600 2023-10-14T09:17:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f4f3759e640 1 Processor -- start 2023-10-14T09:17:33.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f4f3759e640 1 -- start start 2023-10-14T09:17:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6cd7fa640 1 -- 172.21.15.78:0/914924967 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0b5810 con 0x7ff6d006cf00 2023-10-14T09:17:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6cd7fa640 1 -- 172.21.15.78:0/914924967 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc0b9070 con 0x7ff6d006cf00 2023-10-14T09:17:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6cd7fa640 1 -- 172.21.15.78:0/914924967 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0b5c10 con 0x7ff6d006cf00 2023-10-14T09:17:33.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6d6d72640 1 -- 172.21.15.78:0/914924967 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d01f3d60 con 0x7ff6d006cf00 2023-10-14T09:17:33.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f0be489b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0be00bf9c0 0x7f0be0158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f0be489b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be014e4b0 0x7f0be014e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f0be489b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be0071130 con 0x7f0be006cca0 2023-10-14T09:17:33.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f0be489b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be0158f40 con 0x7f0be00bf9c0 2023-10-14T09:17:33.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f0be489b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0071410 con 0x7f0be014e4b0 2023-10-14T09:17:33.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f0bded9d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0be006cca0 0x7f0be0070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51758/0 (socket says 172.21.15.78:51758) 2023-10-14T09:17:33.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7f0bded9d640 1 -- 172.21.15.78:0/2976818625 learned_addr learned my addr 172.21.15.78:0/2976818625 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:33.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7fa4496dc640 1 -- 172.21.15.78:0/253950408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa43c00e600 msgr2=0x7fa43c00ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7fa4496dc640 1 --2- 172.21.15.78:0/253950408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa43c00e600 0x7fa43c00ea60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0100e0 tx=0x7fa43801c2f0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.605+0000 7ff6d6d72640 1 -- 172.21.15.78:0/914924967 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d00a7be0 con 0x7ff6d006cf00 2023-10-14T09:17:33.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fe9e659c640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fe9e80be570 0x7fe9e8071120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51762/0 (socket says 172.21.15.78:51762) 2023-10-14T09:17:33.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fe9ec9a1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe9e8157370 0x7fe9e81549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fe9ec9a1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e80bedc0 con 0x7fe9e80be950 2023-10-14T09:17:33.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fa4496dc640 1 -- 172.21.15.78:0/253950408 shutdown_connections 2023-10-14T09:17:33.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fa4496dc640 1 --2- 172.21.15.78:0/253950408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa43c00e600 0x7fa43c00ea60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fa4496dc640 1 --2- 172.21.15.78:0/253950408 >> v2:172.21.15.78:3300/0 conn(0x7fa43c0d4200 0x7fa43c0dac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fa4496dc640 1 -- 172.21.15.78:0/253950408 >> 172.21.15.78:0/253950408 conn(0x7fa43c04c630 msgr2=0x7fa43c04ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fa4496dc640 1 -- 172.21.15.78:0/253950408 shutdown_connections 2023-10-14T09:17:33.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fe9ec9a1640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e81578e0 con 0x7fe9e80be570 2023-10-14T09:17:33.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fe9ec9a1640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e806ffd0 con 0x7fe9e8157370 2023-10-14T09:17:33.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fe9e5d9b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe9e8157370 0x7fe9e81549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fe9e5d9b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe9e8157370 0x7fe9e81549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48242/0 (socket says 172.21.15.78:48242) 2023-10-14T09:17:33.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fe9e5d9b640 1 -- 172.21.15.78:0/2638163513 learned_addr learned my addr 172.21.15.78:0/2638163513 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f3abffff640 1 -- 172.21.15.78:0/825426889 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3ad001d3b0 con 0x7f3ad806d2c0 2023-10-14T09:17:33.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fa4496dc640 1 -- 172.21.15.78:0/253950408 wait complete. 2023-10-14T09:17:33.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f4f3759e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f38141380 0x7f4f38158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f4f3759e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f380bfc60 con 0x7f4f3806f9c0 2023-10-14T09:17:33.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f4f3759e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f380c0800 con 0x7f4f380c0af0 2023-10-14T09:17:33.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f4f3759e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380bf9c0 con 0x7f4f38141380 2023-10-14T09:17:33.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7ff6d6d72640 1 -- 172.21.15.78:0/914924967 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d00a7dd0 con 0x7ff6d006cf00 2023-10-14T09:17:33.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f4f35d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4f3806f9c0 0x7f4f380c00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33950/0 (socket says 172.21.15.78:33950) 2023-10-14T09:17:33.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f4f35d9b640 1 -- 172.21.15.78:0/1479932590 learned_addr learned my addr 172.21.15.78:0/1479932590 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:33.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f4f3659c640 1 --2- 172.21.15.78:0/1479932590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f38141380 0x7f4f38158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bdf59e640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be014e4b0 0x7f0be014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439908568 0 0) 0x7f0be0071130 con 0x7f0be006cca0 2023-10-14T09:17:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bc8003530 con 0x7f0be006cca0 2023-10-14T09:17:33.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bde59c640 1 --2- 172.21.15.78:0/2976818625 >> v2:172.21.15.78:3300/0 conn(0x7f0be00bf9c0 0x7f0be0158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1639190606 0 0) 0x7f0bc8003530 con 0x7f0be006cca0 2023-10-14T09:17:33.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be014e4b0 msgr2=0x7f0be014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be014e4b0 0x7f0be014e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 >> v2:172.21.15.78:3300/0 conn(0x7f0be00bf9c0 msgr2=0x7f0be0158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 --2- 172.21.15.78:0/2976818625 >> v2:172.21.15.78:3300/0 conn(0x7f0be00bf9c0 0x7f0be0158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be00716f0 con 0x7f0be006cca0 2023-10-14T09:17:33.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f0bd4001680 con 0x7f0be006cca0 2023-10-14T09:17:33.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 >> v1:172.21.15.157:6789/0 conn(0x7f0be006cca0 legacy=0x7f0be0070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc8003980 0x7f0bc8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc8004370 0x7f0bc8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bc8004f70 0x7f0bc800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0158f40 con 0x7f0bc8004370 2023-10-14T09:17:33.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0071410 con 0x7f0bc8003980 2023-10-14T09:17:33.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc800bed0 con 0x7f0bc8004f70 2023-10-14T09:17:33.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bde59c640 1 --2- 172.21.15.78:0/2976818625 >> v2:172.21.15.78:3300/0 conn(0x7f0be00bf9c0 0x7f0be0158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:33.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bdf59e640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be014e4b0 0x7f0be014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:33.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bdf59e640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bc8004f70 0x7f0bc800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bde59c640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc8004370 0x7f0bc8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bded9d640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc8003980 0x7f0bc8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fe9e5d9b640 1 -- 172.21.15.78:0/2638163513 >> v1:172.21.15.157:6789/0 conn(0x7fe9e80be570 legacy=0x7fe9e8071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fe9e5d9b640 1 -- 172.21.15.78:0/2638163513 >> v1:172.21.15.78:6789/0 conn(0x7fe9e80be950 legacy=0x7fe9e8071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7fe9e5d9b640 1 -- 172.21.15.78:0/2638163513 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8157bc0 con 0x7fe9e8157370 2023-10-14T09:17:33.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bf36ea640 1 Processor -- start 2023-10-14T09:17:33.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bf36ea640 1 -- start start 2023-10-14T09:17:33.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bf36ea640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bec1583f0 0x7f0bec071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f0bf36ea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0bec06c9a0 0x7f0bec0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa4496dc640 1 Processor -- start 2023-10-14T09:17:33.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bf1486640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bec1583f0 0x7f0bec071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bf1486640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bec1583f0 0x7f0bec071e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48252/0 (socket says 172.21.15.78:48252) 2023-10-14T09:17:33.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bf1486640 1 -- 172.21.15.78:0/3527981952 learned_addr learned my addr 172.21.15.78:0/3527981952 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa4496dc640 1 -- start start 2023-10-14T09:17:33.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bf0c85640 1 --2- 172.21.15.78:0/3527981952 >> v2:172.21.15.78:3300/0 conn(0x7f0bec06c9a0 0x7f0bec0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f3abffff640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3ac4066570 0x7f3ac4068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f3abffff640 1 -- 172.21.15.78:0/825426889 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ad0083db0 con 0x7f3ad806d2c0 2023-10-14T09:17:33.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f3ad6ffd640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3ac4066570 0x7f3ac4068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f3ad6ffd640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3ac4066570 0x7f3ac4068a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8131e60 tx=0x7f3acc0090e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bded9d640 1 -- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bc8004f70 msgr2=0x7f0bc800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bded9d640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bc8004f70 0x7f0bc800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bded9d640 1 -- 172.21.15.78:0/2976818625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc8004370 msgr2=0x7f0bc8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bded9d640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc8004370 0x7f0bc8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bded9d640 1 -- 172.21.15.78:0/2976818625 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be00716f0 con 0x7f0bc8003980 2023-10-14T09:17:33.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bf36ea640 1 -- 172.21.15.78:0/3527981952 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bec06d770 con 0x7f0bec1587d0 2023-10-14T09:17:33.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bf36ea640 1 -- 172.21.15.78:0/3527981952 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec158d40 con 0x7f0bec06c9a0 2023-10-14T09:17:33.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bf36ea640 1 -- 172.21.15.78:0/3527981952 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec06da10 con 0x7f0bec1583f0 2023-10-14T09:17:33.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bf1486640 1 -- 172.21.15.78:0/3527981952 >> v2:172.21.15.78:3300/0 conn(0x7f0bec06c9a0 msgr2=0x7f0bec0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa4496dc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa43c00e600 0x7fa43c030bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa4496dc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa43c043240 0x7fa43c0447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa4496dc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa43c0d4200 0x7fa43c044d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa4496dc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c044350 con 0x7fa43c00e600 2023-10-14T09:17:33.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa4496dc640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0d3050 con 0x7fa43c043240 2023-10-14T09:17:33.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa4496dc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c030060 con 0x7fa43c0d4200 2023-10-14T09:17:33.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa4437fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa43c043240 0x7fa43c0447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa4437fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa43c043240 0x7fa43c0447e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48260/0 (socket says 172.21.15.78:48260) 2023-10-14T09:17:33.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa4437fe640 1 -- 172.21.15.78:0/124451498 learned_addr learned my addr 172.21.15.78:0/124451498 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bf1486640 1 --2- 172.21.15.78:0/3527981952 >> v2:172.21.15.78:3300/0 conn(0x7f0bec06c9a0 0x7f0bec0703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bf1486640 1 -- 172.21.15.78:0/3527981952 >> v1:172.21.15.157:6789/0 conn(0x7f0bec1587d0 legacy=0x7f0bec0bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f0bf1486640 1 -- 172.21.15.78:0/3527981952 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec159020 con 0x7f0bec1583f0 2023-10-14T09:17:33.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa448edb640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa43c0d4200 0x7fa43c044d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f4f3659c640 1 -- 172.21.15.78:0/1479932590 >> v1:172.21.15.157:6789/0 conn(0x7f4f380c0af0 legacy=0x7f4f3806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:33.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f4f3659c640 1 -- 172.21.15.78:0/1479932590 >> v1:172.21.15.78:6789/0 conn(0x7f4f3806f9c0 legacy=0x7f4f380c00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.609+0000 7f4f3659c640 1 -- 172.21.15.78:0/1479932590 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38158570 con 0x7f4f38141380 2023-10-14T09:17:33.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa443fff640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa43c00e600 0x7fa43c030bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7f3abffff640 1 -- 172.21.15.78:0/825426889 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3ad0051350 con 0x7f3ad806d2c0 2023-10-14T09:17:33.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7ff6cd7fa640 1 -- 172.21.15.78:0/914924967 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff6bc0c0480 con 0x7ff6d006cf00 2023-10-14T09:17:33.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa448edb640 1 -- 172.21.15.78:0/124451498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa43c043240 msgr2=0x7fa43c0447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa448edb640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa43c043240 0x7fa43c0447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa448edb640 1 -- 172.21.15.78:0/124451498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa43c00e600 msgr2=0x7fa43c030bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa448edb640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa43c00e600 0x7fa43c030bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa448edb640 1 -- 172.21.15.78:0/124451498 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa438009420 con 0x7fa43c0d4200 2023-10-14T09:17:33.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fa443fff640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa43c00e600 0x7fa43c030bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:33.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.613+0000 7fe9e5d9b640 1 --2- 172.21.15.78:0/2638163513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9e8157370 0x7fe9e81549c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009870 tx=0x7fe9dc01c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1e3bceb7584e8d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fa448edb640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa43c0d4200 0x7fa43c044d20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4380ab000 tx=0x7fa438019090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fe9e559a640 1 -- 172.21.15.78:0/2638163513 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0ab600 con 0x7fe9e8157370 2023-10-14T09:17:33.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fe9e559a640 1 -- 172.21.15.78:0/2638163513 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc0ab760 con 0x7fe9e8157370 2023-10-14T09:17:33.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fe9e559a640 1 -- 172.21.15.78:0/2638163513 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0abaf0 con 0x7fe9e8157370 2023-10-14T09:17:33.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7ff6cd7fa640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff6b4066570 0x7ff6b4068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f4f3659c640 1 --2- 172.21.15.78:0/1479932590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f38141380 0x7f4f38158030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009dc0 tx=0x7f4f3001c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5f866d716717d2d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7ff6cd7fa640 1 -- 172.21.15.78:0/914924967 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6bc0bb070 con 0x7ff6d006cf00 2023-10-14T09:17:33.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0bded9d640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc8003980 0x7f0bc8003da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400c2f0 tx=0x7f0bd401f490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b76e4c2f76e11d93 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2638163513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9e8157370 msgr2=0x7fe9e81549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fe9ec9a1640 1 --2- 172.21.15.78:0/2638163513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9e8157370 0x7fe9e81549c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009870 tx=0x7fe9dc01c400 comp rx=0 tx=0).stop 2023-10-14T09:17:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4005ae0 con 0x7f0bc8003980 2023-10-14T09:17:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd40ab070 con 0x7f0bc8003980 2023-10-14T09:17:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0bddd9b640 1 -- 172.21.15.78:0/2976818625 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4007070 con 0x7f0bc8003980 2023-10-14T09:17:33.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2638163513 shutdown_connections 2023-10-14T09:17:33.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fe9ec9a1640 1 --2- 172.21.15.78:0/2638163513 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9e8157370 0x7fe9e81549c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2638163513 >> 172.21.15.78:0/2638163513 conn(0x7fe9e80c1cc0 msgr2=0x7fe9e80c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2638163513 shutdown_connections 2023-10-14T09:17:33.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2638163513 wait complete. 2023-10-14T09:17:33.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7ff6cffff640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff6b4066570 0x7ff6b4068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0bf1486640 1 --2- 172.21.15.78:0/3527981952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bec1583f0 0x7f0bec071e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0bec06f410 tx=0x7f0be401c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b00138418043837 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fa440ff9640 1 -- 172.21.15.78:0/124451498 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4380ab600 con 0x7fa43c0d4200 2023-10-14T09:17:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fa440ff9640 1 -- 172.21.15.78:0/124451498 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4380a4e90 con 0x7fa43c0d4200 2023-10-14T09:17:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fa440ff9640 1 -- 172.21.15.78:0/124451498 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4380b4850 con 0x7fa43c0d4200 2023-10-14T09:17:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fa4496dc640 1 -- 172.21.15.78:0/124451498 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c043a20 con 0x7fa43c0d4200 2023-10-14T09:17:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0be489b640 1 -- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc8003980 msgr2=0x7f0bc8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0be489b640 1 --2- 172.21.15.78:0/2976818625 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc8003980 0x7f0bc8003da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400c2f0 tx=0x7f0bd401f490 comp rx=0 tx=0).stop 2023-10-14T09:17:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0bdf59e640 1 -- 172.21.15.78:0/2976818625 reap_dead start 2023-10-14T09:17:33.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f4f3559a640 1 -- 172.21.15.78:0/1479932590 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f300a5930 con 0x7f4f38141380 2023-10-14T09:17:33.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0be489b640 1 -- 172.21.15.78:0/2976818625 shutdown_connections 2023-10-14T09:17:33.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0be489b640 1 -- 172.21.15.78:0/2976818625 >> 172.21.15.78:0/2976818625 conn(0x7f0be00c1ac0 msgr2=0x7f0be00c1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f4f3559a640 1 -- 172.21.15.78:0/1479932590 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f300a5a90 con 0x7f4f38141380 2023-10-14T09:17:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f4f3559a640 1 -- 172.21.15.78:0/1479932590 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f300a5e20 con 0x7f4f38141380 2023-10-14T09:17:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7fa4496dc640 1 -- 172.21.15.78:0/124451498 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c043fe0 con 0x7fa43c0d4200 2023-10-14T09:17:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0be3fff640 1 -- 172.21.15.78:0/3527981952 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40a58c0 con 0x7f0bec1583f0 2023-10-14T09:17:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0be3fff640 1 -- 172.21.15.78:0/3527981952 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be40a5a20 con 0x7f0bec1583f0 2023-10-14T09:17:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.617+0000 7f0be3fff640 1 -- 172.21.15.78:0/3527981952 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40a5db0 con 0x7f0bec1583f0 2023-10-14T09:17:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7ff6cd7fa640 1 -- 172.21.15.78:0/914924967 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff6bc0ec310 con 0x7ff6d006cf00 2023-10-14T09:17:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7ff6cffff640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff6b4066570 0x7ff6b4068a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0156d80 tx=0x7ff6c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fa4496dc640 1 -- 172.21.15.78:0/124451498 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa424005260 con 0x7fa43c0d4200 2023-10-14T09:17:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7f0be489b640 1 -- 172.21.15.78:0/2976818625 shutdown_connections 2023-10-14T09:17:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7f0be489b640 1 -- 172.21.15.78:0/2976818625 wait complete. 2023-10-14T09:17:33.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9ec9a1640 1 Processor -- start 2023-10-14T09:17:33.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9ec9a1640 1 -- start start 2023-10-14T09:17:33.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7f0bf36ea640 1 -- 172.21.15.78:0/3527981952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bec1583f0 msgr2=0x7f0bec071e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7f0bf36ea640 1 --2- 172.21.15.78:0/3527981952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bec1583f0 0x7f0bec071e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0bec06f410 tx=0x7f0be401c9f0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fa440ff9640 1 -- 172.21.15.78:0/124451498 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa4380b2040 con 0x7fa43c0d4200 2023-10-14T09:17:33.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7f0bf36ea640 1 -- 172.21.15.78:0/3527981952 shutdown_connections 2023-10-14T09:17:33.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7f0bf36ea640 1 --2- 172.21.15.78:0/3527981952 >> v2:172.21.15.78:3300/0 conn(0x7f0bec06c9a0 0x7f0bec0703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7f0bf36ea640 1 --2- 172.21.15.78:0/3527981952 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bec1583f0 0x7f0bec071e10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7f0bf36ea640 1 -- 172.21.15.78:0/3527981952 >> 172.21.15.78:0/3527981952 conn(0x7f0bec0c1cc0 msgr2=0x7f0bec0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7f4f3759e640 1 -- 172.21.15.78:0/1479932590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f38141380 msgr2=0x7f4f38158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7f4f3759e640 1 --2- 172.21.15.78:0/1479932590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f38141380 0x7f4f38158030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009dc0 tx=0x7f4f3001c870 comp rx=0 tx=0).stop 2023-10-14T09:17:33.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9ec9a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9e80be570 0x7fe9e81340b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9ec9a1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9e80be950 0x7fe9e81345f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9ec9a1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9e8157370 0x7fe9e81f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9ec9a1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e8139d00 con 0x7fe9e80be570 2023-10-14T09:17:33.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9ec9a1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e8139fe0 con 0x7fe9e80be950 2023-10-14T09:17:33.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9ec9a1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e8152580 con 0x7fe9e8157370 2023-10-14T09:17:33.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fa440ff9640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4280664f0 0x7fa4280689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fa440ff9640 1 -- 172.21.15.78:0/124451498 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa43811da10 con 0x7fa43c0d4200 2023-10-14T09:17:33.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9e659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9e80be570 0x7fe9e81340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9e659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9e80be570 0x7fe9e81340b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39372/0 (socket says 172.21.15.78:39372) 2023-10-14T09:17:33.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9e659c640 1 -- 172.21.15.78:0/2049361845 learned_addr learned my addr 172.21.15.78:0/2049361845 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7f0be489b640 1 Processor -- start 2023-10-14T09:17:33.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fa443fff640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4280664f0 0x7fa4280689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9e6d9d640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9e8157370 0x7fe9e81f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.621+0000 7fe9e5d9b640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9e80be950 0x7fe9e81345f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f4f3759e640 1 -- 172.21.15.78:0/1479932590 shutdown_connections 2023-10-14T09:17:33.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f4f3759e640 1 --2- 172.21.15.78:0/1479932590 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f38141380 0x7f4f38158030 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f4f3759e640 1 -- 172.21.15.78:0/1479932590 >> 172.21.15.78:0/1479932590 conn(0x7f4f380c1ac0 msgr2=0x7f4f380c1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0be489b640 1 -- start start 2023-10-14T09:17:33.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9e6d9d640 1 -- 172.21.15.78:0/2049361845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9e80be950 msgr2=0x7fe9e81345f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9e6d9d640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9e80be950 0x7fe9e81345f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9e6d9d640 1 -- 172.21.15.78:0/2049361845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9e80be570 msgr2=0x7fe9e81340b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9e6d9d640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9e80be570 0x7fe9e81340b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9e6d9d640 1 -- 172.21.15.78:0/2049361845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc0094d0 con 0x7fe9e8157370 2023-10-14T09:17:33.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0bf36ea640 1 -- 172.21.15.78:0/3527981952 shutdown_connections 2023-10-14T09:17:33.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0bf36ea640 1 -- 172.21.15.78:0/3527981952 wait complete. 2023-10-14T09:17:33.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9e659c640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9e80be570 0x7fe9e81340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:33.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9e6d9d640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9e8157370 0x7fe9e81f3890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000c780 tx=0x7fe9e000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f4f3759e640 1 -- 172.21.15.78:0/1479932590 shutdown_connections 2023-10-14T09:17:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0bf36ea640 1 Processor -- start 2023-10-14T09:17:33.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fa443fff640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4280664f0 0x7fa4280689b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa44404f480 tx=0x7fa444067f10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0bf36ea640 1 -- start start 2023-10-14T09:17:33.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0be489b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc8003980 0x7f0be00c0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0be489b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be00a8a20 0x7f0be0148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0be489b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be0149090 0x7f0be00a9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0bde59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be00a8a20 0x7f0be0148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fa440ff9640 1 -- 172.21.15.78:0/124451498 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa4380eaf00 con 0x7fa43c0d4200 2023-10-14T09:17:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0bde59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be00a8a20 0x7f0be0148b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48288/0 (socket says 172.21.15.78:48288) 2023-10-14T09:17:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9d6ffd640 1 -- 172.21.15.78:0/2049361845 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0003d90 con 0x7fe9e8157370 2023-10-14T09:17:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9d6ffd640 1 -- 172.21.15.78:0/2049361845 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e000ce30 con 0x7fe9e8157370 2023-10-14T09:17:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9d6ffd640 1 -- 172.21.15.78:0/2049361845 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00052b0 con 0x7fe9e8157370 2023-10-14T09:17:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2049361845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e8152860 con 0x7fe9e8157370 2023-10-14T09:17:33.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2049361845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e8134b60 con 0x7fe9e8157370 2023-10-14T09:17:33.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0bf36ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bec06c9a0 0x7f0bec146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0bf36ea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bec1583f0 0x7f0bec146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f0bf36ea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bec1587d0 0x7f0bec0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf36ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0c3f60 con 0x7f0bec06c9a0 2023-10-14T09:17:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf36ea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec14d4f0 con 0x7f0bec1587d0 2023-10-14T09:17:33.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf36ea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0c3a30 con 0x7f0bec1583f0 2023-10-14T09:17:33.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf1486640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bec06c9a0 0x7f0bec146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf1486640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bec06c9a0 0x7f0bec146150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39400/0 (socket says 172.21.15.78:39400) 2023-10-14T09:17:33.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf1486640 1 -- 172.21.15.78:0/2891785564 learned_addr learned my addr 172.21.15.78:0/2891785564 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf0c85640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bec1583f0 0x7f0bec146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf1c87640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bec1587d0 0x7f0bec0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.625+0000 7f4f3759e640 1 -- 172.21.15.78:0/1479932590 wait complete. 2023-10-14T09:17:33.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f4f3759e640 1 Processor -- start 2023-10-14T09:17:33.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bded9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc8003980 0x7f0be00c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bded9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc8003980 0x7f0be00c0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39388/0 (socket says 172.21.15.78:39388) 2023-10-14T09:17:33.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0be489b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be00a9320 con 0x7f0bc8003980 2023-10-14T09:17:33.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0be489b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be014d7c0 con 0x7f0be00a8a20 2023-10-14T09:17:33.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0be489b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be00a8080 con 0x7f0be0149090 2023-10-14T09:17:33.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f4f3759e640 1 -- start start 2023-10-14T09:17:33.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bdf59e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be0149090 0x7f0be00a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bdf59e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be0149090 0x7f0be00a9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37526/0 (socket says 172.21.15.78:37526) 2023-10-14T09:17:33.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bdf59e640 1 -- 172.21.15.78:0/4230679234 learned_addr learned my addr 172.21.15.78:0/4230679234 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bdf59e640 1 -- 172.21.15.78:0/4230679234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be00a8a20 msgr2=0x7f0be0148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bdf59e640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be00a8a20 0x7f0be0148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bdf59e640 1 -- 172.21.15.78:0/4230679234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc8003980 msgr2=0x7f0be00c0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bdf59e640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc8003980 0x7f0be00c0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bdf59e640 1 -- 172.21.15.78:0/4230679234 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be0149510 con 0x7f0be0149090 2023-10-14T09:17:33.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bded9d640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc8003980 0x7f0be00c0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:33.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf1c87640 1 -- 172.21.15.78:0/2891785564 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bec1583f0 msgr2=0x7f0bec146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf1c87640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bec1583f0 0x7f0bec146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf1c87640 1 -- 172.21.15.78:0/2891785564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bec06c9a0 msgr2=0x7f0bec146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf1c87640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bec06c9a0 0x7f0bec146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf1c87640 1 -- 172.21.15.78:0/2891785564 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4009b30 con 0x7f0bec1587d0 2023-10-14T09:17:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf0c85640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bec1583f0 0x7f0bec146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f4f3759e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f3806f9c0 0x7f4f380aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7fe9d6ffd640 1 -- 172.21.15.78:0/2049361845 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe9e0005410 con 0x7fe9e8157370 2023-10-14T09:17:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bf1c87640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bec1587d0 0x7f0bec0c4370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00c390 tx=0x7f0bdc00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0be1ffb640 1 -- 172.21.15.78:0/2891785564 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc0052d0 con 0x7f0bec1587d0 2023-10-14T09:17:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0be1ffb640 1 -- 172.21.15.78:0/2891785564 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bdc005430 con 0x7f0bec1587d0 2023-10-14T09:17:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0be1ffb640 1 -- 172.21.15.78:0/2891785564 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc003840 con 0x7f0bec1587d0 2023-10-14T09:17:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bdf59e640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be0149090 0x7f0be00a9770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0be014e890 tx=0x7f0bd800f870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bc77fe640 1 -- 172.21.15.78:0/4230679234 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd800e040 con 0x7f0be0149090 2023-10-14T09:17:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bc77fe640 1 -- 172.21.15.78:0/4230679234 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd800f040 con 0x7f0be0149090 2023-10-14T09:17:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0bc77fe640 1 -- 172.21.15.78:0/4230679234 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8015890 con 0x7f0be0149090 2023-10-14T09:17:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.629+0000 7f0be489b640 1 -- 172.21.15.78:0/4230679234 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be0157c30 con 0x7f0be0149090 2023-10-14T09:17:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f0be489b640 1 -- 172.21.15.78:0/4230679234 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be00a85b0 con 0x7f0be0149090 2023-10-14T09:17:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7fe9d6ffd640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe9c8066570 0x7fe9c8068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7fe9d6ffd640 1 -- 172.21.15.78:0/2049361845 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9e00835b0 con 0x7fe9e8157370 2023-10-14T09:17:33.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2049361845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e81526c0 con 0x7fe9e8157370 2023-10-14T09:17:33.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f0bf36ea640 1 -- 172.21.15.78:0/2891785564 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bec14dd30 con 0x7f0bec1587d0 2023-10-14T09:17:33.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f0bf36ea640 1 -- 172.21.15.78:0/2891785564 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bec14d6e0 con 0x7f0bec1587d0 2023-10-14T09:17:33.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3759e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f380c0af0 0x7f4f38132760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f38141380 0x7f4f38132ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3759e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38135ca0 con 0x7f4f38141380 2023-10-14T09:17:33.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3759e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38132310 con 0x7f4f3806f9c0 2023-10-14T09:17:33.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3759e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f381358a0 con 0x7f4f380c0af0 2023-10-14T09:17:33.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3659c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f3806f9c0 0x7f4f380aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3659c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f3806f9c0 0x7f4f380aa6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48300/0 (socket says 172.21.15.78:48300) 2023-10-14T09:17:33.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3659c640 1 -- 172.21.15.78:0/3732916472 learned_addr learned my addr 172.21.15.78:0/3732916472 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:33.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7fe9e659c640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe9c8066570 0x7fe9c8068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f0bf36ea640 1 -- 172.21.15.78:0/2891785564 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bec14dec0 con 0x7f0bec1587d0 2023-10-14T09:17:33.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f36d9d640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f38141380 0x7f4f38132ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7fe9e659c640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe9c8066570 0x7fe9c8068a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8006ec0 tx=0x7fe9d8007f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3659c640 1 -- 172.21.15.78:0/3732916472 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f380c0af0 msgr2=0x7f4f38132760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T09:17:33.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3659c640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f380c0af0 0x7f4f38132760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3659c640 1 -- 172.21.15.78:0/3732916472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f38141380 msgr2=0x7f4f38132ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f4f3659c640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f38141380 0x7f4f38132ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.633+0000 7f0be1ffb640 1 -- 172.21.15.78:0/2891785564 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0bdc0039a0 con 0x7f0bec1587d0 2023-10-14T09:17:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7f0be489b640 1 -- 172.21.15.78:0/4230679234 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be00a9490 con 0x7f0be0149090 2023-10-14T09:17:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7f4f3659c640 1 -- 172.21.15.78:0/3732916472 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f30009a70 con 0x7f4f3806f9c0 2023-10-14T09:17:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7f4f3659c640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f3806f9c0 0x7f4f380aa6f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f30019480 tx=0x7f4f30019610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7f0be1ffb640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bd0066570 0x7f0bd0068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7f0be1ffb640 1 -- 172.21.15.78:0/2891785564 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bdc083230 con 0x7f0bec1587d0 2023-10-14T09:17:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7f0bf1486640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bd0066570 0x7f0bd0068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7f0bc77fe640 1 -- 172.21.15.78:0/4230679234 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0bd80159f0 con 0x7f0be0149090 2023-10-14T09:17:33.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7fe9d6ffd640 1 -- 172.21.15.78:0/2049361845 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe9e81526c0 con 0x7fe9e8157370 2023-10-14T09:17:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7f0bf1486640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bd0066570 0x7f0bd0068a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0be4000f90 tx=0x7f0be40a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7f0bc77fe640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bcc0664f0 0x7f0bcc0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7f0bc77fe640 1 -- 172.21.15.78:0/4230679234 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bd80847a0 con 0x7f0be0149090 2023-10-14T09:17:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.637+0000 7f0bded9d640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bcc0664f0 0x7f0bcc0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.641+0000 7f0bded9d640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bcc0664f0 0x7f0bcc0689b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40ae000 tx=0x7f0bd4001a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.641+0000 7f0be1ffb640 1 -- 172.21.15.78:0/2891785564 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0bdc050740 con 0x7f0bec1587d0 2023-10-14T09:17:33.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.641+0000 7f4f26ffd640 1 -- 172.21.15.78:0/3732916472 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f300adc20 con 0x7f4f3806f9c0 2023-10-14T09:17:33.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.641+0000 7f4f26ffd640 1 -- 172.21.15.78:0/3732916472 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f300adda0 con 0x7f4f3806f9c0 2023-10-14T09:17:33.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.641+0000 7f4f26ffd640 1 -- 172.21.15.78:0/3732916472 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f300b8660 con 0x7f4f3806f9c0 2023-10-14T09:17:33.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.641+0000 7f4f3759e640 1 -- 172.21.15.78:0/3732916472 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f38135000 con 0x7f4f3806f9c0 2023-10-14T09:17:33.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.641+0000 7f4f3759e640 1 -- 172.21.15.78:0/3732916472 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f381355c0 con 0x7f4f3806f9c0 2023-10-14T09:17:33.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.641+0000 7f0bc77fe640 1 -- 172.21.15.78:0/4230679234 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0be00a9490 con 0x7f0be0149090 2023-10-14T09:17:33.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.641+0000 7f4f3759e640 1 -- 172.21.15.78:0/3732916472 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f38132480 con 0x7f4f3806f9c0 2023-10-14T09:17:33.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.645+0000 7f4f26ffd640 1 -- 172.21.15.78:0/3732916472 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4f300b87c0 con 0x7f4f3806f9c0 2023-10-14T09:17:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.645+0000 7f4f26ffd640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f18066570 0x7f4f18068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.645+0000 7f4f26ffd640 1 -- 172.21.15.78:0/3732916472 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f3011f5e0 con 0x7f4f3806f9c0 2023-10-14T09:17:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.649+0000 7f4f35d9b640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f18066570 0x7f4f18068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.649+0000 7f4f35d9b640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f18066570 0x7f4f18068a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f28000f70 tx=0x7f4f28007a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.649+0000 7f4f26ffd640 1 -- 172.21.15.78:0/3732916472 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4f38132480 con 0x7f4f3806f9c0 2023-10-14T09:17:33.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.869+0000 7f6e5d291640 1 -- 172.21.15.78:0/3001741248 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6e581ebbc0 con 0x7f6e58132ce0 2023-10-14T09:17:33.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e3f7fe640 1 -- 172.21.15.78:0/3001741248 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e581ebbc0 con 0x7f6e58132ce0 2023-10-14T09:17:33.877 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-10-14T09:17:33.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 -- 172.21.15.78:0/3001741248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e440664d0 msgr2=0x7f6e44068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e440664d0 0x7f6e44068990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009990 tx=0x7f6e48009110 comp rx=0 tx=0).stop 2023-10-14T09:17:33.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 -- 172.21.15.78:0/3001741248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e58132ce0 msgr2=0x7f6e581e8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e58132ce0 0x7f6e581e8280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00c390 tx=0x7f6e4c00c850 comp rx=0 tx=0).stop 2023-10-14T09:17:33.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 -- 172.21.15.78:0/3001741248 shutdown_connections 2023-10-14T09:17:33.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e440664d0 0x7f6e44068990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e58132ce0 0x7f6e581e8280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e58138d40 0x7f6e58134a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 --2- 172.21.15.78:0/3001741248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e580c5bb0 0x7f6e581eb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 -- 172.21.15.78:0/3001741248 >> 172.21.15.78:0/3001741248 conn(0x7f6e58069e90 msgr2=0x7f6e580c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 -- 172.21.15.78:0/3001741248 shutdown_connections 2023-10-14T09:17:33.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.873+0000 7f6e5d291640 1 -- 172.21.15.78:0/3001741248 wait complete. 2023-10-14T09:17:33.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-14T09:17:33.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.933+0000 7f0bf36ea640 1 -- 172.21.15.78:0/2891785564 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0bec074180 con 0x7f0bec1587d0 2023-10-14T09:17:33.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0be1ffb640 1 -- 172.21.15.78:0/2891785564 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0bdc053d60 con 0x7f0bec1587d0 2023-10-14T09:17:33.941 INFO:teuthology.orchestra.run.smithi078.stdout:55834574852 2023-10-14T09:17:33.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 -- 172.21.15.78:0/2891785564 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bd0066570 msgr2=0x7f0bd0068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bd0066570 0x7f0bd0068a30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0be4000f90 tx=0x7f0be40a7070 comp rx=0 tx=0).stop 2023-10-14T09:17:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 -- 172.21.15.78:0/2891785564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bec1587d0 msgr2=0x7f0bec0c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bec1587d0 0x7f0bec0c4370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00c390 tx=0x7f0bdc00c850 comp rx=0 tx=0).stop 2023-10-14T09:17:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 -- 172.21.15.78:0/2891785564 shutdown_connections 2023-10-14T09:17:33.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bec1587d0 0x7f0bec0c4370 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bd0066570 0x7f0bd0068a30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bec1583f0 0x7f0bec146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 --2- 172.21.15.78:0/2891785564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bec06c9a0 0x7f0bec146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 -- 172.21.15.78:0/2891785564 >> 172.21.15.78:0/2891785564 conn(0x7f0bec0c1cc0 msgr2=0x7f0bec0c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 -- 172.21.15.78:0/2891785564 shutdown_connections 2023-10-14T09:17:33.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.937+0000 7f0bf36ea640 1 -- 172.21.15.78:0/2891785564 wait complete. 2023-10-14T09:17:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.945+0000 7f3abdffb640 1 -- 172.21.15.78:0/825426889 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3ab0005510 con 0x7f3ad806d2c0 2023-10-14T09:17:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.945+0000 7f3abffff640 1 -- 172.21.15.78:0/825426889 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ad0019020 con 0x7f3ad806d2c0 2023-10-14T09:17:33.951 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-10-14T09:17:33.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.945+0000 7ff6d6d72640 1 -- 172.21.15.78:0/914924967 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff6d004e9c0 con 0x7ff6d006cf00 2023-10-14T09:17:33.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.945+0000 7ff6cd7fa640 1 -- 172.21.15.78:0/914924967 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6bc0f4e60 con 0x7ff6d006cf00 2023-10-14T09:17:33.952 INFO:teuthology.orchestra.run.smithi078.stdout:55834574852 2023-10-14T09:17:33.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 -- 172.21.15.78:0/825426889 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3ac4066570 msgr2=0x7f3ac4068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3ac4066570 0x7f3ac4068a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8131e60 tx=0x7f3acc0090e0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 -- 172.21.15.78:0/825426889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 msgr2=0x7f3ad814d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad814d2b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000ba80 tx=0x7f3ad000bf40 comp rx=0 tx=0).stop 2023-10-14T09:17:33.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 -- 172.21.15.78:0/825426889 shutdown_connections 2023-10-14T09:17:33.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ad80c25e0 0x7f3ad812c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ad8071100 0x7f3ad8146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3ac4066570 0x7f3ac4068a30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 --2- 172.21.15.78:0/825426889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ad806d2c0 0x7f3ad814d2b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 -- 172.21.15.78:0/825426889 >> 172.21.15.78:0/825426889 conn(0x7f3ad80c1ac0 msgr2=0x7f3ad814ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 -- 172.21.15.78:0/825426889 shutdown_connections 2023-10-14T09:17:33.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7f3abdffb640 1 -- 172.21.15.78:0/825426889 wait complete. 2023-10-14T09:17:33.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 -- 172.21.15.78:0/914924967 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff6b4066570 msgr2=0x7ff6b4068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff6b4066570 0x7ff6b4068a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0156d80 tx=0x7ff6c4008040 comp rx=0 tx=0).stop 2023-10-14T09:17:33.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 -- 172.21.15.78:0/914924967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d006cf00 msgr2=0x7ff6d0136fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d006cf00 0x7ff6d0136fd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0ad040 tx=0x7ff6bc0191e0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 -- 172.21.15.78:0/914924967 shutdown_connections 2023-10-14T09:17:33.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6d013cd20 0x7ff6d01efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d006fb70 0x7ff6d013b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff6b4066570 0x7ff6b4068a30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 --2- 172.21.15.78:0/914924967 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff6d006cf00 0x7ff6d0136fd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 -- 172.21.15.78:0/914924967 >> 172.21.15.78:0/914924967 conn(0x7ff6d00c1ab0 msgr2=0x7ff6d006d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 -- 172.21.15.78:0/914924967 shutdown_connections 2023-10-14T09:17:33.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.949+0000 7ff6d6d72640 1 -- 172.21.15.78:0/914924967 wait complete. 2023-10-14T09:17:33.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.957+0000 7fa4496dc640 1 -- 172.21.15.78:0/124451498 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa424005510 con 0x7fa43c0d4200 2023-10-14T09:17:33.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.957+0000 7fa440ff9640 1 -- 172.21.15.78:0/124451498 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4380b9020 con 0x7fa43c0d4200 2023-10-14T09:17:33.963 INFO:teuthology.orchestra.run.smithi078.stdout:55834574852 2023-10-14T09:17:33.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.957+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2049361845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe9e81526c0 con 0x7fe9e8157370 2023-10-14T09:17:33.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.957+0000 7fe9d6ffd640 1 -- 172.21.15.78:0/2049361845 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9e81526c0 con 0x7fe9e8157370 2023-10-14T09:17:33.965 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-10-14T09:17:33.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 -- 172.21.15.78:0/124451498 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4280664f0 msgr2=0x7fa4280689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4280664f0 0x7fa4280689b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa44404f480 tx=0x7fa444067f10 comp rx=0 tx=0).stop 2023-10-14T09:17:33.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 -- 172.21.15.78:0/124451498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa43c0d4200 msgr2=0x7fa43c044d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa43c0d4200 0x7fa43c044d20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa4380ab000 tx=0x7fa438019090 comp rx=0 tx=0).stop 2023-10-14T09:17:33.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 -- 172.21.15.78:0/124451498 shutdown_connections 2023-10-14T09:17:33.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa4280664f0 0x7fa4280689b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa43c0d4200 0x7fa43c044d20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa43c043240 0x7fa43c0447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 --2- 172.21.15.78:0/124451498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa43c00e600 0x7fa43c030bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 -- 172.21.15.78:0/124451498 >> 172.21.15.78:0/124451498 conn(0x7fa43c04c630 msgr2=0x7fa43c0059b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 -- 172.21.15.78:0/124451498 shutdown_connections 2023-10-14T09:17:33.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fa4496dc640 1 -- 172.21.15.78:0/124451498 wait complete. 2023-10-14T09:17:33.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2049361845 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe9c8066570 msgr2=0x7fe9c8068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe9c8066570 0x7fe9c8068a30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8006ec0 tx=0x7fe9d8007f30 comp rx=0 tx=0).stop 2023-10-14T09:17:33.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2049361845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9e8157370 msgr2=0x7fe9e81f3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9e8157370 0x7fe9e81f3890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000c780 tx=0x7fe9e000cc40 comp rx=0 tx=0).stop 2023-10-14T09:17:33.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2049361845 shutdown_connections 2023-10-14T09:17:33.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe9c8066570 0x7fe9c8068a30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9e8157370 0x7fe9e81f3890 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe9e80be950 0x7fe9e81345f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 --2- 172.21.15.78:0/2049361845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe9e80be570 0x7fe9e81340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2049361845 >> 172.21.15.78:0/2049361845 conn(0x7fe9e80c1cc0 msgr2=0x7fe9e8156c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7f0be489b640 1 -- 172.21.15.78:0/4230679234 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0be00a9490 con 0x7f0be0149090 2023-10-14T09:17:33.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2049361845 shutdown_connections 2023-10-14T09:17:33.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.961+0000 7fe9ec9a1640 1 -- 172.21.15.78:0/2049361845 wait complete. 2023-10-14T09:17:33.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.965+0000 7f0bc77fe640 1 -- 172.21.15.78:0/4230679234 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0be00a9490 con 0x7f0be0149090 2023-10-14T09:17:33.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-10-14T09:17:33.973 INFO:teuthology.orchestra.run.smithi078.stdout:55834574852 2023-10-14T09:17:33.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 -- 172.21.15.78:0/4230679234 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bcc0664f0 msgr2=0x7f0bcc0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bcc0664f0 0x7f0bcc0689b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40ae000 tx=0x7f0bd4001a10 comp rx=0 tx=0).stop 2023-10-14T09:17:33.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 -- 172.21.15.78:0/4230679234 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be0149090 msgr2=0x7f0be00a9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be0149090 0x7f0be00a9770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0be014e890 tx=0x7f0bd800f870 comp rx=0 tx=0).stop 2023-10-14T09:17:33.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 -- 172.21.15.78:0/4230679234 shutdown_connections 2023-10-14T09:17:33.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0bcc0664f0 0x7f0bcc0689b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0be0149090 0x7f0be00a9770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0be00a8a20 0x7f0be0148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 --2- 172.21.15.78:0/4230679234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bc8003980 0x7f0be00c0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 -- 172.21.15.78:0/4230679234 >> 172.21.15.78:0/4230679234 conn(0x7f0be00c1ac0 msgr2=0x7f0be0149d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 -- 172.21.15.78:0/4230679234 shutdown_connections 2023-10-14T09:17:33.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.969+0000 7f0be489b640 1 -- 172.21.15.78:0/4230679234 wait complete. 2023-10-14T09:17:33.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.973+0000 7f4f3759e640 1 -- 172.21.15.78:0/3732916472 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4f38158dd0 con 0x7f4f3806f9c0 2023-10-14T09:17:33.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.973+0000 7f4f26ffd640 1 -- 172.21.15.78:0/3732916472 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f300ecbf0 con 0x7f4f3806f9c0 2023-10-14T09:17:33.980 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-10-14T09:17:33.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 -- 172.21.15.78:0/3732916472 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f18066570 msgr2=0x7f4f18068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f18066570 0x7f4f18068a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f28000f70 tx=0x7f4f28007a10 comp rx=0 tx=0).stop 2023-10-14T09:17:33.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 -- 172.21.15.78:0/3732916472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f3806f9c0 msgr2=0x7f4f380aa6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:33.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f3806f9c0 0x7f4f380aa6f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f30019480 tx=0x7f4f30019610 comp rx=0 tx=0).stop 2023-10-14T09:17:33.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 -- 172.21.15.78:0/3732916472 shutdown_connections 2023-10-14T09:17:33.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f38141380 0x7f4f38132ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f18066570 0x7f4f18068a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4f380c0af0 0x7f4f38132760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 --2- 172.21.15.78:0/3732916472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4f3806f9c0 0x7f4f380aa6f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:33.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 -- 172.21.15.78:0/3732916472 >> 172.21.15.78:0/3732916472 conn(0x7f4f380c1ac0 msgr2=0x7f4f380c4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:33.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 -- 172.21.15.78:0/3732916472 shutdown_connections 2023-10-14T09:17:33.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:33.977+0000 7f4f3759e640 1 -- 172.21.15.78:0/3732916472 wait complete. 2023-10-14T09:17:33.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-14T09:17:33.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-10-14T09:17:34.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-10-14T09:17:34.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-10-14T09:17:34.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-14T09:17:34.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-10-14T09:17:34.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T09:17:34.974 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T09:17:34.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T09:17:34.997 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T09:17:35.003 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T09:17:35.005 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T09:17:35.010 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T09:17:35.016 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T09:17:35.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.077+0000 7f59bd66b640 1 Processor -- start 2023-10-14T09:17:35.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.077+0000 7f59bd66b640 1 -- start start 2023-10-14T09:17:35.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.077+0000 7f59bd66b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b8149cf0 0x7f59b806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.077+0000 7f59bd66b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f59b80c27e0 0x7f59b815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59b6ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b8149cf0 0x7f59b806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59b77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f59b80c27e0 0x7f59b815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59b77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f59b80c27e0 0x7f59b815a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39430/0 (socket says 172.21.15.78:39430) 2023-10-14T09:17:35.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59b6ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b8149cf0 0x7f59b806fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37554/0 (socket says 172.21.15.78:37554) 2023-10-14T09:17:35.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59b77fe640 1 -- 172.21.15.78:0/2722161826 learned_addr learned my addr 172.21.15.78:0/2722161826 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59bd66b640 1 -- 172.21.15.78:0/2722161826 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b80706c0 con 0x7f59b8153da0 2023-10-14T09:17:35.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59bd66b640 1 -- 172.21.15.78:0/2722161826 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b806c8f0 con 0x7f59b80c27e0 2023-10-14T09:17:35.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59bd66b640 1 -- 172.21.15.78:0/2722161826 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8070960 con 0x7f59b8149cf0 2023-10-14T09:17:35.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59b77fe640 1 -- 172.21.15.78:0/2722161826 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b8149cf0 msgr2=0x7f59b806fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59b77fe640 1 --2- 172.21.15.78:0/2722161826 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b8149cf0 0x7f59b806fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59b77fe640 1 -- 172.21.15.78:0/2722161826 >> v1:172.21.15.157:6789/0 conn(0x7f59b8153da0 legacy=0x7f59b81532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.081+0000 7f59b77fe640 1 -- 172.21.15.78:0/2722161826 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b806cb90 con 0x7f59b80c27e0 2023-10-14T09:17:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.085+0000 7f59b77fe640 1 --2- 172.21.15.78:0/2722161826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b80c27e0 0x7f59b815a6b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009e50 tx=0x7f59b001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80adadb41256684 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.085+0000 7f59b5ffb640 1 -- 172.21.15.78:0/2722161826 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b00a5850 con 0x7f59b80c27e0 2023-10-14T09:17:35.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.085+0000 7f59b5ffb640 1 -- 172.21.15.78:0/2722161826 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b00a59b0 con 0x7f59b80c27e0 2023-10-14T09:17:35.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.085+0000 7f59b5ffb640 1 -- 172.21.15.78:0/2722161826 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b00a5d80 con 0x7f59b80c27e0 2023-10-14T09:17:35.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.089+0000 7f59bd66b640 1 -- 172.21.15.78:0/2722161826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b80c27e0 msgr2=0x7f59b815a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.089+0000 7f59bd66b640 1 --2- 172.21.15.78:0/2722161826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b80c27e0 0x7f59b815a6b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009e50 tx=0x7f59b001ca30 comp rx=0 tx=0).stop 2023-10-14T09:17:35.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.089+0000 7f59bd66b640 1 -- 172.21.15.78:0/2722161826 shutdown_connections 2023-10-14T09:17:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.089+0000 7f59bd66b640 1 --2- 172.21.15.78:0/2722161826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b80c27e0 0x7f59b815a6b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.089+0000 7f59bd66b640 1 --2- 172.21.15.78:0/2722161826 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b8149cf0 0x7f59b806fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.089+0000 7f59bd66b640 1 -- 172.21.15.78:0/2722161826 >> 172.21.15.78:0/2722161826 conn(0x7f59b80c1cc0 msgr2=0x7f59b80c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.089+0000 7f59bd66b640 1 -- 172.21.15.78:0/2722161826 shutdown_connections 2023-10-14T09:17:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.089+0000 7f59bd66b640 1 -- 172.21.15.78:0/2722161826 wait complete. 2023-10-14T09:17:35.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.093+0000 7f59bd66b640 1 Processor -- start 2023-10-14T09:17:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.093+0000 7f59bd66b640 1 -- start start 2023-10-14T09:17:35.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.093+0000 7f59bd66b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b80c27e0 0x7f59b81418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59bd66b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59b8149cf0 0x7f59b814f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59bd66b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b8153da0 0x7f59b814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59bd66b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80ab2f0 con 0x7f59b8153da0 2023-10-14T09:17:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59b6ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b80c27e0 0x7f59b81418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59b6ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b80c27e0 0x7f59b81418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37556/0 (socket says 172.21.15.78:37556) 2023-10-14T09:17:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59b6ffd640 1 -- 172.21.15.78:0/671115974 learned_addr learned my addr 172.21.15.78:0/671115974 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81454e0 con 0x7f59b8149cf0 2023-10-14T09:17:35.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8147e00 con 0x7f59b80c27e0 2023-10-14T09:17:35.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59b77fe640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b8153da0 0x7f59b814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59b6ffd640 1 -- 172.21.15.78:0/671115974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59b8149cf0 msgr2=0x7f59b814f5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T09:17:35.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59b6ffd640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59b8149cf0 0x7f59b814f5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59b6ffd640 1 -- 172.21.15.78:0/671115974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b8153da0 msgr2=0x7f59b814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59b6ffd640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b8153da0 0x7f59b814fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59b6ffd640 1 -- 172.21.15.78:0/671115974 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0009b30 con 0x7f59b80c27e0 2023-10-14T09:17:35.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59b6ffd640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b80c27e0 0x7f59b81418b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e930 tx=0x7f59ac00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f599f7fe640 1 -- 172.21.15.78:0/671115974 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00ca00 con 0x7f59b80c27e0 2023-10-14T09:17:35.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f599f7fe640 1 -- 172.21.15.78:0/671115974 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac00cb60 con 0x7f59b80c27e0 2023-10-14T09:17:35.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f599f7fe640 1 -- 172.21.15.78:0/671115974 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac013470 con 0x7f59b80c27e0 2023-10-14T09:17:35.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b8145730 con 0x7f59b80c27e0 2023-10-14T09:17:35.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.097+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b80aafa0 con 0x7f59b80c27e0 2023-10-14T09:17:35.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.105+0000 7f599f7fe640 1 -- 172.21.15.78:0/671115974 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59ac0135d0 con 0x7f59b80c27e0 2023-10-14T09:17:35.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.105+0000 7f599f7fe640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f59a40665a0 0x7f59a4068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.105+0000 7f599f7fe640 1 -- 172.21.15.78:0/671115974 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59ac084030 con 0x7f59b80c27e0 2023-10-14T09:17:35.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.105+0000 7f59b67fc640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f59a40665a0 0x7f59a4068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.105+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b806ddc0 con 0x7f59b80c27e0 2023-10-14T09:17:35.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.109+0000 7f59b67fc640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f59a40665a0 0x7f59a4068a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59b8148580 tx=0x7f59a80079e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.113+0000 7f599f7fe640 1 -- 172.21.15.78:0/671115974 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59ac051540 con 0x7f59b80c27e0 2023-10-14T09:17:35.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.181+0000 7f41b5617640 1 Processor -- start 2023-10-14T09:17:35.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.181+0000 7f41b5617640 1 -- start start 2023-10-14T09:17:35.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.181+0000 7f41b5617640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f41b006cfe0 0x7f41b0071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.181+0000 7f41b5617640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f41b0138f20 0x7f41b0153370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.185+0000 7f41b5617640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b014fe50 con 0x7f41b0071100 2023-10-14T09:17:35.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.185+0000 7f41b5617640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b0150130 con 0x7f41b006cfe0 2023-10-14T09:17:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.185+0000 7f41b5617640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b0150410 con 0x7f41b0138f20 2023-10-14T09:17:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.185+0000 7f41b4e16640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f41b0138f20 0x7f41b0153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.185+0000 7f41b4e16640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f41b0138f20 0x7f41b0153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48318/0 (socket says 172.21.15.78:48318) 2023-10-14T09:17:35.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.185+0000 7f41b4e16640 1 -- 172.21.15.78:0/1260450434 learned_addr learned my addr 172.21.15.78:0/1260450434 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.185+0000 7f41b4e16640 1 -- 172.21.15.78:0/1260450434 >> v2:172.21.15.78:3300/0 conn(0x7f41b006cfe0 msgr2=0x7f41b0071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.185+0000 7f41b4e16640 1 --2- 172.21.15.78:0/1260450434 >> v2:172.21.15.78:3300/0 conn(0x7f41b006cfe0 0x7f41b0071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.185+0000 7f41b4e16640 1 -- 172.21.15.78:0/1260450434 >> v1:172.21.15.78:6789/0 conn(0x7f41b0071100 legacy=0x7f41b0138810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.185+0000 7f41b4e16640 1 -- 172.21.15.78:0/1260450434 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b01506f0 con 0x7f41b0138f20 2023-10-14T09:17:35.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.189+0000 7f41b4e16640 1 --2- 172.21.15.78:0/1260450434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b0138f20 0x7f41b0153370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41b00c2ac0 tx=0x7f41a001d630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5c176bf69b40faa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.189+0000 7f41aeffd640 1 -- 172.21.15.78:0/1260450434 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a00a76d0 con 0x7f41b0138f20 2023-10-14T09:17:35.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.189+0000 7f41aeffd640 1 -- 172.21.15.78:0/1260450434 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a00a7830 con 0x7f41b0138f20 2023-10-14T09:17:35.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.189+0000 7f41aeffd640 1 -- 172.21.15.78:0/1260450434 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a00a7bc0 con 0x7f41b0138f20 2023-10-14T09:17:35.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.193+0000 7f41b5617640 1 -- 172.21.15.78:0/1260450434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b0138f20 msgr2=0x7f41b0153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.193+0000 7f41b5617640 1 --2- 172.21.15.78:0/1260450434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b0138f20 0x7f41b0153370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41b00c2ac0 tx=0x7f41a001d630 comp rx=0 tx=0).stop 2023-10-14T09:17:35.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.193+0000 7f41b5617640 1 -- 172.21.15.78:0/1260450434 shutdown_connections 2023-10-14T09:17:35.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.193+0000 7f41b5617640 1 --2- 172.21.15.78:0/1260450434 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b0138f20 0x7f41b0153370 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.193+0000 7f41b5617640 1 --2- 172.21.15.78:0/1260450434 >> v2:172.21.15.78:3300/0 conn(0x7f41b006cfe0 0x7f41b0071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.193+0000 7f41b5617640 1 -- 172.21.15.78:0/1260450434 >> 172.21.15.78:0/1260450434 conn(0x7f41b00c1ac0 msgr2=0x7f41b00c1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.193+0000 7f41b5617640 1 -- 172.21.15.78:0/1260450434 shutdown_connections 2023-10-14T09:17:35.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.193+0000 7f41b5617640 1 -- 172.21.15.78:0/1260450434 wait complete. 2023-10-14T09:17:35.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41b5617640 1 Processor -- start 2023-10-14T09:17:35.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41b5617640 1 -- start start 2023-10-14T09:17:35.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41b5617640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b006cfe0 0x7f41b0136e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41b5617640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41b0071100 0x7f41b00a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41b5617640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b0138f20 0x7f41b00c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b006cfe0 0x7f41b0136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b006cfe0 0x7f41b0136e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39462/0 (socket says 172.21.15.78:39462) 2023-10-14T09:17:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41affff640 1 -- 172.21.15.78:0/3827307257 learned_addr learned my addr 172.21.15.78:0/3827307257 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b006fec0 con 0x7f41b006cfe0 2023-10-14T09:17:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b01e8800 con 0x7f41b0138f20 2023-10-14T09:17:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b01e7ed0 con 0x7f41b0071100 2023-10-14T09:17:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.197+0000 7f41b4e16640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b0138f20 0x7f41b00c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41af7fe640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41b0071100 0x7f41b00a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41b4e16640 1 -- 172.21.15.78:0/3827307257 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41b0071100 msgr2=0x7f41b00a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41b4e16640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41b0071100 0x7f41b00a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41b4e16640 1 -- 172.21.15.78:0/3827307257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b006cfe0 msgr2=0x7f41b0136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41b4e16640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b006cfe0 0x7f41b0136e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41b4e16640 1 -- 172.21.15.78:0/3827307257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a0009d60 con 0x7f41b0138f20 2023-10-14T09:17:35.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41b4e16640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b0138f20 0x7f41b00c3e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41a00ad000 tx=0x7f41a001a3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41acff9640 1 -- 172.21.15.78:0/3827307257 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a00af830 con 0x7f41b0138f20 2023-10-14T09:17:35.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b01e81b0 con 0x7f41b0138f20 2023-10-14T09:17:35.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b01373a0 con 0x7f41b0138f20 2023-10-14T09:17:35.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41acff9640 1 -- 172.21.15.78:0/3827307257 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a00af990 con 0x7f41b0138f20 2023-10-14T09:17:35.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41acff9640 1 -- 172.21.15.78:0/3827307257 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a00afd40 con 0x7f41b0138f20 2023-10-14T09:17:35.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.201+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4190005260 con 0x7f41b0138f20 2023-10-14T09:17:35.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.205+0000 7f41acff9640 1 -- 172.21.15.78:0/3827307257 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f41a00c1460 con 0x7f41b0138f20 2023-10-14T09:17:35.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.205+0000 7f41acff9640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f419c066500 0x7f419c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.205+0000 7f41acff9640 1 -- 172.21.15.78:0/3827307257 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41a00ab070 con 0x7f41b0138f20 2023-10-14T09:17:35.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.205+0000 7f41affff640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f419c066500 0x7f419c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.209+0000 7f41affff640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f419c066500 0x7f419c0689c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f41a800e250 tx=0x7f41a800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.213+0000 7f41acff9640 1 -- 172.21.15.78:0/3827307257 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f41a00ec5b0 con 0x7f41b0138f20 2023-10-14T09:17:35.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.269+0000 7f88e550f640 1 Processor -- start 2023-10-14T09:17:35.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.269+0000 7f88e550f640 1 -- start start 2023-10-14T09:17:35.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.269+0000 7f0d5b39d640 1 Processor -- start 2023-10-14T09:17:35.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.269+0000 7fdd91cea640 1 Processor -- start 2023-10-14T09:17:35.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.269+0000 7f88e550f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f88e01572f0 0x7f88e0154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88e550f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e0070c90 con 0x7f88e00be950 2023-10-14T09:17:35.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88e550f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e0157860 con 0x7f88e00be570 2023-10-14T09:17:35.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88e550f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e00bee00 con 0x7f88e01572f0 2023-10-14T09:17:35.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88deffd640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f88e00be570 0x7f88e0071120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51780/0 (socket says 172.21.15.78:51780) 2023-10-14T09:17:35.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88deffd640 1 -- 172.21.15.78:0/2444658631 learned_addr learned my addr 172.21.15.78:0/2444658631 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684937480 0 0) 0x7f88e0157860 con 0x7f88e00be570 2023-10-14T09:17:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88de7fc640 1 --2- 172.21.15.78:0/2444658631 >> v2:172.21.15.157:3300/0 conn(0x7f88e01572f0 0x7f88e0154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88c8003530 con 0x7f88e00be570 2023-10-14T09:17:35.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f770db0f640 1 Processor -- start 2023-10-14T09:17:35.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4120024621 0 0) 0x7f88c8003530 con 0x7f88e00be570 2023-10-14T09:17:35.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 >> v2:172.21.15.157:3300/0 conn(0x7f88e01572f0 msgr2=0x7f88e0154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 --2- 172.21.15.78:0/2444658631 >> v2:172.21.15.157:3300/0 conn(0x7f88e01572f0 0x7f88e0154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 >> v1:172.21.15.78:6789/0 conn(0x7f88e00be950 legacy=0x7f88e0071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0157b40 con 0x7f88e00be570 2023-10-14T09:17:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f0d5b39d640 1 -- start start 2023-10-14T09:17:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f0d5b39d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0d54149cf0 0x7f0d5406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f0d5b39d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54153da0 0x7f0d541532d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f0d5b39d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d540706c0 con 0x7f0d54153810 2023-10-14T09:17:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f0d5b39d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5406c8f0 con 0x7f0d54149cf0 2023-10-14T09:17:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f0d5b39d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54070960 con 0x7f0d54153da0 2023-10-14T09:17:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f88d4001680 con 0x7f88e00be570 2023-10-14T09:17:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 >> v1:172.21.15.157:6789/0 conn(0x7f88e00be570 legacy=0x7f88e0071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 --2- 172.21.15.78:0/2444658631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88c8003980 0x7f88c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 --2- 172.21.15.78:0/2444658631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80047d0 0x7f88c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 --2- 172.21.15.78:0/2444658631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88c8005190 0x7f88c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00bee00 con 0x7f88c8005190 2023-10-14T09:17:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80148a0 con 0x7f88c80047d0 2023-10-14T09:17:35.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c8014a60 con 0x7f88c8003980 2023-10-14T09:17:35.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f770db0f640 1 -- start start 2023-10-14T09:17:35.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f3a54d0f640 1 Processor -- start 2023-10-14T09:17:35.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f0d59139640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0d54149cf0 0x7f0d5406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f3a54d0f640 1 -- start start 2023-10-14T09:17:35.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f770db0f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f77080c4fa0 0x7f7708157e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f770db0f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77080c4400 0x7f77080c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f770db0f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77080c4950 con 0x7f7708151240 2023-10-14T09:17:35.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f770db0f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77080c7bf0 con 0x7f77080c4400 2023-10-14T09:17:35.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f770db0f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7708157370 con 0x7f77080c4fa0 2023-10-14T09:17:35.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7fdd91cea640 1 -- start start 2023-10-14T09:17:35.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f0d58938640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54153da0 0x7f0d541532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f0d59139640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0d54149cf0 0x7f0d5406fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48338/0 (socket says 172.21.15.78:48338) 2023-10-14T09:17:35.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f0d59139640 1 -- 172.21.15.78:0/2807001100 learned_addr learned my addr 172.21.15.78:0/2807001100 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88deffd640 1 --2- 172.21.15.78:0/2444658631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88c8003980 0x7f88c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.273+0000 7f88de7fc640 1 --2- 172.21.15.78:0/2444658631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80047d0 0x7f88c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f77077fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7708151240 0x7f77080c74e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51798/0 (socket says 172.21.15.78:51798) 2023-10-14T09:17:35.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f77077fe640 1 -- 172.21.15.78:0/3475275810 learned_addr learned my addr 172.21.15.78:0/3475275810 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:35.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f88deffd640 1 -- 172.21.15.78:0/2444658631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80047d0 msgr2=0x7f88c8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f88deffd640 1 --2- 172.21.15.78:0/2444658631 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c80047d0 0x7f88c8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f88deffd640 1 -- 172.21.15.78:0/2444658631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88c8005190 msgr2=0x7f88c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f88deffd640 1 --2- 172.21.15.78:0/2444658631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88c8005190 0x7f88c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f88deffd640 1 -- 172.21.15.78:0/2444658631 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0070c90 con 0x7f88c8003980 2023-10-14T09:17:35.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f7706ffd640 1 --2- 172.21.15.78:0/3475275810 >> v2:172.21.15.157:3300/0 conn(0x7f77080c4fa0 0x7f7708157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f0d59139640 1 -- 172.21.15.78:0/2807001100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54153da0 msgr2=0x7f0d541532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f0d59139640 1 --2- 172.21.15.78:0/2807001100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54153da0 0x7f0d541532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f0d59139640 1 -- 172.21.15.78:0/2807001100 >> v1:172.21.15.157:6789/0 conn(0x7f0d54153810 legacy=0x7f0d540bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f88df7fe640 1 -- 172.21.15.78:0/2444658631 reap_dead start 2023-10-14T09:17:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f7707fff640 1 --2- 172.21.15.78:0/3475275810 >> v2:172.21.15.78:3300/0 conn(0x7f77080c4400 0x7f77080c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd91cea640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdd8c14d920 0x7fdd8c06d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd91cea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdd8c153e70 0x7fdd8c15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd91cea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c0c45d0 con 0x7fdd8c0c3a30 2023-10-14T09:17:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd91cea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c0a4cb0 con 0x7fdd8c153e70 2023-10-14T09:17:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd91cea640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8c0a4ec0 con 0x7fdd8c14d920 2023-10-14T09:17:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f7706ffd640 1 -- 172.21.15.78:0/3475275810 >> v2:172.21.15.78:3300/0 conn(0x7f77080c4400 msgr2=0x7f77080c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f0d59139640 1 -- 172.21.15.78:0/2807001100 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5406cb90 con 0x7f0d54149cf0 2023-10-14T09:17:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f0d58938640 1 --2- 172.21.15.78:0/2807001100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54153da0 0x7f0d541532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:35.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd8affd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdd8c0c3a30 0x7fdd8c153760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33982/0 (socket says 172.21.15.78:33982) 2023-10-14T09:17:35.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd8affd640 1 -- 172.21.15.78:0/439400511 learned_addr learned my addr 172.21.15.78:0/439400511 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:35.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd8bfff640 1 --2- 172.21.15.78:0/439400511 >> v2:172.21.15.78:3300/0 conn(0x7fdd8c153e70 0x7fdd8c15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f77067fc640 1 -- 172.21.15.78:0/3475275810 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646197549 0 0) 0x7f77080c4950 con 0x7f7708151240 2023-10-14T09:17:35.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f7706ffd640 1 --2- 172.21.15.78:0/3475275810 >> v2:172.21.15.78:3300/0 conn(0x7f77080c4400 0x7f77080c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f7706ffd640 1 -- 172.21.15.78:0/3475275810 >> v1:172.21.15.157:6789/0 conn(0x7f7708151240 legacy=0x7f77080c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f3a54d0f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a500be570 0x7f3a501549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f3a54d0f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3a50157370 0x7f3a500be950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f7706ffd640 1 -- 172.21.15.78:0/3475275810 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7708157650 con 0x7f77080c4fa0 2023-10-14T09:17:35.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7f7707fff640 1 --2- 172.21.15.78:0/3475275810 >> v2:172.21.15.78:3300/0 conn(0x7f77080c4400 0x7f77080c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd8bfff640 1 -- 172.21.15.78:0/439400511 >> v2:172.21.15.157:3300/0 conn(0x7fdd8c14d920 msgr2=0x7fdd8c06d590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:17:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd8bfff640 1 --2- 172.21.15.78:0/439400511 >> v2:172.21.15.157:3300/0 conn(0x7fdd8c14d920 0x7fdd8c06d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd8bfff640 1 -- 172.21.15.78:0/439400511 >> v1:172.21.15.78:6789/0 conn(0x7fdd8c0c3a30 legacy=0x7fdd8c153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.277+0000 7fdd8bfff640 1 -- 172.21.15.78:0/439400511 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c1504c0 con 0x7fdd8c153e70 2023-10-14T09:17:35.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f3a45d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3a50157370 0x7f3a500be950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f3a45d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3a50157370 0x7f3a500be950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39514/0 (socket says 172.21.15.78:39514) 2023-10-14T09:17:35.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f3a45d9b640 1 -- 172.21.15.78:0/1110987862 learned_addr learned my addr 172.21.15.78:0/1110987862 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1110987862 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a501578e0 con 0x7f3a50071120 2023-10-14T09:17:35.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1110987862 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5006ffd0 con 0x7f3a50157370 2023-10-14T09:17:35.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1110987862 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a50157bc0 con 0x7f3a500be570 2023-10-14T09:17:35.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f88deffd640 1 --2- 172.21.15.78:0/2444658631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88c8003980 0x7f88c8003da0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88d400c240 tx=0x7f88d401cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11f3922f5436e44c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f3a4e59c640 1 --2- 172.21.15.78:0/1110987862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a500be570 0x7f3a501549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f3a45d9b640 1 -- 172.21.15.78:0/1110987862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a500be570 msgr2=0x7f3a501549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f3a45d9b640 1 --2- 172.21.15.78:0/1110987862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a500be570 0x7f3a501549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f3a45d9b640 1 -- 172.21.15.78:0/1110987862 >> v1:172.21.15.78:6789/0 conn(0x7f3a50071120 legacy=0x7f3a500715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f3a45d9b640 1 -- 172.21.15.78:0/1110987862 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50157ea0 con 0x7f3a50157370 2023-10-14T09:17:35.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f7706ffd640 1 --2- 172.21.15.78:0/3475275810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77080c4fa0 0x7f7708157e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f77080c9520 tx=0x7f76fc01c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22be579971dc580 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f77067fc640 1 -- 172.21.15.78:0/3475275810 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0ab600 con 0x7f77080c4fa0 2023-10-14T09:17:35.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f77067fc640 1 -- 172.21.15.78:0/3475275810 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc0a7050 con 0x7f77080c4fa0 2023-10-14T09:17:35.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f77067fc640 1 -- 172.21.15.78:0/3475275810 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0ab980 con 0x7f77080c4fa0 2023-10-14T09:17:35.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d40a58d0 con 0x7f88c8003980 2023-10-14T09:17:35.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d40a5a30 con 0x7f88c8003980 2023-10-14T09:17:35.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f88ddffb640 1 -- 172.21.15.78:0/2444658631 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d40a5e60 con 0x7f88c8003980 2023-10-14T09:17:35.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f0d59139640 1 --2- 172.21.15.78:0/2807001100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d54149cf0 0x7f0d5406fc10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d50008870 tx=0x7f0d5001e850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21f4a5a5817c3878 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f0d4bfff640 1 -- 172.21.15.78:0/2807001100 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d500a77b0 con 0x7f0d54149cf0 2023-10-14T09:17:35.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f0d4bfff640 1 -- 172.21.15.78:0/2807001100 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d500ab070 con 0x7f0d54149cf0 2023-10-14T09:17:35.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f0d4bfff640 1 -- 172.21.15.78:0/2807001100 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d500a7b30 con 0x7f0d54149cf0 2023-10-14T09:17:35.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f770db0f640 1 -- 172.21.15.78:0/3475275810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77080c4fa0 msgr2=0x7f7708157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f770db0f640 1 --2- 172.21.15.78:0/3475275810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77080c4fa0 0x7f7708157e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f77080c9520 tx=0x7f76fc01c3d0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f770db0f640 1 -- 172.21.15.78:0/3475275810 shutdown_connections 2023-10-14T09:17:35.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f770db0f640 1 --2- 172.21.15.78:0/3475275810 >> v2:172.21.15.78:3300/0 conn(0x7f77080c4400 0x7f77080c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f770db0f640 1 --2- 172.21.15.78:0/3475275810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77080c4fa0 0x7f7708157e50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f770db0f640 1 -- 172.21.15.78:0/3475275810 >> 172.21.15.78:0/3475275810 conn(0x7f77080c6060 msgr2=0x7f77080c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f770db0f640 1 -- 172.21.15.78:0/3475275810 shutdown_connections 2023-10-14T09:17:35.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7fdd8bfff640 1 --2- 172.21.15.78:0/439400511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c153e70 0x7fdd8c15aaf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0c3450 tx=0x7fdd8401d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a523c8e98c2a4694 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f88e550f640 1 -- 172.21.15.78:0/2444658631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88c8003980 msgr2=0x7f88c8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.281+0000 7f88e550f640 1 --2- 172.21.15.78:0/2444658631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88c8003980 0x7f88c8003da0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88d400c240 tx=0x7f88d401cbf0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2807001100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d54149cf0 msgr2=0x7f0d5406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f0d5b39d640 1 --2- 172.21.15.78:0/2807001100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d54149cf0 0x7f0d5406fc10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d50008870 tx=0x7f0d5001e850 comp rx=0 tx=0).stop 2023-10-14T09:17:35.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7fdd8a7fc640 1 -- 172.21.15.78:0/439400511 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400a2d0 con 0x7fdd8c153e70 2023-10-14T09:17:35.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f6933332640 1 Processor -- start 2023-10-14T09:17:35.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f6933332640 1 -- start start 2023-10-14T09:17:35.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f770db0f640 1 -- 172.21.15.78:0/3475275810 wait complete. 2023-10-14T09:17:35.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f88e550f640 1 -- 172.21.15.78:0/2444658631 shutdown_connections 2023-10-14T09:17:35.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f88e550f640 1 --2- 172.21.15.78:0/2444658631 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88c8003980 0x7f88c8003da0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f88e550f640 1 -- 172.21.15.78:0/2444658631 >> 172.21.15.78:0/2444658631 conn(0x7f88e00c1cc0 msgr2=0x7f88e00c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7fdd8a7fc640 1 -- 172.21.15.78:0/439400511 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd840a6810 con 0x7fdd8c153e70 2023-10-14T09:17:35.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7fdd8a7fc640 1 -- 172.21.15.78:0/439400511 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd840a6ba0 con 0x7fdd8c153e70 2023-10-14T09:17:35.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7fdd91cea640 1 -- 172.21.15.78:0/439400511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c153e70 msgr2=0x7fdd8c15aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7fdd91cea640 1 --2- 172.21.15.78:0/439400511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c153e70 0x7fdd8c15aaf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0c3450 tx=0x7fdd8401d950 comp rx=0 tx=0).stop 2023-10-14T09:17:35.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7fdd91cea640 1 -- 172.21.15.78:0/439400511 shutdown_connections 2023-10-14T09:17:35.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7fdd91cea640 1 --2- 172.21.15.78:0/439400511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c153e70 0x7fdd8c15aaf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7fdd91cea640 1 --2- 172.21.15.78:0/439400511 >> v2:172.21.15.157:3300/0 conn(0x7fdd8c14d920 0x7fdd8c06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7fdd91cea640 1 -- 172.21.15.78:0/439400511 >> 172.21.15.78:0/439400511 conn(0x7fdd8c0c25b0 msgr2=0x7fdd8c0c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2807001100 shutdown_connections 2023-10-14T09:17:35.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f0d5b39d640 1 --2- 172.21.15.78:0/2807001100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54153da0 0x7f0d541532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f0d5b39d640 1 --2- 172.21.15.78:0/2807001100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d54149cf0 0x7f0d5406fc10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2807001100 >> 172.21.15.78:0/2807001100 conn(0x7f0d540c1cc0 msgr2=0x7f0d540c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f3a45d9b640 1 --2- 172.21.15.78:0/1110987862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a50157370 0x7f3a500be950 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009e50 tx=0x7f3a3801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a378c0108b32ab24 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f6933332640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f692c0ca7b0 0x7f692c02b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f6933332640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f692c02c6d0 0x7f692c02ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f6933332640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c158020 con 0x7f692c02bfa0 2023-10-14T09:17:35.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f6933332640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c157cf0 con 0x7f692c0ca7b0 2023-10-14T09:17:35.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f6933332640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c0c75b0 con 0x7f692c02c6d0 2023-10-14T09:17:35.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f88e550f640 1 -- 172.21.15.78:0/2444658631 shutdown_connections 2023-10-14T09:17:35.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f3a4dd9b640 1 -- 172.21.15.78:0/1110987862 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a380a5870 con 0x7f3a50157370 2023-10-14T09:17:35.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7fdd91cea640 1 -- 172.21.15.78:0/439400511 shutdown_connections 2023-10-14T09:17:35.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f3a4dd9b640 1 -- 172.21.15.78:0/1110987862 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a380a59d0 con 0x7f3a50157370 2023-10-14T09:17:35.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f3a4dd9b640 1 -- 172.21.15.78:0/1110987862 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a380a5d60 con 0x7f3a50157370 2023-10-14T09:17:35.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f6934594640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f692c02bfa0 0x7f692c0c77f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:51806/0 (socket says 172.21.15.78:51806) 2023-10-14T09:17:35.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f6934594640 1 -- 172.21.15.78:0/3828580835 learned_addr learned my addr 172.21.15.78:0/3828580835 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:35.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7fdd91cea640 1 -- 172.21.15.78:0/439400511 wait complete. 2023-10-14T09:17:35.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f6932330640 1 --2- 172.21.15.78:0/3828580835 >> v2:172.21.15.157:3300/0 conn(0x7f692c0ca7b0 0x7f692c02b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2807001100 shutdown_connections 2023-10-14T09:17:35.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f770db0f640 1 Processor -- start 2023-10-14T09:17:35.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2807001100 wait complete. 2023-10-14T09:17:35.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f88e550f640 1 -- 172.21.15.78:0/2444658631 wait complete. 2023-10-14T09:17:35.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f693132e640 1 -- 172.21.15.78:0/3828580835 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221154705 0 0) 0x7f692c158020 con 0x7f692c02bfa0 2023-10-14T09:17:35.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.285+0000 7f693132e640 1 -- 172.21.15.78:0/3828580835 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f691c003530 con 0x7f692c02bfa0 2023-10-14T09:17:35.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1110987862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a50157370 msgr2=0x7f3a500be950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f3a54d0f640 1 --2- 172.21.15.78:0/1110987862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a50157370 0x7f3a500be950 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009e50 tx=0x7f3a3801c9e0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1110987862 shutdown_connections 2023-10-14T09:17:35.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f3a54d0f640 1 --2- 172.21.15.78:0/1110987862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a50157370 0x7f3a500be950 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f3a54d0f640 1 --2- 172.21.15.78:0/1110987862 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a500be570 0x7f3a501549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1110987862 >> 172.21.15.78:0/1110987862 conn(0x7f3a500c1cc0 msgr2=0x7f3a500c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f88e550f640 1 Processor -- start 2023-10-14T09:17:35.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f770db0f640 1 -- start start 2023-10-14T09:17:35.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7fdd91cea640 1 Processor -- start 2023-10-14T09:17:35.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f0d5b39d640 1 Processor -- start 2023-10-14T09:17:35.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1110987862 shutdown_connections 2023-10-14T09:17:35.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1110987862 wait complete. 2023-10-14T09:17:35.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f0d5b39d640 1 -- start start 2023-10-14T09:17:35.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f88e550f640 1 -- start start 2023-10-14T09:17:35.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f88e550f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c8003980 0x7f88e00bd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f88e550f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88e01e89c0 0x7f88e00bd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f88e550f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e01337a0 0x7f88e0133c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f88e550f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e0155fb0 con 0x7f88e01337a0 2023-10-14T09:17:35.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f88e550f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00bdc90 con 0x7f88c8003980 2023-10-14T09:17:35.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f88e550f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e01e8e50 con 0x7f88e01e89c0 2023-10-14T09:17:35.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f88deffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c8003980 0x7f88e00bd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f88deffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c8003980 0x7f88e00bd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48388/0 (socket says 172.21.15.78:48388) 2023-10-14T09:17:35.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f88deffd640 1 -- 172.21.15.78:0/1592388641 learned_addr learned my addr 172.21.15.78:0/1592388641 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f6932330640 1 -- 172.21.15.78:0/3828580835 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f692c02c6d0 msgr2=0x7f692c02ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f6932330640 1 --2- 172.21.15.78:0/3828580835 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f692c02c6d0 0x7f692c02ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f6932330640 1 -- 172.21.15.78:0/3828580835 >> v1:172.21.15.157:6789/0 conn(0x7f692c02bfa0 legacy=0x7f692c0c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7f6932330640 1 -- 172.21.15.78:0/3828580835 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c0c5890 con 0x7f692c0ca7b0 2023-10-14T09:17:35.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.289+0000 7fdd91cea640 1 -- start start 2023-10-14T09:17:35.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd91cea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd8c0c3a30 0x7fdd8c1ee040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d5b39d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54149cf0 0x7f0d540c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f88deffd640 1 -- 172.21.15.78:0/1592388641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88e01e89c0 msgr2=0x7f88e00bd750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T09:17:35.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f88deffd640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88e01e89c0 0x7f88e00bd750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f88deffd640 1 -- 172.21.15.78:0/1592388641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e01337a0 msgr2=0x7f88e0133c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T09:17:35.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f88deffd640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e01337a0 0x7f88e0133c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f88deffd640 1 -- 172.21.15.78:0/1592388641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e01570c0 con 0x7f88c8003980 2023-10-14T09:17:35.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd91cea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd8c14d920 0x7fdd8c1f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d5b39d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d54153810 0x7f0d54144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd91cea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c153e70 0x7fdd8c1f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f88deffd640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c8003980 0x7f88e00bd210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88d401ca20 tx=0x7f88c8005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8b7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd8c0c3a30 0x7fdd8c1ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d59139640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54149cf0 0x7f0d540c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d59139640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54149cf0 0x7f0d540c3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37616/0 (socket says 172.21.15.78:37616) 2023-10-14T09:17:35.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8affd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd8c14d920 0x7fdd8c1f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f3a54d0f640 1 Processor -- start 2023-10-14T09:17:35.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c153e70 0x7fdd8c1f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8b7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd8c0c3a30 0x7fdd8c1ee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48394/0 (socket says 172.21.15.78:48394) 2023-10-14T09:17:35.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c153e70 0x7fdd8c1f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39538/0 (socket says 172.21.15.78:39538) 2023-10-14T09:17:35.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f6932330640 1 --2- 172.21.15.78:0/3828580835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f692c0ca7b0 0x7f692c02b520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6920009d90 tx=0x7f692001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c8df4354501d07 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d58938640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d54153810 0x7f0d54144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8b7fe640 1 -- 172.21.15.78:0/2524595958 learned_addr learned my addr 172.21.15.78:0/2524595958 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1469c0 con 0x7fdd8c153e70 2023-10-14T09:17:35.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c152f60 con 0x7fdd8c0c3a30 2023-10-14T09:17:35.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d58938640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d54153810 0x7f0d54144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39526/0 (socket says 172.21.15.78:39526) 2023-10-14T09:17:35.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c146440 con 0x7fdd8c14d920 2023-10-14T09:17:35.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f770db0f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77080c4400 0x7f770815dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f770db0f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77080c4fa0 0x7f77081564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f770db0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7708151240 0x7f77081f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f693132e640 1 -- 172.21.15.78:0/3828580835 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200a58b0 con 0x7f692c0ca7b0 2023-10-14T09:17:35.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f770db0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77081f45d0 con 0x7f7708151240 2023-10-14T09:17:35.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f770db0f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77081f05a0 con 0x7f77080c4fa0 2023-10-14T09:17:35.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f770db0f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77081f0880 con 0x7f77080c4400 2023-10-14T09:17:35.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d5b39d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d54153da0 0x7f0d54152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f77077fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77080c4400 0x7f770815dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f693132e640 1 -- 172.21.15.78:0/3828580835 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69200a5a10 con 0x7f692c0ca7b0 2023-10-14T09:17:35.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f3a54d0f640 1 -- start start 2023-10-14T09:17:35.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f77077fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77080c4400 0x7f770815dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37630/0 (socket says 172.21.15.78:37630) 2023-10-14T09:17:35.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f77077fe640 1 -- 172.21.15.78:0/186428431 learned_addr learned my addr 172.21.15.78:0/186428431 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f693132e640 1 -- 172.21.15.78:0/3828580835 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200a5da0 con 0x7f692c0ca7b0 2023-10-14T09:17:35.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d5b39d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540ab380 con 0x7f0d54153810 2023-10-14T09:17:35.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f7706ffd640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77080c4fa0 0x7f77081564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d5b39d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54144a30 con 0x7f0d54153da0 2023-10-14T09:17:35.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d5b39d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54144700 con 0x7f0d54149cf0 2023-10-14T09:17:35.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d5993a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d54153da0 0x7f0d54152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d5993a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d54153da0 0x7f0d54152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48406/0 (socket says 172.21.15.78:48406) 2023-10-14T09:17:35.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d5993a640 1 -- 172.21.15.78:0/2744646093 learned_addr learned my addr 172.21.15.78:0/2744646093 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8bfff640 1 -- 172.21.15.78:0/2524595958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd8c14d920 msgr2=0x7fdd8c1f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8bfff640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd8c14d920 0x7fdd8c1f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8bfff640 1 -- 172.21.15.78:0/2524595958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd8c0c3a30 msgr2=0x7fdd8c1ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8bfff640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd8c0c3a30 0x7fdd8c1ee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8bfff640 1 -- 172.21.15.78:0/2524595958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8400ab80 con 0x7fdd8c153e70 2023-10-14T09:17:35.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8b7fe640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd8c0c3a30 0x7fdd8c1ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-10-14T09:17:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8affd640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd8c14d920 0x7fdd8c1f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f7707fff640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7708151240 0x7f77081f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7fdd8bfff640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c153e70 0x7fdd8c1f46e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdd840ac000 tx=0x7fdd8401a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f7706ffd640 1 -- 172.21.15.78:0/186428431 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77080c4400 msgr2=0x7f770815dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f7706ffd640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77080c4400 0x7f770815dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f7706ffd640 1 -- 172.21.15.78:0/186428431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7708151240 msgr2=0x7f77081f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f7706ffd640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7708151240 0x7f77081f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f7706ffd640 1 -- 172.21.15.78:0/186428431 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700009a70 con 0x7f77080c4fa0 2023-10-14T09:17:35.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d59139640 1 -- 172.21.15.78:0/2744646093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d54153da0 msgr2=0x7f0d54152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f0d59139640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d54153da0 0x7f0d54152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f88c77fe640 1 -- 172.21.15.78:0/1592388641 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4001680 con 0x7f88c8003980 2023-10-14T09:17:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f88c77fe640 1 -- 172.21.15.78:0/1592388641 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d40047f0 con 0x7f88c8003980 2023-10-14T09:17:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f88c77fe640 1 -- 172.21.15.78:0/1592388641 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4004b60 con 0x7f88c8003980 2023-10-14T09:17:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f88e550f640 1 -- 172.21.15.78:0/1592388641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e0156b00 con 0x7f88c8003980 2023-10-14T09:17:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f0d59139640 1 -- 172.21.15.78:0/2744646093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d54153810 msgr2=0x7f0d54144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.293+0000 7f88e550f640 1 -- 172.21.15.78:0/1592388641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e0134170 con 0x7f88c8003980 2023-10-14T09:17:35.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a54d0f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a50071120 0x7f3a500c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f0d59139640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d54153810 0x7f0d54144ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a54d0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a500be570 0x7f3a50154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f7706ffd640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77080c4fa0 0x7f77081564c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0ab000 tx=0x7f76fc019170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a4e59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a50071120 0x7f3a500c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a4e59c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a50071120 0x7f3a500c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:48414/0 (socket says 172.21.15.78:48414) 2023-10-14T09:17:35.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a4e59c640 1 -- 172.21.15.78:0/1954361453 learned_addr learned my addr 172.21.15.78:0/1954361453 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7fdd73fff640 1 -- 172.21.15.78:0/2524595958 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd840bc070 con 0x7fdd8c153e70 2023-10-14T09:17:35.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f0d59139640 1 -- 172.21.15.78:0/2744646093 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50008550 con 0x7f0d54149cf0 2023-10-14T09:17:35.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a45d9b640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a500be570 0x7f3a50154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f0d59139640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54149cf0 0x7f0d540c3c70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0d500af000 tx=0x7f0d5001d090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a54d0f640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a50157370 0x7f3a501f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500c37d0 con 0x7f3a500be570 2023-10-14T09:17:35.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500c3a50 con 0x7f3a50071120 2023-10-14T09:17:35.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500a8a50 con 0x7f3a50157370 2023-10-14T09:17:35.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f0d49ffb640 1 -- 172.21.15.78:0/2744646093 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d500a8a10 con 0x7f0d54149cf0 2023-10-14T09:17:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a4ed9d640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a50157370 0x7f3a501f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a4e59c640 1 -- 172.21.15.78:0/1954361453 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a50157370 msgr2=0x7f3a501f39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a4e59c640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a50157370 0x7f3a501f39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a4e59c640 1 -- 172.21.15.78:0/1954361453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a500be570 msgr2=0x7f3a50154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a4e59c640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a500be570 0x7f3a50154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a4e59c640 1 -- 172.21.15.78:0/1954361453 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a38009b30 con 0x7f3a50071120 2023-10-14T09:17:35.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f0d49ffb640 1 -- 172.21.15.78:0/2744646093 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d500a8b70 con 0x7f0d54149cf0 2023-10-14T09:17:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f6933332640 1 -- 172.21.15.78:0/3828580835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f692c0ca7b0 msgr2=0x7f692c02b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f6933332640 1 --2- 172.21.15.78:0/3828580835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f692c0ca7b0 0x7f692c02b520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6920009d90 tx=0x7f692001c8e0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f6933332640 1 -- 172.21.15.78:0/3828580835 shutdown_connections 2023-10-14T09:17:35.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f6933332640 1 --2- 172.21.15.78:0/3828580835 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f692c02c6d0 0x7f692c02ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f6933332640 1 --2- 172.21.15.78:0/3828580835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f692c0ca7b0 0x7f692c02b520 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f6933332640 1 -- 172.21.15.78:0/3828580835 >> 172.21.15.78:0/3828580835 conn(0x7f692c0ac950 msgr2=0x7f692c0acd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f88e550f640 1 -- 172.21.15.78:0/1592388641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e0074180 con 0x7f88c8003980 2023-10-14T09:17:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2744646093 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d541e8e30 con 0x7f0d54149cf0 2023-10-14T09:17:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2744646093 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d540c41b0 con 0x7f0d54149cf0 2023-10-14T09:17:35.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7fdd73fff640 1 -- 172.21.15.78:0/2524595958 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd840b7480 con 0x7fdd8c153e70 2023-10-14T09:17:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7fdd73fff640 1 -- 172.21.15.78:0/2524595958 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd840b7810 con 0x7fdd8c153e70 2023-10-14T09:17:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c151120 con 0x7fdd8c153e70 2023-10-14T09:17:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c1466e0 con 0x7fdd8c153e70 2023-10-14T09:17:35.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c1530d0 con 0x7fdd8c153e70 2023-10-14T09:17:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f6933332640 1 -- 172.21.15.78:0/3828580835 shutdown_connections 2023-10-14T09:17:35.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f6933332640 1 -- 172.21.15.78:0/3828580835 wait complete. 2023-10-14T09:17:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f0d49ffb640 1 -- 172.21.15.78:0/2744646093 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000b150 con 0x7f0d54149cf0 2023-10-14T09:17:35.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f3a4e59c640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a50071120 0x7f3a500c3290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000e930 tx=0x7f3a4000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f88c77fe640 1 -- 172.21.15.78:0/1592388641 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f88d40b5070 con 0x7f88c8003980 2023-10-14T09:17:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f88c77fe640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88cc0664d0 0x7f88cc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f88c77fe640 1 -- 172.21.15.78:0/1592388641 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88d411da80 con 0x7f88c8003980 2023-10-14T09:17:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f76effff640 1 -- 172.21.15.78:0/186428431 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0b4410 con 0x7f77080c4fa0 2023-10-14T09:17:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f76effff640 1 -- 172.21.15.78:0/186428431 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc0b4570 con 0x7f77080c4fa0 2023-10-14T09:17:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f770db0f640 1 -- 172.21.15.78:0/186428431 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76fc009420 con 0x7f77080c4fa0 2023-10-14T09:17:35.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f76effff640 1 -- 172.21.15.78:0/186428431 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0b4410 con 0x7f77080c4fa0 2023-10-14T09:17:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.297+0000 7f770db0f640 1 -- 172.21.15.78:0/186428431 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770815e200 con 0x7f77080c4fa0 2023-10-14T09:17:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f770db0f640 1 -- 172.21.15.78:0/186428431 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e8005260 con 0x7f77080c4fa0 2023-10-14T09:17:35.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f6933332640 1 Processor -- start 2023-10-14T09:17:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f6933332640 1 -- start start 2023-10-14T09:17:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f0d49ffb640 1 -- 172.21.15.78:0/2744646093 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0d5000b2b0 con 0x7f0d54149cf0 2023-10-14T09:17:35.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2744646093 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d34005260 con 0x7f0d54149cf0 2023-10-14T09:17:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f6933332640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f692c02bfa0 0x7f692c155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f6933332640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f692c02c6d0 0x7f692c1ec1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f6933332640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f692c0ca7b0 0x7f692c0b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f6932330640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f692c02bfa0 0x7f692c155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f6932330640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f692c02bfa0 0x7f692c155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:37638/0 (socket says 172.21.15.78:37638) 2023-10-14T09:17:35.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f6932330640 1 -- 172.21.15.78:0/767689026 learned_addr learned my addr 172.21.15.78:0/767689026 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f0d49ffb640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d380664a0 0x7f0d38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7fdd73fff640 1 -- 172.21.15.78:0/2524595958 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdd840b7970 con 0x7fdd8c153e70 2023-10-14T09:17:35.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f88de7fc640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88cc0664d0 0x7f88cc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.301+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c1ec720 con 0x7f692c02c6d0 2023-10-14T09:17:35.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c0b57f0 con 0x7f692c0ca7b0 2023-10-14T09:17:35.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c0b6090 con 0x7f692c02bfa0 2023-10-14T09:17:35.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f6932330640 1 -- 172.21.15.78:0/767689026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f692c0ca7b0 msgr2=0x7f692c0b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f6932330640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f692c0ca7b0 0x7f692c0b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f6932330640 1 -- 172.21.15.78:0/767689026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f692c02c6d0 msgr2=0x7f692c1ec1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f6932330640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f692c02c6d0 0x7f692c1ec1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f6932330640 1 -- 172.21.15.78:0/767689026 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920009a70 con 0x7f692c02bfa0 2023-10-14T09:17:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7fdd73fff640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdd780664f0 0x7fdd780689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f88c77fe640 1 -- 172.21.15.78:0/1592388641 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f88d40eaef0 con 0x7f88c8003980 2023-10-14T09:17:35.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f6932330640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f692c02bfa0 0x7f692c155ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6920009d90 tx=0x7f692c0c8710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7fdd73fff640 1 -- 172.21.15.78:0/2524595958 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd840f08a0 con 0x7fdd8c153e70 2023-10-14T09:17:35.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f0d49ffb640 1 -- 172.21.15.78:0/2744646093 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d5011dbc0 con 0x7f0d54149cf0 2023-10-14T09:17:35.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f0d58938640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d380664a0 0x7f0d38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f3a477fe640 1 -- 172.21.15.78:0/1954361453 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40009690 con 0x7f3a50071120 2023-10-14T09:17:35.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f3a477fe640 1 -- 172.21.15.78:0/1954361453 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4000ca00 con 0x7f3a50071120 2023-10-14T09:17:35.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f3a477fe640 1 -- 172.21.15.78:0/1954361453 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4000cd70 con 0x7f3a50071120 2023-10-14T09:17:35.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f88de7fc640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88cc0664d0 0x7f88cc068990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88e00ab5a0 tx=0x7f88d0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f0d58938640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d380664a0 0x7f0d38068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d54148c70 tx=0x7f0d44008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a500a8d30 con 0x7f3a50071120 2023-10-14T09:17:35.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a501f34c0 con 0x7f3a50071120 2023-10-14T09:17:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.305+0000 7f76effff640 1 -- 172.21.15.78:0/186428431 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f76fc0b2040 con 0x7f77080c4fa0 2023-10-14T09:17:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f692affd640 1 -- 172.21.15.78:0/767689026 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200ad6d0 con 0x7f692c02bfa0 2023-10-14T09:17:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f76effff640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76f4066500 0x7f76f40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f76effff640 1 -- 172.21.15.78:0/186428431 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76fc11dec0 con 0x7f77080c4fa0 2023-10-14T09:17:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f692affd640 1 -- 172.21.15.78:0/767689026 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69200ad850 con 0x7f692c02bfa0 2023-10-14T09:17:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f692affd640 1 -- 172.21.15.78:0/767689026 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200adc00 con 0x7f692c02bfa0 2023-10-14T09:17:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7fdd8b7fe640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdd780664f0 0x7fdd780689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f0d49ffb640 1 -- 172.21.15.78:0/2744646093 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0d500eb160 con 0x7f0d54149cf0 2023-10-14T09:17:35.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7fdd8b7fe640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdd780664f0 0x7fdd780689b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c006fd0 tx=0x7fdd7c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a50074180 con 0x7f3a50071120 2023-10-14T09:17:35.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c1561d0 con 0x7f692c02bfa0 2023-10-14T09:17:35.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c0b5d20 con 0x7f692c02bfa0 2023-10-14T09:17:35.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f76effff640 1 -- 172.21.15.78:0/186428431 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f76fc0eb500 con 0x7f77080c4fa0 2023-10-14T09:17:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.313+0000 7fdd73fff640 1 -- 172.21.15.78:0/2524595958 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdd840ecc70 con 0x7fdd8c153e70 2023-10-14T09:17:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f77077fe640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76f4066500 0x7f76f40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.309+0000 7f3a477fe640 1 -- 172.21.15.78:0/1954361453 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3a40013470 con 0x7f3a50071120 2023-10-14T09:17:35.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.313+0000 7f3a477fe640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3a30066520 0x7f3a300689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.313+0000 7f3a477fe640 1 -- 172.21.15.78:0/1954361453 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a400846c0 con 0x7f3a50071120 2023-10-14T09:17:35.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.313+0000 7f3a45d9b640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3a30066520 0x7f3a300689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.313+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6914005260 con 0x7f692c02bfa0 2023-10-14T09:17:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.313+0000 7f692affd640 1 -- 172.21.15.78:0/767689026 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f69200b4040 con 0x7f692c02bfa0 2023-10-14T09:17:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.313+0000 7f692affd640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6910066570 0x7f6910068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.313+0000 7f692affd640 1 -- 172.21.15.78:0/767689026 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f692011e5f0 con 0x7f692c02bfa0 2023-10-14T09:17:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.313+0000 7f6931b2f640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6910066570 0x7f6910068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.317+0000 7f3a477fe640 1 -- 172.21.15.78:0/1954361453 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3a40084b00 con 0x7f3a50071120 2023-10-14T09:17:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.317+0000 7f3a45d9b640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3a30066520 0x7f3a300689e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a380ae000 tx=0x7f3a380a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.317+0000 7f77077fe640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76f4066500 0x7f76f40689c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f76f8000f70 tx=0x7f76f8007eb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.317+0000 7f6931b2f640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6910066570 0x7f6910068a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f692c156700 tx=0x7f6918006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.321+0000 7f692affd640 1 -- 172.21.15.78:0/767689026 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69200ebae0 con 0x7f692c02bfa0 2023-10-14T09:17:35.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.453+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f59b8074180 con 0x7f59b80c27e0 2023-10-14T09:17:35.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.453+0000 7f599f7fe640 1 -- 172.21.15.78:0/671115974 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f59ac021070 con 0x7f59b80c27e0 2023-10-14T09:17:35.460 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-10-14T09:17:35.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f59a40665a0 msgr2=0x7f59a4068a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f59a40665a0 0x7f59a4068a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59b8148580 tx=0x7f59a80079e0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b80c27e0 msgr2=0x7f59b81418b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b80c27e0 0x7f59b81418b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e930 tx=0x7f59ac00edf0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 shutdown_connections 2023-10-14T09:17:35.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59b8153da0 0x7f59b814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59b8149cf0 0x7f59b814f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f59a40665a0 0x7f59a4068a60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 --2- 172.21.15.78:0/671115974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59b80c27e0 0x7f59b81418b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 >> 172.21.15.78:0/671115974 conn(0x7f59b80c1cc0 msgr2=0x7f59b8146080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 shutdown_connections 2023-10-14T09:17:35.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.457+0000 7f59bd66b640 1 -- 172.21.15.78:0/671115974 wait complete. 2023-10-14T09:17:35.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2023-10-14T09:17:35.497 DEBUG:teuthology.parallel:result is None 2023-10-14T09:17:35.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.513+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f41900057e0 con 0x7f41b0138f20 2023-10-14T09:17:35.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.513+0000 7f41acff9640 1 -- 172.21.15.78:0/3827307257 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41a00ec750 con 0x7f41b0138f20 2023-10-14T09:17:35.519 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-10-14T09:17:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f419c066500 msgr2=0x7f419c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f419c066500 0x7f419c0689c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f41a800e250 tx=0x7f41a800b040 comp rx=0 tx=0).stop 2023-10-14T09:17:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b0138f20 msgr2=0x7f41b00c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b0138f20 0x7f41b00c3e50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41a00ad000 tx=0x7f41a001a3d0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 shutdown_connections 2023-10-14T09:17:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b0138f20 0x7f41b00c3e50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f419c066500 0x7f419c0689c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f41b0071100 0x7f41b00a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 --2- 172.21.15.78:0/3827307257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41b006cfe0 0x7f41b0136e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 >> 172.21.15.78:0/3827307257 conn(0x7f41b00c1ac0 msgr2=0x7f41b0134620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 shutdown_connections 2023-10-14T09:17:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.517+0000 7f41b5617640 1 -- 172.21.15.78:0/3827307257 wait complete. 2023-10-14T09:17:35.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2023-10-14T09:17:35.542 DEBUG:teuthology.parallel:result is None 2023-10-14T09:17:35.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.629+0000 7f88e550f640 1 -- 172.21.15.78:0/1592388641 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f88e00c2850 con 0x7f88c8003980 2023-10-14T09:17:35.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.629+0000 7f770db0f640 1 -- 172.21.15.78:0/186428431 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f76e80057e0 con 0x7f77080c4fa0 2023-10-14T09:17:35.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.629+0000 7f88c77fe640 1 -- 172.21.15.78:0/1592388641 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88d40bd070 con 0x7f88c8003980 2023-10-14T09:17:35.635 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-10-14T09:17:35.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.629+0000 7f76effff640 1 -- 172.21.15.78:0/186428431 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76fc0eeb20 con 0x7f77080c4fa0 2023-10-14T09:17:35.636 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-10-14T09:17:35.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 -- 172.21.15.78:0/1592388641 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88cc0664d0 msgr2=0x7f88cc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88cc0664d0 0x7f88cc068990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88e00ab5a0 tx=0x7f88d0009190 comp rx=0 tx=0).stop 2023-10-14T09:17:35.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 -- 172.21.15.78:0/1592388641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c8003980 msgr2=0x7f88e00bd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c8003980 0x7f88e00bd210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88d401ca20 tx=0x7f88c8005800 comp rx=0 tx=0).stop 2023-10-14T09:17:35.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2744646093 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0d340057e0 con 0x7f0d54149cf0 2023-10-14T09:17:35.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 -- 172.21.15.78:0/1592388641 shutdown_connections 2023-10-14T09:17:35.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88e01337a0 0x7f88e0133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f88cc0664d0 0x7f88cc068990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f88e01e89c0 0x7f88e00bd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 --2- 172.21.15.78:0/1592388641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f88c8003980 0x7f88e00bd210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 -- 172.21.15.78:0/1592388641 >> 172.21.15.78:0/1592388641 conn(0x7f88e00c1cc0 msgr2=0x7f88e013b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 -- 172.21.15.78:0/186428431 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76f4066500 msgr2=0x7f76f40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76f4066500 0x7f76f40689c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f76f8000f70 tx=0x7f76f8007eb0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 -- 172.21.15.78:0/186428431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77080c4fa0 msgr2=0x7f77081564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77080c4fa0 0x7f77081564c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76fc0ab000 tx=0x7f76fc019170 comp rx=0 tx=0).stop 2023-10-14T09:17:35.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 -- 172.21.15.78:0/186428431 shutdown_connections 2023-10-14T09:17:35.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7708151240 0x7f77081f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77080c4fa0 0x7f77081564c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76f4066500 0x7f76f40689c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 --2- 172.21.15.78:0/186428431 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77080c4400 0x7f770815dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 -- 172.21.15.78:0/186428431 >> 172.21.15.78:0/186428431 conn(0x7f77080c6060 msgr2=0x7f77080c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 -- 172.21.15.78:0/1592388641 shutdown_connections 2023-10-14T09:17:35.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f0d49ffb640 1 -- 172.21.15.78:0/2744646093 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d500ad020 con 0x7f0d54149cf0 2023-10-14T09:17:35.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f88e550f640 1 -- 172.21.15.78:0/1592388641 wait complete. 2023-10-14T09:17:35.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 -- 172.21.15.78:0/186428431 shutdown_connections 2023-10-14T09:17:35.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.633+0000 7f770db0f640 1 -- 172.21.15.78:0/186428431 wait complete. 2023-10-14T09:17:35.646 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-10-14T09:17:35.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd8c074180 con 0x7fdd8c153e70 2023-10-14T09:17:35.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7fdd73fff640 1 -- 172.21.15.78:0/2524595958 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd840ece10 con 0x7fdd8c153e70 2023-10-14T09:17:35.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2744646093 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d380664a0 msgr2=0x7f0d38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f0d5b39d640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d380664a0 0x7f0d38068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d54148c70 tx=0x7f0d44008040 comp rx=0 tx=0).stop 2023-10-14T09:17:35.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2744646093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54149cf0 msgr2=0x7f0d540c3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f0d5b39d640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54149cf0 0x7f0d540c3c70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0d500af000 tx=0x7f0d5001d090 comp rx=0 tx=0).stop 2023-10-14T09:17:35.649 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-10-14T09:17:35.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2744646093 shutdown_connections 2023-10-14T09:17:35.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f0d5b39d640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0d54153da0 0x7f0d54152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f0d5b39d640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d54153810 0x7f0d54144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f0d5b39d640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d380664a0 0x7f0d38068960 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d54148c70 tx=0x7f0d44008040 comp rx=0 tx=0).stop 2023-10-14T09:17:35.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f0d5b39d640 1 --2- 172.21.15.78:0/2744646093 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0d54149cf0 0x7f0d540c3c70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2744646093 >> 172.21.15.78:0/2744646093 conn(0x7f0d540c1cc0 msgr2=0x7f0d540c1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a500be350 con 0x7f3a50071120 2023-10-14T09:17:35.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdd780664f0 msgr2=0x7fdd780689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7fdd91cea640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdd780664f0 0x7fdd780689b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c006fd0 tx=0x7fdd7c008040 comp rx=0 tx=0).stop 2023-10-14T09:17:35.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c153e70 msgr2=0x7fdd8c1f46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7fdd91cea640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c153e70 0x7fdd8c1f46e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdd840ac000 tx=0x7fdd8401a6f0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.637+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2744646093 shutdown_connections 2023-10-14T09:17:35.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f3a477fe640 1 -- 172.21.15.78:0/1954361453 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a40051e20 con 0x7f3a50071120 2023-10-14T09:17:35.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f0d5b39d640 1 -- 172.21.15.78:0/2744646093 wait complete. 2023-10-14T09:17:35.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 shutdown_connections 2023-10-14T09:17:35.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7fdd91cea640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd8c153e70 0x7fdd8c1f46e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7fdd91cea640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdd780664f0 0x7fdd780689b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7fdd91cea640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdd8c14d920 0x7fdd8c1f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7fdd91cea640 1 --2- 172.21.15.78:0/2524595958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd8c0c3a30 0x7fdd8c1ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 >> 172.21.15.78:0/2524595958 conn(0x7fdd8c0c25b0 msgr2=0x7fdd8c147200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.655 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-10-14T09:17:35.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 shutdown_connections 2023-10-14T09:17:35.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7fdd91cea640 1 -- 172.21.15.78:0/2524595958 wait complete. 2023-10-14T09:17:35.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3a30066520 msgr2=0x7f3a300689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f3a54d0f640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3a30066520 0x7f3a300689e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a380ae000 tx=0x7f3a380a7070 comp rx=0 tx=0).stop 2023-10-14T09:17:35.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a50071120 msgr2=0x7f3a500c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f3a54d0f640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a50071120 0x7f3a500c3290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000e930 tx=0x7f3a4000edf0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 shutdown_connections 2023-10-14T09:17:35.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f3a54d0f640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3a30066520 0x7f3a300689e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f3a54d0f640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3a50157370 0x7f3a501f39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f3a54d0f640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a500be570 0x7f3a50154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f3a54d0f640 1 --2- 172.21.15.78:0/1954361453 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3a50071120 0x7f3a500c3290 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.641+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 >> 172.21.15.78:0/1954361453 conn(0x7f3a500c1cc0 msgr2=0x7f3a5013a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.645+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 shutdown_connections 2023-10-14T09:17:35.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.645+0000 7f3a54d0f640 1 -- 172.21.15.78:0/1954361453 wait complete. 2023-10-14T09:17:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.645+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6914005510 con 0x7f692c02bfa0 2023-10-14T09:17:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.645+0000 7f692affd640 1 -- 172.21.15.78:0/767689026 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69200bd020 con 0x7f692c02bfa0 2023-10-14T09:17:35.661 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-10-14T09:17:35.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6910066570 msgr2=0x7f6910068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6910066570 0x7f6910068a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f692c156700 tx=0x7f6918006ca0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f692c02bfa0 msgr2=0x7f692c155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f692c02bfa0 0x7f692c155ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6920009d90 tx=0x7f692c0c8710 comp rx=0 tx=0).stop 2023-10-14T09:17:35.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 shutdown_connections 2023-10-14T09:17:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f692c0ca7b0 0x7f692c0b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f692c02c6d0 0x7f692c1ec1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6910066570 0x7f6910068a30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 --2- 172.21.15.78:0/767689026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f692c02bfa0 0x7f692c155ad0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 >> 172.21.15.78:0/767689026 conn(0x7f692c0ac950 msgr2=0x7f692c06e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 shutdown_connections 2023-10-14T09:17:35.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.649+0000 7f6933332640 1 -- 172.21.15.78:0/767689026 wait complete. 2023-10-14T09:17:35.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2023-10-14T09:17:35.671 DEBUG:teuthology.parallel:result is None 2023-10-14T09:17:35.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.4 2023-10-14T09:17:35.677 DEBUG:teuthology.parallel:result is None 2023-10-14T09:17:35.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2023-10-14T09:17:35.682 DEBUG:teuthology.parallel:result is None 2023-10-14T09:17:35.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2023-10-14T09:17:35.687 DEBUG:teuthology.parallel:result is None 2023-10-14T09:17:35.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2023-10-14T09:17:35.688 DEBUG:teuthology.parallel:result is None 2023-10-14T09:17:35.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.7 2023-10-14T09:17:35.689 DEBUG:teuthology.parallel:result is None 2023-10-14T09:17:35.690 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T09:17:35.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:17:35.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.865+0000 7f96af93e640 1 Processor -- start 2023-10-14T09:17:35.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96af93e640 1 -- start start 2023-10-14T09:17:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96af93e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96a80c1eb0 0x7f96a80c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96af93e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f96a80c7d30 0x7f96a80c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96af93e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a8151810 con 0x7f96a8151430 2023-10-14T09:17:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96af93e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a80c27d0 con 0x7f96a80c1eb0 2023-10-14T09:17:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96af93e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a806f760 con 0x7f96a80c7d30 2023-10-14T09:17:35.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96aced9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96a80c1eb0 0x7f96a80c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96aced9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96a80c1eb0 0x7f96a80c77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39578/0 (socket says 172.21.15.78:39578) 2023-10-14T09:17:35.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96aced9640 1 -- 172.21.15.78:0/2704422974 learned_addr learned my addr 172.21.15.78:0/2704422974 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96adedb640 1 --2- 172.21.15.78:0/2704422974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f96a80c7d30 0x7f96a80c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96aced9640 1 -- 172.21.15.78:0/2704422974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f96a80c7d30 msgr2=0x7f96a80c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:35.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96aced9640 1 --2- 172.21.15.78:0/2704422974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f96a80c7d30 0x7f96a80c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96aced9640 1 -- 172.21.15.78:0/2704422974 >> v1:172.21.15.157:6789/0 conn(0x7f96a8151430 legacy=0x7f96a81547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.869+0000 7f96aced9640 1 -- 172.21.15.78:0/2704422974 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a806fa00 con 0x7f96a80c1eb0 2023-10-14T09:17:35.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f96aced9640 1 --2- 172.21.15.78:0/2704422974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96a80c1eb0 0x7f96a80c77f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9698009870 tx=0x7f969801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639070b0b16c92e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f969ffff640 1 -- 172.21.15.78:0/2704422974 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980ac410 con 0x7f96a80c1eb0 2023-10-14T09:17:35.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f969ffff640 1 -- 172.21.15.78:0/2704422974 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96980ac570 con 0x7f96a80c1eb0 2023-10-14T09:17:35.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f969ffff640 1 -- 172.21.15.78:0/2704422974 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980ac900 con 0x7f96a80c1eb0 2023-10-14T09:17:35.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f96af93e640 1 -- 172.21.15.78:0/2704422974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96a80c1eb0 msgr2=0x7f96a80c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f96af93e640 1 --2- 172.21.15.78:0/2704422974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96a80c1eb0 0x7f96a80c77f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9698009870 tx=0x7f969801c3b0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f96af93e640 1 -- 172.21.15.78:0/2704422974 shutdown_connections 2023-10-14T09:17:35.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f96af93e640 1 --2- 172.21.15.78:0/2704422974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f96a80c7d30 0x7f96a80c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f96af93e640 1 --2- 172.21.15.78:0/2704422974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96a80c1eb0 0x7f96a80c77f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f96af93e640 1 -- 172.21.15.78:0/2704422974 >> 172.21.15.78:0/2704422974 conn(0x7f96a806a060 msgr2=0x7f96a806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:35.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f96af93e640 1 -- 172.21.15.78:0/2704422974 shutdown_connections 2023-10-14T09:17:35.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f96af93e640 1 -- 172.21.15.78:0/2704422974 wait complete. 2023-10-14T09:17:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f96af93e640 1 Processor -- start 2023-10-14T09:17:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.873+0000 7f96af93e640 1 -- start start 2023-10-14T09:17:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96af93e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f96a80c1eb0 0x7f96a806ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96af93e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96a80c7d30 0x7f96a80aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96af93e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96a8151430 0x7f96a80a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96af93e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80abf90 con 0x7f96a8151430 2023-10-14T09:17:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96af93e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80ac1e0 con 0x7f96a80c7d30 2023-10-14T09:17:35.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96af93e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80ac4c0 con 0x7f96a80c1eb0 2023-10-14T09:17:35.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96adedb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96a8151430 0x7f96a80a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96adedb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96a8151430 0x7f96a80a7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39584/0 (socket says 172.21.15.78:39584) 2023-10-14T09:17:35.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96adedb640 1 -- 172.21.15.78:0/1140818080 learned_addr learned my addr 172.21.15.78:0/1140818080 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:35.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96aced9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96a80c7d30 0x7f96a80aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96ad6da640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f96a80c1eb0 0x7f96a806ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96adedb640 1 -- 172.21.15.78:0/1140818080 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f96a80c1eb0 msgr2=0x7f96a806ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96adedb640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f96a80c1eb0 0x7f96a806ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96adedb640 1 -- 172.21.15.78:0/1140818080 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96a80c7d30 msgr2=0x7f96a80aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:35.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96adedb640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96a80c7d30 0x7f96a80aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96adedb640 1 -- 172.21.15.78:0/1140818080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980094d0 con 0x7f96a8151430 2023-10-14T09:17:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96adedb640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96a8151430 0x7f96a80a7ff0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f96a000efc0 tx=0x7f96a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f969dffb640 1 -- 172.21.15.78:0/1140818080 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0014480 con 0x7f96a8151430 2023-10-14T09:17:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f969dffb640 1 -- 172.21.15.78:0/1140818080 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a000f040 con 0x7f96a8151430 2023-10-14T09:17:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f969dffb640 1 -- 172.21.15.78:0/1140818080 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0014820 con 0x7f96a8151430 2023-10-14T09:17:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96af93e640 1 -- 172.21.15.78:0/1140818080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a80ac7a0 con 0x7f96a8151430 2023-10-14T09:17:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96af93e640 1 -- 172.21.15.78:0/1140818080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a80aa8c0 con 0x7f96a8151430 2023-10-14T09:17:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f96af93e640 1 -- 172.21.15.78:0/1140818080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a80accc0 con 0x7f96a8151430 2023-10-14T09:17:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.877+0000 7f969dffb640 1 -- 172.21.15.78:0/1140818080 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f96a0014980 con 0x7f96a8151430 2023-10-14T09:17:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.881+0000 7f969dffb640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f968c0664a0 0x7f968c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.881+0000 7f969dffb640 1 -- 172.21.15.78:0/1140818080 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96a0084a00 con 0x7f96a8151430 2023-10-14T09:17:35.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.881+0000 7f96ad6da640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f968c0664a0 0x7f968c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:35.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.881+0000 7f96ad6da640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f968c0664a0 0x7f968c068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f96a4007fd0 tx=0x7f96a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:35.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:35.885+0000 7f969dffb640 1 -- 172.21.15.78:0/1140818080 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96a80accc0 con 0x7f96a8151430 2023-10-14T09:17:36.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.033+0000 7f96af93e640 1 -- 172.21.15.78:0/1140818080 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96a80c3650 con 0x7f968c0664a0 2023-10-14T09:17:36.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.041+0000 7f969dffb640 1 -- 172.21.15.78:0/1140818080 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264707 (secure 0 0 0) 0x7f96a4001450 con 0x7f968c0664a0 2023-10-14T09:17:36.048 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:36.049 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-10-14T09:17:36.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 -- 172.21.15.78:0/1140818080 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f968c0664a0 msgr2=0x7f968c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f968c0664a0 0x7f968c068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f96a4007fd0 tx=0x7f96a4009040 comp rx=0 tx=0).stop 2023-10-14T09:17:36.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 -- 172.21.15.78:0/1140818080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96a8151430 msgr2=0x7f96a80a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96a8151430 0x7f96a80a7ff0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f96a000efc0 tx=0x7f96a000c490 comp rx=0 tx=0).stop 2023-10-14T09:17:36.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 -- 172.21.15.78:0/1140818080 shutdown_connections 2023-10-14T09:17:36.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96a8151430 0x7f96a80a7ff0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f96a80c7d30 0x7f96a80aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f968c0664a0 0x7f968c068960 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 --2- 172.21.15.78:0/1140818080 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f96a80c1eb0 0x7f96a806ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 -- 172.21.15.78:0/1140818080 >> 172.21.15.78:0/1140818080 conn(0x7f96a806a060 msgr2=0x7f96a814fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:36.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 -- 172.21.15.78:0/1140818080 shutdown_connections 2023-10-14T09:17:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.045+0000 7f96af93e640 1 -- 172.21.15.78:0/1140818080 wait complete. 2023-10-14T09:17:36.069 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-14T09:17:35.233353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217980,"kb_used_data":1792,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756740,"statfs":{"total":773094113280,"available":772870901760,"internally_reserved":0,"allocated":1835008,"data_stored":1752740,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.007157"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147278+0000","last_change":"2023-10-14T09:17:25.079007+0000","last_active":"2023-10-14T09:17:26.147278+0000","last_peered":"2023-10-14T09:17:26.147278+0000","last_clean":"2023-10-14T09:17:26.147278+0000","last_became_active":"2023-10-14T09:17:25.078749+0000","last_became_peered":"2023-10-14T09:17:25.078749+0000","last_unstale":"2023-10-14T09:17:26.147278+0000","last_undegraded":"2023-10-14T09:17:26.147278+0000","last_fullsized":"2023-10-14T09:17:26.147278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057783+0000","last_change":"2023-10-14T09:17:25.065460+0000","last_active":"2023-10-14T09:17:26.057783+0000","last_peered":"2023-10-14T09:17:26.057783+0000","last_clean":"2023-10-14T09:17:26.057783+0000","last_became_active":"2023-10-14T09:17:25.065172+0000","last_became_peered":"2023-10-14T09:17:25.065172+0000","last_unstale":"2023-10-14T09:17:26.057783+0000","last_undegraded":"2023-10-14T09:17:26.057783+0000","last_fullsized":"2023-10-14T09:17:26.057783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148566+0000","last_change":"2023-10-14T09:17:25.070948+0000","last_active":"2023-10-14T09:17:26.148566+0000","last_peered":"2023-10-14T09:17:26.148566+0000","last_clean":"2023-10-14T09:17:26.148566+0000","last_became_active":"2023-10-14T09:17:25.070661+0000","last_became_peered":"2023-10-14T09:17:25.070661+0000","last_unstale":"2023-10-14T09:17:26.148566+0000","last_undegraded":"2023-10-14T09:17:26.148566+0000","last_fullsized":"2023-10-14T09:17:26.148566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:44.354756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057834+0000","last_change":"2023-10-14T09:17:25.072881+0000","last_active":"2023-10-14T09:17:26.057834+0000","last_peered":"2023-10-14T09:17:26.057834+0000","last_clean":"2023-10-14T09:17:26.057834+0000","last_became_active":"2023-10-14T09:17:25.072555+0000","last_became_peered":"2023-10-14T09:17:25.072555+0000","last_unstale":"2023-10-14T09:17:26.057834+0000","last_undegraded":"2023-10-14T09:17:26.057834+0000","last_fullsized":"2023-10-14T09:17:26.057834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147164+0000","last_change":"2023-10-14T09:17:25.083056+0000","last_active":"2023-10-14T09:17:26.147164+0000","last_peered":"2023-10-14T09:17:26.147164+0000","last_clean":"2023-10-14T09:17:26.147164+0000","last_became_active":"2023-10-14T09:17:25.077385+0000","last_became_peered":"2023-10-14T09:17:25.077385+0000","last_unstale":"2023-10-14T09:17:26.147164+0000","last_undegraded":"2023-10-14T09:17:26.147164+0000","last_fullsized":"2023-10-14T09:17:26.147164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057542+0000","last_change":"2023-10-14T09:17:25.063358+0000","last_active":"2023-10-14T09:17:26.057542+0000","last_peered":"2023-10-14T09:17:26.057542+0000","last_clean":"2023-10-14T09:17:26.057542+0000","last_became_active":"2023-10-14T09:17:25.063069+0000","last_became_peered":"2023-10-14T09:17:25.063069+0000","last_unstale":"2023-10-14T09:17:26.057542+0000","last_undegraded":"2023-10-14T09:17:26.057542+0000","last_fullsized":"2023-10-14T09:17:26.057542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:17.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147429+0000","last_change":"2023-10-14T09:17:25.074574+0000","last_active":"2023-10-14T09:17:26.147429+0000","last_peered":"2023-10-14T09:17:26.147429+0000","last_clean":"2023-10-14T09:17:26.147429+0000","last_became_active":"2023-10-14T09:17:25.074288+0000","last_became_peered":"2023-10-14T09:17:25.074288+0000","last_unstale":"2023-10-14T09:17:26.147429+0000","last_undegraded":"2023-10-14T09:17:26.147429+0000","last_fullsized":"2023-10-14T09:17:26.147429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:26.745591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148053+0000","last_change":"2023-10-14T09:17:25.071156+0000","last_active":"2023-10-14T09:17:26.148053+0000","last_peered":"2023-10-14T09:17:26.148053+0000","last_clean":"2023-10-14T09:17:26.148053+0000","last_became_active":"2023-10-14T09:17:25.070907+0000","last_became_peered":"2023-10-14T09:17:25.070907+0000","last_unstale":"2023-10-14T09:17:26.148053+0000","last_undegraded":"2023-10-14T09:17:26.148053+0000","last_fullsized":"2023-10-14T09:17:26.148053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147584+0000","last_change":"2023-10-14T09:17:25.083299+0000","last_active":"2023-10-14T09:17:26.147584+0000","last_peered":"2023-10-14T09:17:26.147584+0000","last_clean":"2023-10-14T09:17:26.147584+0000","last_became_active":"2023-10-14T09:17:25.082917+0000","last_became_peered":"2023-10-14T09:17:25.082917+0000","last_unstale":"2023-10-14T09:17:26.147584+0000","last_undegraded":"2023-10-14T09:17:26.147584+0000","last_fullsized":"2023-10-14T09:17:26.147584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:23.681006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147796+0000","last_change":"2023-10-14T09:17:25.079917+0000","last_active":"2023-10-14T09:17:26.147796+0000","last_peered":"2023-10-14T09:17:26.147796+0000","last_clean":"2023-10-14T09:17:26.147796+0000","last_became_active":"2023-10-14T09:17:25.079320+0000","last_became_peered":"2023-10-14T09:17:25.079320+0000","last_unstale":"2023-10-14T09:17:26.147796+0000","last_undegraded":"2023-10-14T09:17:26.147796+0000","last_fullsized":"2023-10-14T09:17:26.147796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147174+0000","last_change":"2023-10-14T09:17:25.090783+0000","last_active":"2023-10-14T09:17:26.147174+0000","last_peered":"2023-10-14T09:17:26.147174+0000","last_clean":"2023-10-14T09:17:26.147174+0000","last_became_active":"2023-10-14T09:17:25.090462+0000","last_became_peered":"2023-10-14T09:17:25.090462+0000","last_unstale":"2023-10-14T09:17:26.147174+0000","last_undegraded":"2023-10-14T09:17:26.147174+0000","last_fullsized":"2023-10-14T09:17:26.147174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057218+0000","last_change":"2023-10-14T09:17:25.072604+0000","last_active":"2023-10-14T09:17:26.057218+0000","last_peered":"2023-10-14T09:17:26.057218+0000","last_clean":"2023-10-14T09:17:26.057218+0000","last_became_active":"2023-10-14T09:17:25.072215+0000","last_became_peered":"2023-10-14T09:17:25.072215+0000","last_unstale":"2023-10-14T09:17:26.057218+0000","last_undegraded":"2023-10-14T09:17:26.057218+0000","last_fullsized":"2023-10-14T09:17:26.057218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:01.624510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149412+0000","last_change":"2023-10-14T09:17:25.074394+0000","last_active":"2023-10-14T09:17:26.149412+0000","last_peered":"2023-10-14T09:17:26.149412+0000","last_clean":"2023-10-14T09:17:26.149412+0000","last_became_active":"2023-10-14T09:17:25.074139+0000","last_became_peered":"2023-10-14T09:17:25.074139+0000","last_unstale":"2023-10-14T09:17:26.149412+0000","last_undegraded":"2023-10-14T09:17:26.149412+0000","last_fullsized":"2023-10-14T09:17:26.149412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148817+0000","last_change":"2023-10-14T09:17:25.066224+0000","last_active":"2023-10-14T09:17:26.148817+0000","last_peered":"2023-10-14T09:17:26.148817+0000","last_clean":"2023-10-14T09:17:26.148817+0000","last_became_active":"2023-10-14T09:17:25.065977+0000","last_became_peered":"2023-10-14T09:17:25.065977+0000","last_unstale":"2023-10-14T09:17:26.148817+0000","last_undegraded":"2023-10-14T09:17:26.148817+0000","last_fullsized":"2023-10-14T09:17:26.148817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057378+0000","last_change":"2023-10-14T09:17:25.065526+0000","last_active":"2023-10-14T09:17:26.057378+0000","last_peered":"2023-10-14T09:17:26.057378+0000","last_clean":"2023-10-14T09:17:26.057378+0000","last_became_active":"2023-10-14T09:17:25.065045+0000","last_became_peered":"2023-10-14T09:17:25.065045+0000","last_unstale":"2023-10-14T09:17:26.057378+0000","last_undegraded":"2023-10-14T09:17:26.057378+0000","last_fullsized":"2023-10-14T09:17:26.057378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057383+0000","last_change":"2023-10-14T09:17:25.068473+0000","last_active":"2023-10-14T09:17:26.057383+0000","last_peered":"2023-10-14T09:17:26.057383+0000","last_clean":"2023-10-14T09:17:26.057383+0000","last_became_active":"2023-10-14T09:17:25.065827+0000","last_became_peered":"2023-10-14T09:17:25.065827+0000","last_unstale":"2023-10-14T09:17:26.057383+0000","last_undegraded":"2023-10-14T09:17:26.057383+0000","last_fullsized":"2023-10-14T09:17:26.057383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058518+0000","last_change":"2023-10-14T09:17:25.080133+0000","last_active":"2023-10-14T09:17:26.058518+0000","last_peered":"2023-10-14T09:17:26.058518+0000","last_clean":"2023-10-14T09:17:26.058518+0000","last_became_active":"2023-10-14T09:17:25.079868+0000","last_became_peered":"2023-10-14T09:17:25.079868+0000","last_unstale":"2023-10-14T09:17:26.058518+0000","last_undegraded":"2023-10-14T09:17:26.058518+0000","last_fullsized":"2023-10-14T09:17:26.058518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:23.681006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149034+0000","last_change":"2023-10-14T09:17:25.072227+0000","last_active":"2023-10-14T09:17:26.149034+0000","last_peered":"2023-10-14T09:17:26.149034+0000","last_clean":"2023-10-14T09:17:26.149034+0000","last_became_active":"2023-10-14T09:17:25.071942+0000","last_became_peered":"2023-10-14T09:17:25.071942+0000","last_unstale":"2023-10-14T09:17:26.149034+0000","last_undegraded":"2023-10-14T09:17:26.149034+0000","last_fullsized":"2023-10-14T09:17:26.149034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:08.387279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148853+0000","last_change":"2023-10-14T09:17:25.086013+0000","last_active":"2023-10-14T09:17:26.148853+0000","last_peered":"2023-10-14T09:17:26.148853+0000","last_clean":"2023-10-14T09:17:26.148853+0000","last_became_active":"2023-10-14T09:17:25.085027+0000","last_became_peered":"2023-10-14T09:17:25.085027+0000","last_unstale":"2023-10-14T09:17:26.148853+0000","last_undegraded":"2023-10-14T09:17:26.148853+0000","last_fullsized":"2023-10-14T09:17:26.148853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:18.616879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146990+0000","last_change":"2023-10-14T09:17:25.076399+0000","last_active":"2023-10-14T09:17:26.146990+0000","last_peered":"2023-10-14T09:17:26.146990+0000","last_clean":"2023-10-14T09:17:26.146990+0000","last_became_active":"2023-10-14T09:17:25.076035+0000","last_became_peered":"2023-10-14T09:17:25.076035+0000","last_unstale":"2023-10-14T09:17:26.146990+0000","last_undegraded":"2023-10-14T09:17:26.146990+0000","last_fullsized":"2023-10-14T09:17:26.146990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148535+0000","last_change":"2023-10-14T09:17:25.073762+0000","last_active":"2023-10-14T09:17:26.148535+0000","last_peered":"2023-10-14T09:17:26.148535+0000","last_clean":"2023-10-14T09:17:26.148535+0000","last_became_active":"2023-10-14T09:17:25.073517+0000","last_became_peered":"2023-10-14T09:17:25.073517+0000","last_unstale":"2023-10-14T09:17:26.148535+0000","last_undegraded":"2023-10-14T09:17:26.148535+0000","last_fullsized":"2023-10-14T09:17:26.148535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:54.504717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057667+0000","last_change":"2023-10-14T09:17:25.085256+0000","last_active":"2023-10-14T09:17:26.057667+0000","last_peered":"2023-10-14T09:17:26.057667+0000","last_clean":"2023-10-14T09:17:26.057667+0000","last_became_active":"2023-10-14T09:17:25.077345+0000","last_became_peered":"2023-10-14T09:17:25.077345+0000","last_unstale":"2023-10-14T09:17:26.057667+0000","last_undegraded":"2023-10-14T09:17:26.057667+0000","last_fullsized":"2023-10-14T09:17:26.057667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148088+0000","last_change":"2023-10-14T09:17:25.069064+0000","last_active":"2023-10-14T09:17:26.148088+0000","last_peered":"2023-10-14T09:17:26.148088+0000","last_clean":"2023-10-14T09:17:26.148088+0000","last_became_active":"2023-10-14T09:17:25.068801+0000","last_became_peered":"2023-10-14T09:17:25.068801+0000","last_unstale":"2023-10-14T09:17:26.148088+0000","last_undegraded":"2023-10-14T09:17:26.148088+0000","last_fullsized":"2023-10-14T09:17:26.148088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057463+0000","last_change":"2023-10-14T09:17:25.069195+0000","last_active":"2023-10-14T09:17:26.057463+0000","last_peered":"2023-10-14T09:17:26.057463+0000","last_clean":"2023-10-14T09:17:26.057463+0000","last_became_active":"2023-10-14T09:17:25.068765+0000","last_became_peered":"2023-10-14T09:17:25.068765+0000","last_unstale":"2023-10-14T09:17:26.057463+0000","last_undegraded":"2023-10-14T09:17:26.057463+0000","last_fullsized":"2023-10-14T09:17:26.057463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149566+0000","last_change":"2023-10-14T09:17:25.082506+0000","last_active":"2023-10-14T09:17:26.149566+0000","last_peered":"2023-10-14T09:17:26.149566+0000","last_clean":"2023-10-14T09:17:26.149566+0000","last_became_active":"2023-10-14T09:17:25.082192+0000","last_became_peered":"2023-10-14T09:17:25.082192+0000","last_unstale":"2023-10-14T09:17:26.149566+0000","last_undegraded":"2023-10-14T09:17:26.149566+0000","last_fullsized":"2023-10-14T09:17:26.149566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147790+0000","last_change":"2023-10-14T09:17:25.076265+0000","last_active":"2023-10-14T09:17:26.147790+0000","last_peered":"2023-10-14T09:17:26.147790+0000","last_clean":"2023-10-14T09:17:26.147790+0000","last_became_active":"2023-10-14T09:17:25.075674+0000","last_became_peered":"2023-10-14T09:17:25.075674+0000","last_unstale":"2023-10-14T09:17:26.147790+0000","last_undegraded":"2023-10-14T09:17:26.147790+0000","last_fullsized":"2023-10-14T09:17:26.147790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057548+0000","last_change":"2023-10-14T09:17:25.070067+0000","last_active":"2023-10-14T09:17:26.057548+0000","last_peered":"2023-10-14T09:17:26.057548+0000","last_clean":"2023-10-14T09:17:26.057548+0000","last_became_active":"2023-10-14T09:17:25.069770+0000","last_became_peered":"2023-10-14T09:17:25.069770+0000","last_unstale":"2023-10-14T09:17:26.057548+0000","last_undegraded":"2023-10-14T09:17:26.057548+0000","last_fullsized":"2023-10-14T09:17:26.057548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149613+0000","last_change":"2023-10-14T09:17:25.082595+0000","last_active":"2023-10-14T09:17:26.149613+0000","last_peered":"2023-10-14T09:17:26.149613+0000","last_clean":"2023-10-14T09:17:26.149613+0000","last_became_active":"2023-10-14T09:17:25.082221+0000","last_became_peered":"2023-10-14T09:17:25.082221+0000","last_unstale":"2023-10-14T09:17:26.149613+0000","last_undegraded":"2023-10-14T09:17:26.149613+0000","last_fullsized":"2023-10-14T09:17:26.149613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148653+0000","last_change":"2023-10-14T09:17:25.074917+0000","last_active":"2023-10-14T09:17:26.148653+0000","last_peered":"2023-10-14T09:17:26.148653+0000","last_clean":"2023-10-14T09:17:26.148653+0000","last_became_active":"2023-10-14T09:17:25.074673+0000","last_became_peered":"2023-10-14T09:17:25.074673+0000","last_unstale":"2023-10-14T09:17:26.148653+0000","last_undegraded":"2023-10-14T09:17:26.148653+0000","last_fullsized":"2023-10-14T09:17:26.148653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057745+0000","last_change":"2023-10-14T09:17:25.070234+0000","last_active":"2023-10-14T09:17:26.057745+0000","last_peered":"2023-10-14T09:17:26.057745+0000","last_clean":"2023-10-14T09:17:26.057745+0000","last_became_active":"2023-10-14T09:17:25.069862+0000","last_became_peered":"2023-10-14T09:17:25.069862+0000","last_unstale":"2023-10-14T09:17:26.057745+0000","last_undegraded":"2023-10-14T09:17:26.057745+0000","last_fullsized":"2023-10-14T09:17:26.057745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148580+0000","last_change":"2023-10-14T09:17:25.067057+0000","last_active":"2023-10-14T09:17:26.148580+0000","last_peered":"2023-10-14T09:17:26.148580+0000","last_clean":"2023-10-14T09:17:26.148580+0000","last_became_active":"2023-10-14T09:17:25.066506+0000","last_became_peered":"2023-10-14T09:17:25.066506+0000","last_unstale":"2023-10-14T09:17:26.148580+0000","last_undegraded":"2023-10-14T09:17:26.148580+0000","last_fullsized":"2023-10-14T09:17:26.148580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:26.084905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146872+0000","last_change":"2023-10-14T09:17:25.071224+0000","last_active":"2023-10-14T09:17:26.146872+0000","last_peered":"2023-10-14T09:17:26.146872+0000","last_clean":"2023-10-14T09:17:26.146872+0000","last_became_active":"2023-10-14T09:17:25.070538+0000","last_became_peered":"2023-10-14T09:17:25.070538+0000","last_unstale":"2023-10-14T09:17:26.146872+0000","last_undegraded":"2023-10-14T09:17:26.146872+0000","last_fullsized":"2023-10-14T09:17:26.146872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.056842+0000","last_change":"2023-10-14T09:17:25.060731+0000","last_active":"2023-10-14T09:17:26.056842+0000","last_peered":"2023-10-14T09:17:26.056842+0000","last_clean":"2023-10-14T09:17:26.056842+0000","last_became_active":"2023-10-14T09:17:25.060361+0000","last_became_peered":"2023-10-14T09:17:25.060361+0000","last_unstale":"2023-10-14T09:17:26.056842+0000","last_undegraded":"2023-10-14T09:17:26.056842+0000","last_fullsized":"2023-10-14T09:17:26.056842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:58.882094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149507+0000","last_change":"2023-10-14T09:17:24.647223+0000","last_active":"2023-10-14T09:17:26.149507+0000","last_peered":"2023-10-14T09:17:26.149507+0000","last_clean":"2023-10-14T09:17:26.149507+0000","last_became_active":"2023-10-14T09:17:24.646910+0000","last_became_peered":"2023-10-14T09:17:24.646910+0000","last_unstale":"2023-10-14T09:17:26.149507+0000","last_undegraded":"2023-10-14T09:17:26.149507+0000","last_fullsized":"2023-10-14T09:17:26.149507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:43.349047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148773+0000","last_change":"2023-10-14T09:17:25.072654+0000","last_active":"2023-10-14T09:17:26.148773+0000","last_peered":"2023-10-14T09:17:26.148773+0000","last_clean":"2023-10-14T09:17:26.148773+0000","last_became_active":"2023-10-14T09:17:25.072361+0000","last_became_peered":"2023-10-14T09:17:25.072361+0000","last_unstale":"2023-10-14T09:17:26.148773+0000","last_undegraded":"2023-10-14T09:17:26.148773+0000","last_fullsized":"2023-10-14T09:17:26.148773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147198+0000","last_change":"2023-10-14T09:17:24.651708+0000","last_active":"2023-10-14T09:17:26.147198+0000","last_peered":"2023-10-14T09:17:26.147198+0000","last_clean":"2023-10-14T09:17:26.147198+0000","last_became_active":"2023-10-14T09:17:24.651461+0000","last_became_peered":"2023-10-14T09:17:24.651461+0000","last_unstale":"2023-10-14T09:17:26.147198+0000","last_undegraded":"2023-10-14T09:17:26.147198+0000","last_fullsized":"2023-10-14T09:17:26.147198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148228+0000","last_change":"2023-10-14T09:17:24.660053+0000","last_active":"2023-10-14T09:17:26.148228+0000","last_peered":"2023-10-14T09:17:26.148228+0000","last_clean":"2023-10-14T09:17:26.148228+0000","last_became_active":"2023-10-14T09:17:24.659722+0000","last_became_peered":"2023-10-14T09:17:24.659722+0000","last_unstale":"2023-10-14T09:17:26.148228+0000","last_undegraded":"2023-10-14T09:17:26.148228+0000","last_fullsized":"2023-10-14T09:17:26.148228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148174+0000","last_change":"2023-10-14T09:17:25.070599+0000","last_active":"2023-10-14T09:17:26.148174+0000","last_peered":"2023-10-14T09:17:26.148174+0000","last_clean":"2023-10-14T09:17:26.148174+0000","last_became_active":"2023-10-14T09:17:25.070202+0000","last_became_peered":"2023-10-14T09:17:25.070202+0000","last_unstale":"2023-10-14T09:17:26.148174+0000","last_undegraded":"2023-10-14T09:17:26.148174+0000","last_fullsized":"2023-10-14T09:17:26.148174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057470+0000","last_change":"2023-10-14T09:17:24.636532+0000","last_active":"2023-10-14T09:17:26.057470+0000","last_peered":"2023-10-14T09:17:26.057470+0000","last_clean":"2023-10-14T09:17:26.057470+0000","last_became_active":"2023-10-14T09:17:24.636180+0000","last_became_peered":"2023-10-14T09:17:24.636180+0000","last_unstale":"2023-10-14T09:17:26.057470+0000","last_undegraded":"2023-10-14T09:17:26.057470+0000","last_fullsized":"2023-10-14T09:17:26.057470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:25.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057394+0000","last_change":"2023-10-14T09:17:25.069990+0000","last_active":"2023-10-14T09:17:26.057394+0000","last_peered":"2023-10-14T09:17:26.057394+0000","last_clean":"2023-10-14T09:17:26.057394+0000","last_became_active":"2023-10-14T09:17:25.069733+0000","last_became_peered":"2023-10-14T09:17:25.069733+0000","last_unstale":"2023-10-14T09:17:26.057394+0000","last_undegraded":"2023-10-14T09:17:26.057394+0000","last_fullsized":"2023-10-14T09:17:26.057394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147600+0000","last_change":"2023-10-14T09:17:24.658971+0000","last_active":"2023-10-14T09:17:26.147600+0000","last_peered":"2023-10-14T09:17:26.147600+0000","last_clean":"2023-10-14T09:17:26.147600+0000","last_became_active":"2023-10-14T09:17:24.658454+0000","last_became_peered":"2023-10-14T09:17:24.658454+0000","last_unstale":"2023-10-14T09:17:26.147600+0000","last_undegraded":"2023-10-14T09:17:26.147600+0000","last_fullsized":"2023-10-14T09:17:26.147600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058246+0000","last_change":"2023-10-14T09:17:25.073538+0000","last_active":"2023-10-14T09:17:26.058246+0000","last_peered":"2023-10-14T09:17:26.058246+0000","last_clean":"2023-10-14T09:17:26.058246+0000","last_became_active":"2023-10-14T09:17:25.073196+0000","last_became_peered":"2023-10-14T09:17:25.073196+0000","last_unstale":"2023-10-14T09:17:26.058246+0000","last_undegraded":"2023-10-14T09:17:26.058246+0000","last_fullsized":"2023-10-14T09:17:26.058246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:57.142103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058171+0000","last_change":"2023-10-14T09:17:24.656283+0000","last_active":"2023-10-14T09:17:26.058171+0000","last_peered":"2023-10-14T09:17:26.058171+0000","last_clean":"2023-10-14T09:17:26.058171+0000","last_became_active":"2023-10-14T09:17:24.655902+0000","last_became_peered":"2023-10-14T09:17:24.655902+0000","last_unstale":"2023-10-14T09:17:26.058171+0000","last_undegraded":"2023-10-14T09:17:26.058171+0000","last_fullsized":"2023-10-14T09:17:26.058171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:56.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149035+0000","last_change":"2023-10-14T09:17:25.074931+0000","last_active":"2023-10-14T09:17:26.149035+0000","last_peered":"2023-10-14T09:17:26.149035+0000","last_clean":"2023-10-14T09:17:26.149035+0000","last_became_active":"2023-10-14T09:17:25.074606+0000","last_became_peered":"2023-10-14T09:17:25.074606+0000","last_unstale":"2023-10-14T09:17:26.149035+0000","last_undegraded":"2023-10-14T09:17:26.149035+0000","last_fullsized":"2023-10-14T09:17:26.149035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057641+0000","last_change":"2023-10-14T09:17:24.660850+0000","last_active":"2023-10-14T09:17:26.057641+0000","last_peered":"2023-10-14T09:17:26.057641+0000","last_clean":"2023-10-14T09:17:26.057641+0000","last_became_active":"2023-10-14T09:17:24.660566+0000","last_became_peered":"2023-10-14T09:17:24.660566+0000","last_unstale":"2023-10-14T09:17:26.057641+0000","last_undegraded":"2023-10-14T09:17:26.057641+0000","last_fullsized":"2023-10-14T09:17:26.057641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:55.254926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057347+0000","last_change":"2023-10-14T09:17:25.084623+0000","last_active":"2023-10-14T09:17:26.057347+0000","last_peered":"2023-10-14T09:17:26.057347+0000","last_clean":"2023-10-14T09:17:26.057347+0000","last_became_active":"2023-10-14T09:17:25.083870+0000","last_became_peered":"2023-10-14T09:17:25.083870+0000","last_unstale":"2023-10-14T09:17:26.057347+0000","last_undegraded":"2023-10-14T09:17:26.057347+0000","last_fullsized":"2023-10-14T09:17:26.057347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:56.260635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147002+0000","last_change":"2023-10-14T09:17:24.655371+0000","last_active":"2023-10-14T09:17:26.147002+0000","last_peered":"2023-10-14T09:17:26.147002+0000","last_clean":"2023-10-14T09:17:26.147002+0000","last_became_active":"2023-10-14T09:17:24.654821+0000","last_became_peered":"2023-10-14T09:17:24.654821+0000","last_unstale":"2023-10-14T09:17:26.147002+0000","last_undegraded":"2023-10-14T09:17:26.147002+0000","last_fullsized":"2023-10-14T09:17:26.147002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147299+0000","last_change":"2023-10-14T09:17:25.073958+0000","last_active":"2023-10-14T09:17:26.147299+0000","last_peered":"2023-10-14T09:17:26.147299+0000","last_clean":"2023-10-14T09:17:26.147299+0000","last_became_active":"2023-10-14T09:17:25.073630+0000","last_became_peered":"2023-10-14T09:17:25.073630+0000","last_unstale":"2023-10-14T09:17:26.147299+0000","last_undegraded":"2023-10-14T09:17:26.147299+0000","last_fullsized":"2023-10-14T09:17:26.147299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148859+0000","last_change":"2023-10-14T09:17:24.647614+0000","last_active":"2023-10-14T09:17:26.148859+0000","last_peered":"2023-10-14T09:17:26.148859+0000","last_clean":"2023-10-14T09:17:26.148859+0000","last_became_active":"2023-10-14T09:17:24.647181+0000","last_became_peered":"2023-10-14T09:17:24.647181+0000","last_unstale":"2023-10-14T09:17:26.148859+0000","last_undegraded":"2023-10-14T09:17:26.148859+0000","last_fullsized":"2023-10-14T09:17:26.148859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148784+0000","last_change":"2023-10-14T09:17:25.074213+0000","last_active":"2023-10-14T09:17:26.148784+0000","last_peered":"2023-10-14T09:17:26.148784+0000","last_clean":"2023-10-14T09:17:26.148784+0000","last_became_active":"2023-10-14T09:17:25.073939+0000","last_became_peered":"2023-10-14T09:17:25.073939+0000","last_unstale":"2023-10-14T09:17:26.148784+0000","last_undegraded":"2023-10-14T09:17:26.148784+0000","last_fullsized":"2023-10-14T09:17:26.148784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057774+0000","last_change":"2023-10-14T09:17:24.650224+0000","last_active":"2023-10-14T09:17:26.057774+0000","last_peered":"2023-10-14T09:17:26.057774+0000","last_clean":"2023-10-14T09:17:26.057774+0000","last_became_active":"2023-10-14T09:17:24.649874+0000","last_became_peered":"2023-10-14T09:17:24.649874+0000","last_unstale":"2023-10-14T09:17:26.057774+0000","last_undegraded":"2023-10-14T09:17:26.057774+0000","last_fullsized":"2023-10-14T09:17:26.057774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:39.459526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147326+0000","last_change":"2023-10-14T09:17:25.087021+0000","last_active":"2023-10-14T09:17:26.147326+0000","last_peered":"2023-10-14T09:17:26.147326+0000","last_clean":"2023-10-14T09:17:26.147326+0000","last_became_active":"2023-10-14T09:17:25.085886+0000","last_became_peered":"2023-10-14T09:17:25.085886+0000","last_unstale":"2023-10-14T09:17:26.147326+0000","last_undegraded":"2023-10-14T09:17:26.147326+0000","last_fullsized":"2023-10-14T09:17:26.147326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:57.270296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146875+0000","last_change":"2023-10-14T09:17:24.656925+0000","last_active":"2023-10-14T09:17:26.146875+0000","last_peered":"2023-10-14T09:17:26.146875+0000","last_clean":"2023-10-14T09:17:26.146875+0000","last_became_active":"2023-10-14T09:17:24.656662+0000","last_became_peered":"2023-10-14T09:17:24.656662+0000","last_unstale":"2023-10-14T09:17:26.146875+0000","last_undegraded":"2023-10-14T09:17:26.146875+0000","last_fullsized":"2023-10-14T09:17:26.146875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:25.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147060+0000","last_change":"2023-10-14T09:17:25.071484+0000","last_active":"2023-10-14T09:17:26.147060+0000","last_peered":"2023-10-14T09:17:26.147060+0000","last_clean":"2023-10-14T09:17:26.147060+0000","last_became_active":"2023-10-14T09:17:25.070874+0000","last_became_peered":"2023-10-14T09:17:25.070874+0000","last_unstale":"2023-10-14T09:17:26.147060+0000","last_undegraded":"2023-10-14T09:17:26.147060+0000","last_fullsized":"2023-10-14T09:17:26.147060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147921+0000","last_change":"2023-10-14T09:17:24.650705+0000","last_active":"2023-10-14T09:17:26.147921+0000","last_peered":"2023-10-14T09:17:26.147921+0000","last_clean":"2023-10-14T09:17:26.147921+0000","last_became_active":"2023-10-14T09:17:24.650339+0000","last_became_peered":"2023-10-14T09:17:24.650339+0000","last_unstale":"2023-10-14T09:17:26.147921+0000","last_undegraded":"2023-10-14T09:17:26.147921+0000","last_fullsized":"2023-10-14T09:17:26.147921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:01.491312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147488+0000","last_change":"2023-10-14T09:17:25.086229+0000","last_active":"2023-10-14T09:17:26.147488+0000","last_peered":"2023-10-14T09:17:26.147488+0000","last_clean":"2023-10-14T09:17:26.147488+0000","last_became_active":"2023-10-14T09:17:25.085568+0000","last_became_peered":"2023-10-14T09:17:25.085568+0000","last_unstale":"2023-10-14T09:17:26.147488+0000","last_undegraded":"2023-10-14T09:17:26.147488+0000","last_fullsized":"2023-10-14T09:17:26.147488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:08.172052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057268+0000","last_change":"2023-10-14T09:17:24.651869+0000","last_active":"2023-10-14T09:17:26.057268+0000","last_peered":"2023-10-14T09:17:26.057268+0000","last_clean":"2023-10-14T09:17:26.057268+0000","last_became_active":"2023-10-14T09:17:24.651545+0000","last_became_peered":"2023-10-14T09:17:24.651545+0000","last_unstale":"2023-10-14T09:17:26.057268+0000","last_undegraded":"2023-10-14T09:17:26.057268+0000","last_fullsized":"2023-10-14T09:17:26.057268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:01.491312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147728+0000","last_change":"2023-10-14T09:17:25.086054+0000","last_active":"2023-10-14T09:17:26.147728+0000","last_peered":"2023-10-14T09:17:26.147728+0000","last_clean":"2023-10-14T09:17:26.147728+0000","last_became_active":"2023-10-14T09:17:25.085704+0000","last_became_peered":"2023-10-14T09:17:25.085704+0000","last_unstale":"2023-10-14T09:17:26.147728+0000","last_undegraded":"2023-10-14T09:17:26.147728+0000","last_fullsized":"2023-10-14T09:17:26.147728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:13.523277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148998+0000","last_change":"2023-10-14T09:17:24.647549+0000","last_active":"2023-10-14T09:17:26.148998+0000","last_peered":"2023-10-14T09:17:26.148998+0000","last_clean":"2023-10-14T09:17:26.148998+0000","last_became_active":"2023-10-14T09:17:24.645321+0000","last_became_peered":"2023-10-14T09:17:24.645321+0000","last_unstale":"2023-10-14T09:17:26.148998+0000","last_undegraded":"2023-10-14T09:17:26.148998+0000","last_fullsized":"2023-10-14T09:17:26.148998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:55.254926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147428+0000","last_change":"2023-10-14T09:17:25.086522+0000","last_active":"2023-10-14T09:17:26.147428+0000","last_peered":"2023-10-14T09:17:26.147428+0000","last_clean":"2023-10-14T09:17:26.147428+0000","last_became_active":"2023-10-14T09:17:25.086192+0000","last_became_peered":"2023-10-14T09:17:25.086192+0000","last_unstale":"2023-10-14T09:17:26.147428+0000","last_undegraded":"2023-10-14T09:17:26.147428+0000","last_fullsized":"2023-10-14T09:17:26.147428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:57.142103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057720+0000","last_change":"2023-10-14T09:17:24.654486+0000","last_active":"2023-10-14T09:17:26.057720+0000","last_peered":"2023-10-14T09:17:26.057720+0000","last_clean":"2023-10-14T09:17:26.057720+0000","last_became_active":"2023-10-14T09:17:24.652694+0000","last_became_peered":"2023-10-14T09:17:24.652694+0000","last_unstale":"2023-10-14T09:17:26.057720+0000","last_undegraded":"2023-10-14T09:17:26.057720+0000","last_fullsized":"2023-10-14T09:17:26.057720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058138+0000","last_change":"2023-10-14T09:17:25.067993+0000","last_active":"2023-10-14T09:17:26.058138+0000","last_peered":"2023-10-14T09:17:26.058138+0000","last_clean":"2023-10-14T09:17:26.058138+0000","last_became_active":"2023-10-14T09:17:25.067671+0000","last_became_peered":"2023-10-14T09:17:25.067671+0000","last_unstale":"2023-10-14T09:17:26.058138+0000","last_undegraded":"2023-10-14T09:17:26.058138+0000","last_fullsized":"2023-10-14T09:17:26.058138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:26.745591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148710+0000","last_change":"2023-10-14T09:17:24.638946+0000","last_active":"2023-10-14T09:17:26.148710+0000","last_peered":"2023-10-14T09:17:26.148710+0000","last_clean":"2023-10-14T09:17:26.148710+0000","last_became_active":"2023-10-14T09:17:24.638655+0000","last_became_peered":"2023-10-14T09:17:24.638655+0000","last_unstale":"2023-10-14T09:17:26.148710+0000","last_undegraded":"2023-10-14T09:17:26.148710+0000","last_fullsized":"2023-10-14T09:17:26.148710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:00.618802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147399+0000","last_change":"2023-10-14T09:17:25.084705+0000","last_active":"2023-10-14T09:17:26.147399+0000","last_peered":"2023-10-14T09:17:26.147399+0000","last_clean":"2023-10-14T09:17:26.147399+0000","last_became_active":"2023-10-14T09:17:25.084208+0000","last_became_peered":"2023-10-14T09:17:25.084208+0000","last_unstale":"2023-10-14T09:17:26.147399+0000","last_undegraded":"2023-10-14T09:17:26.147399+0000","last_fullsized":"2023-10-14T09:17:26.147399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:52.745681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T09:17:25.064563+0000","last_change":"2023-10-14T09:17:14.304224+0000","last_active":"2023-10-14T09:17:25.064563+0000","last_peered":"2023-10-14T09:17:25.064563+0000","last_clean":"2023-10-14T09:17:25.064563+0000","last_became_active":"2023-10-14T09:17:14.303743+0000","last_became_peered":"2023-10-14T09:17:14.303743+0000","last_unstale":"2023-10-14T09:17:25.064563+0000","last_undegraded":"2023-10-14T09:17:25.064563+0000","last_fullsized":"2023-10-14T09:17:25.064563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_clean_scrub_stamp":"2023-10-14T09:17:13.285641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:24.100243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057432+0000","last_change":"2023-10-14T09:17:24.646906+0000","last_active":"2023-10-14T09:17:26.057432+0000","last_peered":"2023-10-14T09:17:26.057432+0000","last_clean":"2023-10-14T09:17:26.057432+0000","last_became_active":"2023-10-14T09:17:24.646536+0000","last_became_peered":"2023-10-14T09:17:24.646536+0000","last_unstale":"2023-10-14T09:17:26.057432+0000","last_undegraded":"2023-10-14T09:17:26.057432+0000","last_fullsized":"2023-10-14T09:17:26.057432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149345+0000","last_change":"2023-10-14T09:17:25.065358+0000","last_active":"2023-10-14T09:17:26.149345+0000","last_peered":"2023-10-14T09:17:26.149345+0000","last_clean":"2023-10-14T09:17:26.149345+0000","last_became_active":"2023-10-14T09:17:25.065048+0000","last_became_peered":"2023-10-14T09:17:25.065048+0000","last_unstale":"2023-10-14T09:17:26.149345+0000","last_undegraded":"2023-10-14T09:17:26.149345+0000","last_fullsized":"2023-10-14T09:17:26.149345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147353+0000","last_change":"2023-10-14T09:17:24.663937+0000","last_active":"2023-10-14T09:17:26.147353+0000","last_peered":"2023-10-14T09:17:26.147353+0000","last_clean":"2023-10-14T09:17:26.147353+0000","last_became_active":"2023-10-14T09:17:24.663420+0000","last_became_peered":"2023-10-14T09:17:24.663420+0000","last_unstale":"2023-10-14T09:17:26.147353+0000","last_undegraded":"2023-10-14T09:17:26.147353+0000","last_fullsized":"2023-10-14T09:17:26.147353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148230+0000","last_change":"2023-10-14T09:17:25.079632+0000","last_active":"2023-10-14T09:17:26.148230+0000","last_peered":"2023-10-14T09:17:26.148230+0000","last_clean":"2023-10-14T09:17:26.148230+0000","last_became_active":"2023-10-14T09:17:25.079358+0000","last_became_peered":"2023-10-14T09:17:25.079358+0000","last_unstale":"2023-10-14T09:17:26.148230+0000","last_undegraded":"2023-10-14T09:17:26.148230+0000","last_fullsized":"2023-10-14T09:17:26.148230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:03.207187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148663+0000","last_change":"2023-10-14T09:17:24.646437+0000","last_active":"2023-10-14T09:17:26.148663+0000","last_peered":"2023-10-14T09:17:26.148663+0000","last_clean":"2023-10-14T09:17:26.148663+0000","last_became_active":"2023-10-14T09:17:24.645079+0000","last_became_peered":"2023-10-14T09:17:24.645079+0000","last_unstale":"2023-10-14T09:17:26.148663+0000","last_undegraded":"2023-10-14T09:17:26.148663+0000","last_fullsized":"2023-10-14T09:17:26.148663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:57.876385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057579+0000","last_change":"2023-10-14T09:17:25.057184+0000","last_active":"2023-10-14T09:17:26.057579+0000","last_peered":"2023-10-14T09:17:26.057579+0000","last_clean":"2023-10-14T09:17:26.057579+0000","last_became_active":"2023-10-14T09:17:25.056927+0000","last_became_peered":"2023-10-14T09:17:25.056927+0000","last_unstale":"2023-10-14T09:17:26.057579+0000","last_undegraded":"2023-10-14T09:17:26.057579+0000","last_fullsized":"2023-10-14T09:17:26.057579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057868+0000","last_change":"2023-10-14T09:17:24.654452+0000","last_active":"2023-10-14T09:17:26.057868+0000","last_peered":"2023-10-14T09:17:26.057868+0000","last_clean":"2023-10-14T09:17:26.057868+0000","last_became_active":"2023-10-14T09:17:24.654123+0000","last_became_peered":"2023-10-14T09:17:24.654123+0000","last_unstale":"2023-10-14T09:17:26.057868+0000","last_undegraded":"2023-10-14T09:17:26.057868+0000","last_fullsized":"2023-10-14T09:17:26.057868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:06.694051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057462+0000","last_change":"2023-10-14T09:17:25.065503+0000","last_active":"2023-10-14T09:17:26.057462+0000","last_peered":"2023-10-14T09:17:26.057462+0000","last_clean":"2023-10-14T09:17:26.057462+0000","last_became_active":"2023-10-14T09:17:25.065201+0000","last_became_peered":"2023-10-14T09:17:25.065201+0000","last_unstale":"2023-10-14T09:17:26.057462+0000","last_undegraded":"2023-10-14T09:17:26.057462+0000","last_fullsized":"2023-10-14T09:17:26.057462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:08.387279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057636+0000","last_change":"2023-10-14T09:17:24.654216+0000","last_active":"2023-10-14T09:17:26.057636+0000","last_peered":"2023-10-14T09:17:26.057636+0000","last_clean":"2023-10-14T09:17:26.057636+0000","last_became_active":"2023-10-14T09:17:24.653646+0000","last_became_peered":"2023-10-14T09:17:24.653646+0000","last_unstale":"2023-10-14T09:17:26.057636+0000","last_undegraded":"2023-10-14T09:17:26.057636+0000","last_fullsized":"2023-10-14T09:17:26.057636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057990+0000","last_change":"2023-10-14T09:17:25.072986+0000","last_active":"2023-10-14T09:17:26.057990+0000","last_peered":"2023-10-14T09:17:26.057990+0000","last_clean":"2023-10-14T09:17:26.057990+0000","last_became_active":"2023-10-14T09:17:25.072730+0000","last_became_peered":"2023-10-14T09:17:25.072730+0000","last_unstale":"2023-10-14T09:17:26.057990+0000","last_undegraded":"2023-10-14T09:17:26.057990+0000","last_fullsized":"2023-10-14T09:17:26.057990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:57.270296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147812+0000","last_change":"2023-10-14T09:17:24.663546+0000","last_active":"2023-10-14T09:17:26.147812+0000","last_peered":"2023-10-14T09:17:26.147812+0000","last_clean":"2023-10-14T09:17:26.147812+0000","last_became_active":"2023-10-14T09:17:24.663199+0000","last_became_peered":"2023-10-14T09:17:24.663199+0000","last_unstale":"2023-10-14T09:17:26.147812+0000","last_undegraded":"2023-10-14T09:17:26.147812+0000","last_fullsized":"2023-10-14T09:17:26.147812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:48.194426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057548+0000","last_change":"2023-10-14T09:17:25.061842+0000","last_active":"2023-10-14T09:17:26.057548+0000","last_peered":"2023-10-14T09:17:26.057548+0000","last_clean":"2023-10-14T09:17:26.057548+0000","last_became_active":"2023-10-14T09:17:25.061587+0000","last_became_peered":"2023-10-14T09:17:25.061587+0000","last_unstale":"2023-10-14T09:17:26.057548+0000","last_undegraded":"2023-10-14T09:17:26.057548+0000","last_fullsized":"2023-10-14T09:17:26.057548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:27.250002+0000","last_change":"2023-10-14T09:17:24.657107+0000","last_active":"2023-10-14T09:17:27.250002+0000","last_peered":"2023-10-14T09:17:27.250002+0000","last_clean":"2023-10-14T09:17:27.250002+0000","last_became_active":"2023-10-14T09:17:24.656772+0000","last_became_peered":"2023-10-14T09:17:24.656772+0000","last_unstale":"2023-10-14T09:17:27.250002+0000","last_undegraded":"2023-10-14T09:17:27.250002+0000","last_fullsized":"2023-10-14T09:17:27.250002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:33.644028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149658+0000","last_change":"2023-10-14T09:17:25.077360+0000","last_active":"2023-10-14T09:17:26.149658+0000","last_peered":"2023-10-14T09:17:26.149658+0000","last_clean":"2023-10-14T09:17:26.149658+0000","last_became_active":"2023-10-14T09:17:25.076972+0000","last_became_peered":"2023-10-14T09:17:25.076972+0000","last_unstale":"2023-10-14T09:17:26.149658+0000","last_undegraded":"2023-10-14T09:17:26.149658+0000","last_fullsized":"2023-10-14T09:17:26.149658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147675+0000","last_change":"2023-10-14T09:17:24.650946+0000","last_active":"2023-10-14T09:17:26.147675+0000","last_peered":"2023-10-14T09:17:26.147675+0000","last_clean":"2023-10-14T09:17:26.147675+0000","last_became_active":"2023-10-14T09:17:24.650657+0000","last_became_peered":"2023-10-14T09:17:24.650657+0000","last_unstale":"2023-10-14T09:17:26.147675+0000","last_undegraded":"2023-10-14T09:17:26.147675+0000","last_fullsized":"2023-10-14T09:17:26.147675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148670+0000","last_change":"2023-10-14T09:17:25.065959+0000","last_active":"2023-10-14T09:17:26.148670+0000","last_peered":"2023-10-14T09:17:26.148670+0000","last_clean":"2023-10-14T09:17:26.148670+0000","last_became_active":"2023-10-14T09:17:25.065708+0000","last_became_peered":"2023-10-14T09:17:25.065708+0000","last_unstale":"2023-10-14T09:17:26.148670+0000","last_undegraded":"2023-10-14T09:17:26.148670+0000","last_fullsized":"2023-10-14T09:17:26.148670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147118+0000","last_change":"2023-10-14T09:17:24.663717+0000","last_active":"2023-10-14T09:17:26.147118+0000","last_peered":"2023-10-14T09:17:26.147118+0000","last_clean":"2023-10-14T09:17:26.147118+0000","last_became_active":"2023-10-14T09:17:24.663082+0000","last_became_peered":"2023-10-14T09:17:24.663082+0000","last_unstale":"2023-10-14T09:17:26.147118+0000","last_undegraded":"2023-10-14T09:17:26.147118+0000","last_fullsized":"2023-10-14T09:17:26.147118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057370+0000","last_change":"2023-10-14T09:17:25.062652+0000","last_active":"2023-10-14T09:17:26.057370+0000","last_peered":"2023-10-14T09:17:26.057370+0000","last_clean":"2023-10-14T09:17:26.057370+0000","last_became_active":"2023-10-14T09:17:25.062345+0000","last_became_peered":"2023-10-14T09:17:25.062345+0000","last_unstale":"2023-10-14T09:17:26.057370+0000","last_undegraded":"2023-10-14T09:17:26.057370+0000","last_fullsized":"2023-10-14T09:17:26.057370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:26.084905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057462+0000","last_change":"2023-10-14T09:17:24.655398+0000","last_active":"2023-10-14T09:17:26.057462+0000","last_peered":"2023-10-14T09:17:26.057462+0000","last_clean":"2023-10-14T09:17:26.057462+0000","last_became_active":"2023-10-14T09:17:24.654885+0000","last_became_peered":"2023-10-14T09:17:24.654885+0000","last_unstale":"2023-10-14T09:17:26.057462+0000","last_undegraded":"2023-10-14T09:17:26.057462+0000","last_fullsized":"2023-10-14T09:17:26.057462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148294+0000","last_change":"2023-10-14T09:17:25.063668+0000","last_active":"2023-10-14T09:17:26.148294+0000","last_peered":"2023-10-14T09:17:26.148294+0000","last_clean":"2023-10-14T09:17:26.148294+0000","last_became_active":"2023-10-14T09:17:25.063408+0000","last_became_peered":"2023-10-14T09:17:25.063408+0000","last_unstale":"2023-10-14T09:17:26.148294+0000","last_undegraded":"2023-10-14T09:17:26.148294+0000","last_fullsized":"2023-10-14T09:17:26.148294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057694+0000","last_change":"2023-10-14T09:17:24.652502+0000","last_active":"2023-10-14T09:17:26.057694+0000","last_peered":"2023-10-14T09:17:26.057694+0000","last_clean":"2023-10-14T09:17:26.057694+0000","last_became_active":"2023-10-14T09:17:24.652222+0000","last_became_peered":"2023-10-14T09:17:24.652222+0000","last_unstale":"2023-10-14T09:17:26.057694+0000","last_undegraded":"2023-10-14T09:17:26.057694+0000","last_fullsized":"2023-10-14T09:17:26.057694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:57.876385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149500+0000","last_change":"2023-10-14T09:17:25.070505+0000","last_active":"2023-10-14T09:17:26.149500+0000","last_peered":"2023-10-14T09:17:26.149500+0000","last_clean":"2023-10-14T09:17:26.149500+0000","last_became_active":"2023-10-14T09:17:25.070227+0000","last_became_peered":"2023-10-14T09:17:25.070227+0000","last_unstale":"2023-10-14T09:17:26.149500+0000","last_undegraded":"2023-10-14T09:17:26.149500+0000","last_fullsized":"2023-10-14T09:17:26.149500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147529+0000","last_change":"2023-10-14T09:17:24.663767+0000","last_active":"2023-10-14T09:17:26.147529+0000","last_peered":"2023-10-14T09:17:26.147529+0000","last_clean":"2023-10-14T09:17:26.147529+0000","last_became_active":"2023-10-14T09:17:24.663287+0000","last_became_peered":"2023-10-14T09:17:24.663287+0000","last_unstale":"2023-10-14T09:17:26.147529+0000","last_undegraded":"2023-10-14T09:17:26.147529+0000","last_fullsized":"2023-10-14T09:17:26.147529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:52.317766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147098+0000","last_change":"2023-10-14T09:17:25.083037+0000","last_active":"2023-10-14T09:17:26.147098+0000","last_peered":"2023-10-14T09:17:26.147098+0000","last_clean":"2023-10-14T09:17:26.147098+0000","last_became_active":"2023-10-14T09:17:25.082685+0000","last_became_peered":"2023-10-14T09:17:25.082685+0000","last_unstale":"2023-10-14T09:17:26.147098+0000","last_undegraded":"2023-10-14T09:17:26.147098+0000","last_fullsized":"2023-10-14T09:17:26.147098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058036+0000","last_change":"2023-10-14T09:17:25.070513+0000","last_active":"2023-10-14T09:17:26.058036+0000","last_peered":"2023-10-14T09:17:26.058036+0000","last_clean":"2023-10-14T09:17:26.058036+0000","last_became_active":"2023-10-14T09:17:25.070206+0000","last_became_peered":"2023-10-14T09:17:25.070206+0000","last_unstale":"2023-10-14T09:17:26.058036+0000","last_undegraded":"2023-10-14T09:17:26.058036+0000","last_fullsized":"2023-10-14T09:17:26.058036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:52.745681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147258+0000","last_change":"2023-10-14T09:17:24.663588+0000","last_active":"2023-10-14T09:17:26.147258+0000","last_peered":"2023-10-14T09:17:26.147258+0000","last_clean":"2023-10-14T09:17:26.147258+0000","last_became_active":"2023-10-14T09:17:24.663275+0000","last_became_peered":"2023-10-14T09:17:24.663275+0000","last_unstale":"2023-10-14T09:17:26.147258+0000","last_undegraded":"2023-10-14T09:17:26.147258+0000","last_fullsized":"2023-10-14T09:17:26.147258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058308+0000","last_change":"2023-10-14T09:17:25.081621+0000","last_active":"2023-10-14T09:17:26.058308+0000","last_peered":"2023-10-14T09:17:26.058308+0000","last_clean":"2023-10-14T09:17:26.058308+0000","last_became_active":"2023-10-14T09:17:25.081183+0000","last_became_peered":"2023-10-14T09:17:25.081183+0000","last_unstale":"2023-10-14T09:17:26.058308+0000","last_undegraded":"2023-10-14T09:17:26.058308+0000","last_fullsized":"2023-10-14T09:17:26.058308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:08.172052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147404+0000","last_change":"2023-10-14T09:17:24.664054+0000","last_active":"2023-10-14T09:17:26.147404+0000","last_peered":"2023-10-14T09:17:26.147404+0000","last_clean":"2023-10-14T09:17:26.147404+0000","last_became_active":"2023-10-14T09:17:24.663750+0000","last_became_peered":"2023-10-14T09:17:24.663750+0000","last_unstale":"2023-10-14T09:17:26.147404+0000","last_undegraded":"2023-10-14T09:17:26.147404+0000","last_fullsized":"2023-10-14T09:17:26.147404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148919+0000","last_change":"2023-10-14T09:17:25.079820+0000","last_active":"2023-10-14T09:17:26.148919+0000","last_peered":"2023-10-14T09:17:26.148919+0000","last_clean":"2023-10-14T09:17:26.148919+0000","last_became_active":"2023-10-14T09:17:25.079573+0000","last_became_peered":"2023-10-14T09:17:25.079573+0000","last_unstale":"2023-10-14T09:17:26.148919+0000","last_undegraded":"2023-10-14T09:17:26.148919+0000","last_fullsized":"2023-10-14T09:17:26.148919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149601+0000","last_change":"2023-10-14T09:17:24.652635+0000","last_active":"2023-10-14T09:17:26.149601+0000","last_peered":"2023-10-14T09:17:26.149601+0000","last_clean":"2023-10-14T09:17:26.149601+0000","last_became_active":"2023-10-14T09:17:24.652363+0000","last_became_peered":"2023-10-14T09:17:24.652363+0000","last_unstale":"2023-10-14T09:17:26.149601+0000","last_undegraded":"2023-10-14T09:17:26.149601+0000","last_fullsized":"2023-10-14T09:17:26.149601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149517+0000","last_change":"2023-10-14T09:17:25.078752+0000","last_active":"2023-10-14T09:17:26.149517+0000","last_peered":"2023-10-14T09:17:26.149517+0000","last_clean":"2023-10-14T09:17:26.149517+0000","last_became_active":"2023-10-14T09:17:25.078504+0000","last_became_peered":"2023-10-14T09:17:25.078504+0000","last_unstale":"2023-10-14T09:17:26.149517+0000","last_undegraded":"2023-10-14T09:17:26.149517+0000","last_fullsized":"2023-10-14T09:17:26.149517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:17.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149133+0000","last_change":"2023-10-14T09:17:24.651100+0000","last_active":"2023-10-14T09:17:26.149133+0000","last_peered":"2023-10-14T09:17:26.149133+0000","last_clean":"2023-10-14T09:17:26.149133+0000","last_became_active":"2023-10-14T09:17:24.650418+0000","last_became_peered":"2023-10-14T09:17:24.650418+0000","last_unstale":"2023-10-14T09:17:26.149133+0000","last_undegraded":"2023-10-14T09:17:26.149133+0000","last_fullsized":"2023-10-14T09:17:26.149133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":661848,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5389999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4489999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4770000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5119999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":661904,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:17:36.074 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:17:36.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.241+0000 7fd8babd9640 1 Processor -- start 2023-10-14T09:17:36.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8babd9640 1 -- start start 2023-10-14T09:17:36.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8babd9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8b414ddb0 0x7fd8b40c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8babd9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b406c470 con 0x7fd8b40c6910 2023-10-14T09:17:36.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8babd9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b406c750 con 0x7fd8b4153e80 2023-10-14T09:17:36.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8babd9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40c64f0 con 0x7fd8b414ddb0 2023-10-14T09:17:36.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8b9176640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd8b40c6910 0x7fd8b40c3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34000/0 (socket says 172.21.15.78:34000) 2023-10-14T09:17:36.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8b9176640 1 -- 172.21.15.78:0/3787079719 learned_addr learned my addr 172.21.15.78:0/3787079719 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:36.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8b8975640 1 --2- 172.21.15.78:0/3787079719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8b414ddb0 0x7fd8b40c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8ab7fe640 1 -- 172.21.15.78:0/3787079719 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880230727 0 0) 0x7fd8b406c470 con 0x7fd8b40c6910 2023-10-14T09:17:36.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8ab7fe640 1 -- 172.21.15.78:0/3787079719 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd89c003530 con 0x7fd8b40c6910 2023-10-14T09:17:36.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8ab7fe640 1 -- 172.21.15.78:0/3787079719 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757641220 0 0) 0x7fd8b406c750 con 0x7fd8b4153e80 2023-10-14T09:17:36.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8ab7fe640 1 -- 172.21.15.78:0/3787079719 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b406c470 con 0x7fd8b4153e80 2023-10-14T09:17:36.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8b8975640 1 -- 172.21.15.78:0/3787079719 >> v1:172.21.15.157:6789/0 conn(0x7fd8b4153e80 legacy=0x7fd8b406bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8b8975640 1 -- 172.21.15.78:0/3787079719 >> v1:172.21.15.78:6789/0 conn(0x7fd8b40c6910 legacy=0x7fd8b40c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8ab7fe640 1 -- 172.21.15.78:0/3787079719 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2041737481 0 0) 0x7fd89c003530 con 0x7fd8b40c6910 2023-10-14T09:17:36.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.245+0000 7fd8b8975640 1 -- 172.21.15.78:0/3787079719 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b406ca30 con 0x7fd8b414ddb0 2023-10-14T09:17:36.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8b8975640 1 --2- 172.21.15.78:0/3787079719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8b414ddb0 0x7fd8b40c7780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00097f0 tx=0x7fd8b001c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73026eddfd716463 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:36.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8ab7fe640 1 -- 172.21.15.78:0/3787079719 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac001a00 con 0x7fd8b414ddb0 2023-10-14T09:17:36.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8ab7fe640 1 -- 172.21.15.78:0/3787079719 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b00a7050 con 0x7fd8b414ddb0 2023-10-14T09:17:36.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8ab7fe640 1 -- 172.21.15.78:0/3787079719 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00ab620 con 0x7fd8b414ddb0 2023-10-14T09:17:36.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8babd9640 1 -- 172.21.15.78:0/3787079719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8b414ddb0 msgr2=0x7fd8b40c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8babd9640 1 --2- 172.21.15.78:0/3787079719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8b414ddb0 0x7fd8b40c7780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00097f0 tx=0x7fd8b001c2c0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8babd9640 1 -- 172.21.15.78:0/3787079719 shutdown_connections 2023-10-14T09:17:36.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8babd9640 1 --2- 172.21.15.78:0/3787079719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8b414ddb0 0x7fd8b40c7780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8babd9640 1 -- 172.21.15.78:0/3787079719 >> 172.21.15.78:0/3787079719 conn(0x7fd8b40ab1f0 msgr2=0x7fd8b40ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:36.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8babd9640 1 -- 172.21.15.78:0/3787079719 shutdown_connections 2023-10-14T09:17:36.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8babd9640 1 -- 172.21.15.78:0/3787079719 wait complete. 2023-10-14T09:17:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8babd9640 1 Processor -- start 2023-10-14T09:17:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.249+0000 7fd8babd9640 1 -- start start 2023-10-14T09:17:36.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8babd9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8b40c6910 0x7fd8b414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8babd9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b414ddb0 0x7fd8b4153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8babd9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8b4153e80 0x7fd8b41ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8babd9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b4157f90 con 0x7fd8b414ddb0 2023-10-14T09:17:36.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8babd9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b41ec680 con 0x7fd8b4153e80 2023-10-14T09:17:36.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8babd9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40bf3c0 con 0x7fd8b40c6910 2023-10-14T09:17:36.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8abfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b414ddb0 0x7fd8b4153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8abfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b414ddb0 0x7fd8b4153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39600/0 (socket says 172.21.15.78:39600) 2023-10-14T09:17:36.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8abfff640 1 -- 172.21.15.78:0/495745768 learned_addr learned my addr 172.21.15.78:0/495745768 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:36.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8b8975640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8b40c6910 0x7fd8b414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8b9176640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8b4153e80 0x7fd8b41ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8abfff640 1 -- 172.21.15.78:0/495745768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8b40c6910 msgr2=0x7fd8b414b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8abfff640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8b40c6910 0x7fd8b414b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8abfff640 1 -- 172.21.15.78:0/495745768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8b4153e80 msgr2=0x7fd8b41ecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8abfff640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8b4153e80 0x7fd8b41ecdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8abfff640 1 -- 172.21.15.78:0/495745768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0009420 con 0x7fd8b414ddb0 2023-10-14T09:17:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8abfff640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b414ddb0 0x7fd8b4153590 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400c530 tx=0x7fd8a400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8a97fa640 1 -- 172.21.15.78:0/495745768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a40052d0 con 0x7fd8b414ddb0 2023-10-14T09:17:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8a97fa640 1 -- 172.21.15.78:0/495745768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a4005430 con 0x7fd8b414ddb0 2023-10-14T09:17:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8a97fa640 1 -- 172.21.15.78:0/495745768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4012870 con 0x7fd8b414ddb0 2023-10-14T09:17:36.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8babd9640 1 -- 172.21.15.78:0/495745768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b41f0b00 con 0x7fd8b414ddb0 2023-10-14T09:17:36.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8babd9640 1 -- 172.21.15.78:0/495745768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b4157cb0 con 0x7fd8b414ddb0 2023-10-14T09:17:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.253+0000 7fd8babd9640 1 -- 172.21.15.78:0/495745768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b4074180 con 0x7fd8b414ddb0 2023-10-14T09:17:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.257+0000 7fd8a97fa640 1 -- 172.21.15.78:0/495745768 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd8a40129d0 con 0x7fd8b414ddb0 2023-10-14T09:17:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.257+0000 7fd8a97fa640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd8a00664a0 0x7fd8a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.257+0000 7fd8a97fa640 1 -- 172.21.15.78:0/495745768 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8a4083930 con 0x7fd8b414ddb0 2023-10-14T09:17:36.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.257+0000 7fd8b8975640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd8a00664a0 0x7fd8a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.257+0000 7fd8b8975640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd8a00664a0 0x7fd8a0068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00ad000 tx=0x7fd8b00a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:36.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.261+0000 7fd8a97fa640 1 -- 172.21.15.78:0/495745768 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8a4050dd0 con 0x7fd8b414ddb0 2023-10-14T09:17:36.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.405+0000 7fd8babd9640 1 -- 172.21.15.78:0/495745768 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8b4161f50 con 0x7fd8a00664a0 2023-10-14T09:17:36.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.413+0000 7fd8a97fa640 1 -- 172.21.15.78:0/495745768 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264707 (secure 0 0 0) 0x7fd8b00ab580 con 0x7fd8a00664a0 2023-10-14T09:17:36.421 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:36.423 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-10-14T09:17:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 -- 172.21.15.78:0/495745768 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd8a00664a0 msgr2=0x7fd8a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd8a00664a0 0x7fd8a0068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00ad000 tx=0x7fd8b00a6000 comp rx=0 tx=0).stop 2023-10-14T09:17:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 -- 172.21.15.78:0/495745768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b414ddb0 msgr2=0x7fd8b4153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b414ddb0 0x7fd8b4153590 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400c530 tx=0x7fd8a400c9f0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 -- 172.21.15.78:0/495745768 shutdown_connections 2023-10-14T09:17:36.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd8b4153e80 0x7fd8b41ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8b414ddb0 0x7fd8b4153590 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd8a00664a0 0x7fd8a0068960 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 --2- 172.21.15.78:0/495745768 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd8b40c6910 0x7fd8b414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 -- 172.21.15.78:0/495745768 >> 172.21.15.78:0/495745768 conn(0x7fd8b40ab1f0 msgr2=0x7fd8b40aa330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:36.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 -- 172.21.15.78:0/495745768 shutdown_connections 2023-10-14T09:17:36.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.417+0000 7fd8babd9640 1 -- 172.21.15.78:0/495745768 wait complete. 2023-10-14T09:17:36.441 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-14T09:17:35.233353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217980,"kb_used_data":1792,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756740,"statfs":{"total":773094113280,"available":772870901760,"internally_reserved":0,"allocated":1835008,"data_stored":1752740,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.007157"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147278+0000","last_change":"2023-10-14T09:17:25.079007+0000","last_active":"2023-10-14T09:17:26.147278+0000","last_peered":"2023-10-14T09:17:26.147278+0000","last_clean":"2023-10-14T09:17:26.147278+0000","last_became_active":"2023-10-14T09:17:25.078749+0000","last_became_peered":"2023-10-14T09:17:25.078749+0000","last_unstale":"2023-10-14T09:17:26.147278+0000","last_undegraded":"2023-10-14T09:17:26.147278+0000","last_fullsized":"2023-10-14T09:17:26.147278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057783+0000","last_change":"2023-10-14T09:17:25.065460+0000","last_active":"2023-10-14T09:17:26.057783+0000","last_peered":"2023-10-14T09:17:26.057783+0000","last_clean":"2023-10-14T09:17:26.057783+0000","last_became_active":"2023-10-14T09:17:25.065172+0000","last_became_peered":"2023-10-14T09:17:25.065172+0000","last_unstale":"2023-10-14T09:17:26.057783+0000","last_undegraded":"2023-10-14T09:17:26.057783+0000","last_fullsized":"2023-10-14T09:17:26.057783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148566+0000","last_change":"2023-10-14T09:17:25.070948+0000","last_active":"2023-10-14T09:17:26.148566+0000","last_peered":"2023-10-14T09:17:26.148566+0000","last_clean":"2023-10-14T09:17:26.148566+0000","last_became_active":"2023-10-14T09:17:25.070661+0000","last_became_peered":"2023-10-14T09:17:25.070661+0000","last_unstale":"2023-10-14T09:17:26.148566+0000","last_undegraded":"2023-10-14T09:17:26.148566+0000","last_fullsized":"2023-10-14T09:17:26.148566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:44.354756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057834+0000","last_change":"2023-10-14T09:17:25.072881+0000","last_active":"2023-10-14T09:17:26.057834+0000","last_peered":"2023-10-14T09:17:26.057834+0000","last_clean":"2023-10-14T09:17:26.057834+0000","last_became_active":"2023-10-14T09:17:25.072555+0000","last_became_peered":"2023-10-14T09:17:25.072555+0000","last_unstale":"2023-10-14T09:17:26.057834+0000","last_undegraded":"2023-10-14T09:17:26.057834+0000","last_fullsized":"2023-10-14T09:17:26.057834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147164+0000","last_change":"2023-10-14T09:17:25.083056+0000","last_active":"2023-10-14T09:17:26.147164+0000","last_peered":"2023-10-14T09:17:26.147164+0000","last_clean":"2023-10-14T09:17:26.147164+0000","last_became_active":"2023-10-14T09:17:25.077385+0000","last_became_peered":"2023-10-14T09:17:25.077385+0000","last_unstale":"2023-10-14T09:17:26.147164+0000","last_undegraded":"2023-10-14T09:17:26.147164+0000","last_fullsized":"2023-10-14T09:17:26.147164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057542+0000","last_change":"2023-10-14T09:17:25.063358+0000","last_active":"2023-10-14T09:17:26.057542+0000","last_peered":"2023-10-14T09:17:26.057542+0000","last_clean":"2023-10-14T09:17:26.057542+0000","last_became_active":"2023-10-14T09:17:25.063069+0000","last_became_peered":"2023-10-14T09:17:25.063069+0000","last_unstale":"2023-10-14T09:17:26.057542+0000","last_undegraded":"2023-10-14T09:17:26.057542+0000","last_fullsized":"2023-10-14T09:17:26.057542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:17.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147429+0000","last_change":"2023-10-14T09:17:25.074574+0000","last_active":"2023-10-14T09:17:26.147429+0000","last_peered":"2023-10-14T09:17:26.147429+0000","last_clean":"2023-10-14T09:17:26.147429+0000","last_became_active":"2023-10-14T09:17:25.074288+0000","last_became_peered":"2023-10-14T09:17:25.074288+0000","last_unstale":"2023-10-14T09:17:26.147429+0000","last_undegraded":"2023-10-14T09:17:26.147429+0000","last_fullsized":"2023-10-14T09:17:26.147429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:26.745591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148053+0000","last_change":"2023-10-14T09:17:25.071156+0000","last_active":"2023-10-14T09:17:26.148053+0000","last_peered":"2023-10-14T09:17:26.148053+0000","last_clean":"2023-10-14T09:17:26.148053+0000","last_became_active":"2023-10-14T09:17:25.070907+0000","last_became_peered":"2023-10-14T09:17:25.070907+0000","last_unstale":"2023-10-14T09:17:26.148053+0000","last_undegraded":"2023-10-14T09:17:26.148053+0000","last_fullsized":"2023-10-14T09:17:26.148053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147584+0000","last_change":"2023-10-14T09:17:25.083299+0000","last_active":"2023-10-14T09:17:26.147584+0000","last_peered":"2023-10-14T09:17:26.147584+0000","last_clean":"2023-10-14T09:17:26.147584+0000","last_became_active":"2023-10-14T09:17:25.082917+0000","last_became_peered":"2023-10-14T09:17:25.082917+0000","last_unstale":"2023-10-14T09:17:26.147584+0000","last_undegraded":"2023-10-14T09:17:26.147584+0000","last_fullsized":"2023-10-14T09:17:26.147584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:23.681006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147796+0000","last_change":"2023-10-14T09:17:25.079917+0000","last_active":"2023-10-14T09:17:26.147796+0000","last_peered":"2023-10-14T09:17:26.147796+0000","last_clean":"2023-10-14T09:17:26.147796+0000","last_became_active":"2023-10-14T09:17:25.079320+0000","last_became_peered":"2023-10-14T09:17:25.079320+0000","last_unstale":"2023-10-14T09:17:26.147796+0000","last_undegraded":"2023-10-14T09:17:26.147796+0000","last_fullsized":"2023-10-14T09:17:26.147796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147174+0000","last_change":"2023-10-14T09:17:25.090783+0000","last_active":"2023-10-14T09:17:26.147174+0000","last_peered":"2023-10-14T09:17:26.147174+0000","last_clean":"2023-10-14T09:17:26.147174+0000","last_became_active":"2023-10-14T09:17:25.090462+0000","last_became_peered":"2023-10-14T09:17:25.090462+0000","last_unstale":"2023-10-14T09:17:26.147174+0000","last_undegraded":"2023-10-14T09:17:26.147174+0000","last_fullsized":"2023-10-14T09:17:26.147174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057218+0000","last_change":"2023-10-14T09:17:25.072604+0000","last_active":"2023-10-14T09:17:26.057218+0000","last_peered":"2023-10-14T09:17:26.057218+0000","last_clean":"2023-10-14T09:17:26.057218+0000","last_became_active":"2023-10-14T09:17:25.072215+0000","last_became_peered":"2023-10-14T09:17:25.072215+0000","last_unstale":"2023-10-14T09:17:26.057218+0000","last_undegraded":"2023-10-14T09:17:26.057218+0000","last_fullsized":"2023-10-14T09:17:26.057218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:01.624510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149412+0000","last_change":"2023-10-14T09:17:25.074394+0000","last_active":"2023-10-14T09:17:26.149412+0000","last_peered":"2023-10-14T09:17:26.149412+0000","last_clean":"2023-10-14T09:17:26.149412+0000","last_became_active":"2023-10-14T09:17:25.074139+0000","last_became_peered":"2023-10-14T09:17:25.074139+0000","last_unstale":"2023-10-14T09:17:26.149412+0000","last_undegraded":"2023-10-14T09:17:26.149412+0000","last_fullsized":"2023-10-14T09:17:26.149412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148817+0000","last_change":"2023-10-14T09:17:25.066224+0000","last_active":"2023-10-14T09:17:26.148817+0000","last_peered":"2023-10-14T09:17:26.148817+0000","last_clean":"2023-10-14T09:17:26.148817+0000","last_became_active":"2023-10-14T09:17:25.065977+0000","last_became_peered":"2023-10-14T09:17:25.065977+0000","last_unstale":"2023-10-14T09:17:26.148817+0000","last_undegraded":"2023-10-14T09:17:26.148817+0000","last_fullsized":"2023-10-14T09:17:26.148817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057378+0000","last_change":"2023-10-14T09:17:25.065526+0000","last_active":"2023-10-14T09:17:26.057378+0000","last_peered":"2023-10-14T09:17:26.057378+0000","last_clean":"2023-10-14T09:17:26.057378+0000","last_became_active":"2023-10-14T09:17:25.065045+0000","last_became_peered":"2023-10-14T09:17:25.065045+0000","last_unstale":"2023-10-14T09:17:26.057378+0000","last_undegraded":"2023-10-14T09:17:26.057378+0000","last_fullsized":"2023-10-14T09:17:26.057378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057383+0000","last_change":"2023-10-14T09:17:25.068473+0000","last_active":"2023-10-14T09:17:26.057383+0000","last_peered":"2023-10-14T09:17:26.057383+0000","last_clean":"2023-10-14T09:17:26.057383+0000","last_became_active":"2023-10-14T09:17:25.065827+0000","last_became_peered":"2023-10-14T09:17:25.065827+0000","last_unstale":"2023-10-14T09:17:26.057383+0000","last_undegraded":"2023-10-14T09:17:26.057383+0000","last_fullsized":"2023-10-14T09:17:26.057383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058518+0000","last_change":"2023-10-14T09:17:25.080133+0000","last_active":"2023-10-14T09:17:26.058518+0000","last_peered":"2023-10-14T09:17:26.058518+0000","last_clean":"2023-10-14T09:17:26.058518+0000","last_became_active":"2023-10-14T09:17:25.079868+0000","last_became_peered":"2023-10-14T09:17:25.079868+0000","last_unstale":"2023-10-14T09:17:26.058518+0000","last_undegraded":"2023-10-14T09:17:26.058518+0000","last_fullsized":"2023-10-14T09:17:26.058518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:23.681006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149034+0000","last_change":"2023-10-14T09:17:25.072227+0000","last_active":"2023-10-14T09:17:26.149034+0000","last_peered":"2023-10-14T09:17:26.149034+0000","last_clean":"2023-10-14T09:17:26.149034+0000","last_became_active":"2023-10-14T09:17:25.071942+0000","last_became_peered":"2023-10-14T09:17:25.071942+0000","last_unstale":"2023-10-14T09:17:26.149034+0000","last_undegraded":"2023-10-14T09:17:26.149034+0000","last_fullsized":"2023-10-14T09:17:26.149034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:08.387279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148853+0000","last_change":"2023-10-14T09:17:25.086013+0000","last_active":"2023-10-14T09:17:26.148853+0000","last_peered":"2023-10-14T09:17:26.148853+0000","last_clean":"2023-10-14T09:17:26.148853+0000","last_became_active":"2023-10-14T09:17:25.085027+0000","last_became_peered":"2023-10-14T09:17:25.085027+0000","last_unstale":"2023-10-14T09:17:26.148853+0000","last_undegraded":"2023-10-14T09:17:26.148853+0000","last_fullsized":"2023-10-14T09:17:26.148853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:18.616879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146990+0000","last_change":"2023-10-14T09:17:25.076399+0000","last_active":"2023-10-14T09:17:26.146990+0000","last_peered":"2023-10-14T09:17:26.146990+0000","last_clean":"2023-10-14T09:17:26.146990+0000","last_became_active":"2023-10-14T09:17:25.076035+0000","last_became_peered":"2023-10-14T09:17:25.076035+0000","last_unstale":"2023-10-14T09:17:26.146990+0000","last_undegraded":"2023-10-14T09:17:26.146990+0000","last_fullsized":"2023-10-14T09:17:26.146990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148535+0000","last_change":"2023-10-14T09:17:25.073762+0000","last_active":"2023-10-14T09:17:26.148535+0000","last_peered":"2023-10-14T09:17:26.148535+0000","last_clean":"2023-10-14T09:17:26.148535+0000","last_became_active":"2023-10-14T09:17:25.073517+0000","last_became_peered":"2023-10-14T09:17:25.073517+0000","last_unstale":"2023-10-14T09:17:26.148535+0000","last_undegraded":"2023-10-14T09:17:26.148535+0000","last_fullsized":"2023-10-14T09:17:26.148535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:54.504717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057667+0000","last_change":"2023-10-14T09:17:25.085256+0000","last_active":"2023-10-14T09:17:26.057667+0000","last_peered":"2023-10-14T09:17:26.057667+0000","last_clean":"2023-10-14T09:17:26.057667+0000","last_became_active":"2023-10-14T09:17:25.077345+0000","last_became_peered":"2023-10-14T09:17:25.077345+0000","last_unstale":"2023-10-14T09:17:26.057667+0000","last_undegraded":"2023-10-14T09:17:26.057667+0000","last_fullsized":"2023-10-14T09:17:26.057667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148088+0000","last_change":"2023-10-14T09:17:25.069064+0000","last_active":"2023-10-14T09:17:26.148088+0000","last_peered":"2023-10-14T09:17:26.148088+0000","last_clean":"2023-10-14T09:17:26.148088+0000","last_became_active":"2023-10-14T09:17:25.068801+0000","last_became_peered":"2023-10-14T09:17:25.068801+0000","last_unstale":"2023-10-14T09:17:26.148088+0000","last_undegraded":"2023-10-14T09:17:26.148088+0000","last_fullsized":"2023-10-14T09:17:26.148088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057463+0000","last_change":"2023-10-14T09:17:25.069195+0000","last_active":"2023-10-14T09:17:26.057463+0000","last_peered":"2023-10-14T09:17:26.057463+0000","last_clean":"2023-10-14T09:17:26.057463+0000","last_became_active":"2023-10-14T09:17:25.068765+0000","last_became_peered":"2023-10-14T09:17:25.068765+0000","last_unstale":"2023-10-14T09:17:26.057463+0000","last_undegraded":"2023-10-14T09:17:26.057463+0000","last_fullsized":"2023-10-14T09:17:26.057463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149566+0000","last_change":"2023-10-14T09:17:25.082506+0000","last_active":"2023-10-14T09:17:26.149566+0000","last_peered":"2023-10-14T09:17:26.149566+0000","last_clean":"2023-10-14T09:17:26.149566+0000","last_became_active":"2023-10-14T09:17:25.082192+0000","last_became_peered":"2023-10-14T09:17:25.082192+0000","last_unstale":"2023-10-14T09:17:26.149566+0000","last_undegraded":"2023-10-14T09:17:26.149566+0000","last_fullsized":"2023-10-14T09:17:26.149566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:18.737255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147790+0000","last_change":"2023-10-14T09:17:25.076265+0000","last_active":"2023-10-14T09:17:26.147790+0000","last_peered":"2023-10-14T09:17:26.147790+0000","last_clean":"2023-10-14T09:17:26.147790+0000","last_became_active":"2023-10-14T09:17:25.075674+0000","last_became_peered":"2023-10-14T09:17:25.075674+0000","last_unstale":"2023-10-14T09:17:26.147790+0000","last_undegraded":"2023-10-14T09:17:26.147790+0000","last_fullsized":"2023-10-14T09:17:26.147790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057548+0000","last_change":"2023-10-14T09:17:25.070067+0000","last_active":"2023-10-14T09:17:26.057548+0000","last_peered":"2023-10-14T09:17:26.057548+0000","last_clean":"2023-10-14T09:17:26.057548+0000","last_became_active":"2023-10-14T09:17:25.069770+0000","last_became_peered":"2023-10-14T09:17:25.069770+0000","last_unstale":"2023-10-14T09:17:26.057548+0000","last_undegraded":"2023-10-14T09:17:26.057548+0000","last_fullsized":"2023-10-14T09:17:26.057548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149613+0000","last_change":"2023-10-14T09:17:25.082595+0000","last_active":"2023-10-14T09:17:26.149613+0000","last_peered":"2023-10-14T09:17:26.149613+0000","last_clean":"2023-10-14T09:17:26.149613+0000","last_became_active":"2023-10-14T09:17:25.082221+0000","last_became_peered":"2023-10-14T09:17:25.082221+0000","last_unstale":"2023-10-14T09:17:26.149613+0000","last_undegraded":"2023-10-14T09:17:26.149613+0000","last_fullsized":"2023-10-14T09:17:26.149613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148653+0000","last_change":"2023-10-14T09:17:25.074917+0000","last_active":"2023-10-14T09:17:26.148653+0000","last_peered":"2023-10-14T09:17:26.148653+0000","last_clean":"2023-10-14T09:17:26.148653+0000","last_became_active":"2023-10-14T09:17:25.074673+0000","last_became_peered":"2023-10-14T09:17:25.074673+0000","last_unstale":"2023-10-14T09:17:26.148653+0000","last_undegraded":"2023-10-14T09:17:26.148653+0000","last_fullsized":"2023-10-14T09:17:26.148653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057745+0000","last_change":"2023-10-14T09:17:25.070234+0000","last_active":"2023-10-14T09:17:26.057745+0000","last_peered":"2023-10-14T09:17:26.057745+0000","last_clean":"2023-10-14T09:17:26.057745+0000","last_became_active":"2023-10-14T09:17:25.069862+0000","last_became_peered":"2023-10-14T09:17:25.069862+0000","last_unstale":"2023-10-14T09:17:26.057745+0000","last_undegraded":"2023-10-14T09:17:26.057745+0000","last_fullsized":"2023-10-14T09:17:26.057745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:07:20.562556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148580+0000","last_change":"2023-10-14T09:17:25.067057+0000","last_active":"2023-10-14T09:17:26.148580+0000","last_peered":"2023-10-14T09:17:26.148580+0000","last_clean":"2023-10-14T09:17:26.148580+0000","last_became_active":"2023-10-14T09:17:25.066506+0000","last_became_peered":"2023-10-14T09:17:25.066506+0000","last_unstale":"2023-10-14T09:17:26.148580+0000","last_undegraded":"2023-10-14T09:17:26.148580+0000","last_fullsized":"2023-10-14T09:17:26.148580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:26.084905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146872+0000","last_change":"2023-10-14T09:17:25.071224+0000","last_active":"2023-10-14T09:17:26.146872+0000","last_peered":"2023-10-14T09:17:26.146872+0000","last_clean":"2023-10-14T09:17:26.146872+0000","last_became_active":"2023-10-14T09:17:25.070538+0000","last_became_peered":"2023-10-14T09:17:25.070538+0000","last_unstale":"2023-10-14T09:17:26.146872+0000","last_undegraded":"2023-10-14T09:17:26.146872+0000","last_fullsized":"2023-10-14T09:17:26.146872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:34.649737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.056842+0000","last_change":"2023-10-14T09:17:25.060731+0000","last_active":"2023-10-14T09:17:26.056842+0000","last_peered":"2023-10-14T09:17:26.056842+0000","last_clean":"2023-10-14T09:17:26.056842+0000","last_became_active":"2023-10-14T09:17:25.060361+0000","last_became_peered":"2023-10-14T09:17:25.060361+0000","last_unstale":"2023-10-14T09:17:26.056842+0000","last_undegraded":"2023-10-14T09:17:26.056842+0000","last_fullsized":"2023-10-14T09:17:26.056842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:58.882094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149507+0000","last_change":"2023-10-14T09:17:24.647223+0000","last_active":"2023-10-14T09:17:26.149507+0000","last_peered":"2023-10-14T09:17:26.149507+0000","last_clean":"2023-10-14T09:17:26.149507+0000","last_became_active":"2023-10-14T09:17:24.646910+0000","last_became_peered":"2023-10-14T09:17:24.646910+0000","last_unstale":"2023-10-14T09:17:26.149507+0000","last_undegraded":"2023-10-14T09:17:26.149507+0000","last_fullsized":"2023-10-14T09:17:26.149507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:43.349047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148773+0000","last_change":"2023-10-14T09:17:25.072654+0000","last_active":"2023-10-14T09:17:26.148773+0000","last_peered":"2023-10-14T09:17:26.148773+0000","last_clean":"2023-10-14T09:17:26.148773+0000","last_became_active":"2023-10-14T09:17:25.072361+0000","last_became_peered":"2023-10-14T09:17:25.072361+0000","last_unstale":"2023-10-14T09:17:26.148773+0000","last_undegraded":"2023-10-14T09:17:26.148773+0000","last_fullsized":"2023-10-14T09:17:26.148773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147198+0000","last_change":"2023-10-14T09:17:24.651708+0000","last_active":"2023-10-14T09:17:26.147198+0000","last_peered":"2023-10-14T09:17:26.147198+0000","last_clean":"2023-10-14T09:17:26.147198+0000","last_became_active":"2023-10-14T09:17:24.651461+0000","last_became_peered":"2023-10-14T09:17:24.651461+0000","last_unstale":"2023-10-14T09:17:26.147198+0000","last_undegraded":"2023-10-14T09:17:26.147198+0000","last_fullsized":"2023-10-14T09:17:26.147198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148228+0000","last_change":"2023-10-14T09:17:24.660053+0000","last_active":"2023-10-14T09:17:26.148228+0000","last_peered":"2023-10-14T09:17:26.148228+0000","last_clean":"2023-10-14T09:17:26.148228+0000","last_became_active":"2023-10-14T09:17:24.659722+0000","last_became_peered":"2023-10-14T09:17:24.659722+0000","last_unstale":"2023-10-14T09:17:26.148228+0000","last_undegraded":"2023-10-14T09:17:26.148228+0000","last_fullsized":"2023-10-14T09:17:26.148228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148174+0000","last_change":"2023-10-14T09:17:25.070599+0000","last_active":"2023-10-14T09:17:26.148174+0000","last_peered":"2023-10-14T09:17:26.148174+0000","last_clean":"2023-10-14T09:17:26.148174+0000","last_became_active":"2023-10-14T09:17:25.070202+0000","last_became_peered":"2023-10-14T09:17:25.070202+0000","last_unstale":"2023-10-14T09:17:26.148174+0000","last_undegraded":"2023-10-14T09:17:26.148174+0000","last_fullsized":"2023-10-14T09:17:26.148174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057470+0000","last_change":"2023-10-14T09:17:24.636532+0000","last_active":"2023-10-14T09:17:26.057470+0000","last_peered":"2023-10-14T09:17:26.057470+0000","last_clean":"2023-10-14T09:17:26.057470+0000","last_became_active":"2023-10-14T09:17:24.636180+0000","last_became_peered":"2023-10-14T09:17:24.636180+0000","last_unstale":"2023-10-14T09:17:26.057470+0000","last_undegraded":"2023-10-14T09:17:26.057470+0000","last_fullsized":"2023-10-14T09:17:26.057470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:25.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057394+0000","last_change":"2023-10-14T09:17:25.069990+0000","last_active":"2023-10-14T09:17:26.057394+0000","last_peered":"2023-10-14T09:17:26.057394+0000","last_clean":"2023-10-14T09:17:26.057394+0000","last_became_active":"2023-10-14T09:17:25.069733+0000","last_became_peered":"2023-10-14T09:17:25.069733+0000","last_unstale":"2023-10-14T09:17:26.057394+0000","last_undegraded":"2023-10-14T09:17:26.057394+0000","last_fullsized":"2023-10-14T09:17:26.057394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147600+0000","last_change":"2023-10-14T09:17:24.658971+0000","last_active":"2023-10-14T09:17:26.147600+0000","last_peered":"2023-10-14T09:17:26.147600+0000","last_clean":"2023-10-14T09:17:26.147600+0000","last_became_active":"2023-10-14T09:17:24.658454+0000","last_became_peered":"2023-10-14T09:17:24.658454+0000","last_unstale":"2023-10-14T09:17:26.147600+0000","last_undegraded":"2023-10-14T09:17:26.147600+0000","last_fullsized":"2023-10-14T09:17:26.147600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058246+0000","last_change":"2023-10-14T09:17:25.073538+0000","last_active":"2023-10-14T09:17:26.058246+0000","last_peered":"2023-10-14T09:17:26.058246+0000","last_clean":"2023-10-14T09:17:26.058246+0000","last_became_active":"2023-10-14T09:17:25.073196+0000","last_became_peered":"2023-10-14T09:17:25.073196+0000","last_unstale":"2023-10-14T09:17:26.058246+0000","last_undegraded":"2023-10-14T09:17:26.058246+0000","last_fullsized":"2023-10-14T09:17:26.058246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:57.142103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058171+0000","last_change":"2023-10-14T09:17:24.656283+0000","last_active":"2023-10-14T09:17:26.058171+0000","last_peered":"2023-10-14T09:17:26.058171+0000","last_clean":"2023-10-14T09:17:26.058171+0000","last_became_active":"2023-10-14T09:17:24.655902+0000","last_became_peered":"2023-10-14T09:17:24.655902+0000","last_unstale":"2023-10-14T09:17:26.058171+0000","last_undegraded":"2023-10-14T09:17:26.058171+0000","last_fullsized":"2023-10-14T09:17:26.058171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:56.797191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149035+0000","last_change":"2023-10-14T09:17:25.074931+0000","last_active":"2023-10-14T09:17:26.149035+0000","last_peered":"2023-10-14T09:17:26.149035+0000","last_clean":"2023-10-14T09:17:26.149035+0000","last_became_active":"2023-10-14T09:17:25.074606+0000","last_became_peered":"2023-10-14T09:17:25.074606+0000","last_unstale":"2023-10-14T09:17:26.149035+0000","last_undegraded":"2023-10-14T09:17:26.149035+0000","last_fullsized":"2023-10-14T09:17:26.149035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057641+0000","last_change":"2023-10-14T09:17:24.660850+0000","last_active":"2023-10-14T09:17:26.057641+0000","last_peered":"2023-10-14T09:17:26.057641+0000","last_clean":"2023-10-14T09:17:26.057641+0000","last_became_active":"2023-10-14T09:17:24.660566+0000","last_became_peered":"2023-10-14T09:17:24.660566+0000","last_unstale":"2023-10-14T09:17:26.057641+0000","last_undegraded":"2023-10-14T09:17:26.057641+0000","last_fullsized":"2023-10-14T09:17:26.057641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:55.254926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057347+0000","last_change":"2023-10-14T09:17:25.084623+0000","last_active":"2023-10-14T09:17:26.057347+0000","last_peered":"2023-10-14T09:17:26.057347+0000","last_clean":"2023-10-14T09:17:26.057347+0000","last_became_active":"2023-10-14T09:17:25.083870+0000","last_became_peered":"2023-10-14T09:17:25.083870+0000","last_unstale":"2023-10-14T09:17:26.057347+0000","last_undegraded":"2023-10-14T09:17:26.057347+0000","last_fullsized":"2023-10-14T09:17:26.057347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:56.260635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147002+0000","last_change":"2023-10-14T09:17:24.655371+0000","last_active":"2023-10-14T09:17:26.147002+0000","last_peered":"2023-10-14T09:17:26.147002+0000","last_clean":"2023-10-14T09:17:26.147002+0000","last_became_active":"2023-10-14T09:17:24.654821+0000","last_became_peered":"2023-10-14T09:17:24.654821+0000","last_unstale":"2023-10-14T09:17:26.147002+0000","last_undegraded":"2023-10-14T09:17:26.147002+0000","last_fullsized":"2023-10-14T09:17:26.147002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147299+0000","last_change":"2023-10-14T09:17:25.073958+0000","last_active":"2023-10-14T09:17:26.147299+0000","last_peered":"2023-10-14T09:17:26.147299+0000","last_clean":"2023-10-14T09:17:26.147299+0000","last_became_active":"2023-10-14T09:17:25.073630+0000","last_became_peered":"2023-10-14T09:17:25.073630+0000","last_unstale":"2023-10-14T09:17:26.147299+0000","last_undegraded":"2023-10-14T09:17:26.147299+0000","last_fullsized":"2023-10-14T09:17:26.147299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148859+0000","last_change":"2023-10-14T09:17:24.647614+0000","last_active":"2023-10-14T09:17:26.148859+0000","last_peered":"2023-10-14T09:17:26.148859+0000","last_clean":"2023-10-14T09:17:26.148859+0000","last_became_active":"2023-10-14T09:17:24.647181+0000","last_became_peered":"2023-10-14T09:17:24.647181+0000","last_unstale":"2023-10-14T09:17:26.148859+0000","last_undegraded":"2023-10-14T09:17:26.148859+0000","last_fullsized":"2023-10-14T09:17:26.148859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148784+0000","last_change":"2023-10-14T09:17:25.074213+0000","last_active":"2023-10-14T09:17:26.148784+0000","last_peered":"2023-10-14T09:17:26.148784+0000","last_clean":"2023-10-14T09:17:26.148784+0000","last_became_active":"2023-10-14T09:17:25.073939+0000","last_became_peered":"2023-10-14T09:17:25.073939+0000","last_unstale":"2023-10-14T09:17:26.148784+0000","last_undegraded":"2023-10-14T09:17:26.148784+0000","last_fullsized":"2023-10-14T09:17:26.148784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057774+0000","last_change":"2023-10-14T09:17:24.650224+0000","last_active":"2023-10-14T09:17:26.057774+0000","last_peered":"2023-10-14T09:17:26.057774+0000","last_clean":"2023-10-14T09:17:26.057774+0000","last_became_active":"2023-10-14T09:17:24.649874+0000","last_became_peered":"2023-10-14T09:17:24.649874+0000","last_unstale":"2023-10-14T09:17:26.057774+0000","last_undegraded":"2023-10-14T09:17:26.057774+0000","last_fullsized":"2023-10-14T09:17:26.057774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:39.459526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147326+0000","last_change":"2023-10-14T09:17:25.087021+0000","last_active":"2023-10-14T09:17:26.147326+0000","last_peered":"2023-10-14T09:17:26.147326+0000","last_clean":"2023-10-14T09:17:26.147326+0000","last_became_active":"2023-10-14T09:17:25.085886+0000","last_became_peered":"2023-10-14T09:17:25.085886+0000","last_unstale":"2023-10-14T09:17:26.147326+0000","last_undegraded":"2023-10-14T09:17:26.147326+0000","last_fullsized":"2023-10-14T09:17:26.147326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:57.270296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.146875+0000","last_change":"2023-10-14T09:17:24.656925+0000","last_active":"2023-10-14T09:17:26.146875+0000","last_peered":"2023-10-14T09:17:26.146875+0000","last_clean":"2023-10-14T09:17:26.146875+0000","last_became_active":"2023-10-14T09:17:24.656662+0000","last_became_peered":"2023-10-14T09:17:24.656662+0000","last_unstale":"2023-10-14T09:17:26.146875+0000","last_undegraded":"2023-10-14T09:17:26.146875+0000","last_fullsized":"2023-10-14T09:17:26.146875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:25.079197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147060+0000","last_change":"2023-10-14T09:17:25.071484+0000","last_active":"2023-10-14T09:17:26.147060+0000","last_peered":"2023-10-14T09:17:26.147060+0000","last_clean":"2023-10-14T09:17:26.147060+0000","last_became_active":"2023-10-14T09:17:25.070874+0000","last_became_peered":"2023-10-14T09:17:25.070874+0000","last_unstale":"2023-10-14T09:17:26.147060+0000","last_undegraded":"2023-10-14T09:17:26.147060+0000","last_fullsized":"2023-10-14T09:17:26.147060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:49.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147921+0000","last_change":"2023-10-14T09:17:24.650705+0000","last_active":"2023-10-14T09:17:26.147921+0000","last_peered":"2023-10-14T09:17:26.147921+0000","last_clean":"2023-10-14T09:17:26.147921+0000","last_became_active":"2023-10-14T09:17:24.650339+0000","last_became_peered":"2023-10-14T09:17:24.650339+0000","last_unstale":"2023-10-14T09:17:26.147921+0000","last_undegraded":"2023-10-14T09:17:26.147921+0000","last_fullsized":"2023-10-14T09:17:26.147921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:01.491312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147488+0000","last_change":"2023-10-14T09:17:25.086229+0000","last_active":"2023-10-14T09:17:26.147488+0000","last_peered":"2023-10-14T09:17:26.147488+0000","last_clean":"2023-10-14T09:17:26.147488+0000","last_became_active":"2023-10-14T09:17:25.085568+0000","last_became_peered":"2023-10-14T09:17:25.085568+0000","last_unstale":"2023-10-14T09:17:26.147488+0000","last_undegraded":"2023-10-14T09:17:26.147488+0000","last_fullsized":"2023-10-14T09:17:26.147488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:08.172052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057268+0000","last_change":"2023-10-14T09:17:24.651869+0000","last_active":"2023-10-14T09:17:26.057268+0000","last_peered":"2023-10-14T09:17:26.057268+0000","last_clean":"2023-10-14T09:17:26.057268+0000","last_became_active":"2023-10-14T09:17:24.651545+0000","last_became_peered":"2023-10-14T09:17:24.651545+0000","last_unstale":"2023-10-14T09:17:26.057268+0000","last_undegraded":"2023-10-14T09:17:26.057268+0000","last_fullsized":"2023-10-14T09:17:26.057268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:01.491312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147728+0000","last_change":"2023-10-14T09:17:25.086054+0000","last_active":"2023-10-14T09:17:26.147728+0000","last_peered":"2023-10-14T09:17:26.147728+0000","last_clean":"2023-10-14T09:17:26.147728+0000","last_became_active":"2023-10-14T09:17:25.085704+0000","last_became_peered":"2023-10-14T09:17:25.085704+0000","last_unstale":"2023-10-14T09:17:26.147728+0000","last_undegraded":"2023-10-14T09:17:26.147728+0000","last_fullsized":"2023-10-14T09:17:26.147728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:10:13.523277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148998+0000","last_change":"2023-10-14T09:17:24.647549+0000","last_active":"2023-10-14T09:17:26.148998+0000","last_peered":"2023-10-14T09:17:26.148998+0000","last_clean":"2023-10-14T09:17:26.148998+0000","last_became_active":"2023-10-14T09:17:24.645321+0000","last_became_peered":"2023-10-14T09:17:24.645321+0000","last_unstale":"2023-10-14T09:17:26.148998+0000","last_undegraded":"2023-10-14T09:17:26.148998+0000","last_fullsized":"2023-10-14T09:17:26.148998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:55.254926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147428+0000","last_change":"2023-10-14T09:17:25.086522+0000","last_active":"2023-10-14T09:17:26.147428+0000","last_peered":"2023-10-14T09:17:26.147428+0000","last_clean":"2023-10-14T09:17:26.147428+0000","last_became_active":"2023-10-14T09:17:25.086192+0000","last_became_peered":"2023-10-14T09:17:25.086192+0000","last_unstale":"2023-10-14T09:17:26.147428+0000","last_undegraded":"2023-10-14T09:17:26.147428+0000","last_fullsized":"2023-10-14T09:17:26.147428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:57:57.142103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057720+0000","last_change":"2023-10-14T09:17:24.654486+0000","last_active":"2023-10-14T09:17:26.057720+0000","last_peered":"2023-10-14T09:17:26.057720+0000","last_clean":"2023-10-14T09:17:26.057720+0000","last_became_active":"2023-10-14T09:17:24.652694+0000","last_became_peered":"2023-10-14T09:17:24.652694+0000","last_unstale":"2023-10-14T09:17:26.057720+0000","last_undegraded":"2023-10-14T09:17:26.057720+0000","last_fullsized":"2023-10-14T09:17:26.057720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058138+0000","last_change":"2023-10-14T09:17:25.067993+0000","last_active":"2023-10-14T09:17:26.058138+0000","last_peered":"2023-10-14T09:17:26.058138+0000","last_clean":"2023-10-14T09:17:26.058138+0000","last_became_active":"2023-10-14T09:17:25.067671+0000","last_became_peered":"2023-10-14T09:17:25.067671+0000","last_unstale":"2023-10-14T09:17:26.058138+0000","last_undegraded":"2023-10-14T09:17:26.058138+0000","last_fullsized":"2023-10-14T09:17:26.058138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:26.745591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148710+0000","last_change":"2023-10-14T09:17:24.638946+0000","last_active":"2023-10-14T09:17:26.148710+0000","last_peered":"2023-10-14T09:17:26.148710+0000","last_clean":"2023-10-14T09:17:26.148710+0000","last_became_active":"2023-10-14T09:17:24.638655+0000","last_became_peered":"2023-10-14T09:17:24.638655+0000","last_unstale":"2023-10-14T09:17:26.148710+0000","last_undegraded":"2023-10-14T09:17:26.148710+0000","last_fullsized":"2023-10-14T09:17:26.148710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:00.618802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147399+0000","last_change":"2023-10-14T09:17:25.084705+0000","last_active":"2023-10-14T09:17:26.147399+0000","last_peered":"2023-10-14T09:17:26.147399+0000","last_clean":"2023-10-14T09:17:26.147399+0000","last_became_active":"2023-10-14T09:17:25.084208+0000","last_became_peered":"2023-10-14T09:17:25.084208+0000","last_unstale":"2023-10-14T09:17:26.147399+0000","last_undegraded":"2023-10-14T09:17:26.147399+0000","last_fullsized":"2023-10-14T09:17:26.147399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:52.745681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T09:17:25.064563+0000","last_change":"2023-10-14T09:17:14.304224+0000","last_active":"2023-10-14T09:17:25.064563+0000","last_peered":"2023-10-14T09:17:25.064563+0000","last_clean":"2023-10-14T09:17:25.064563+0000","last_became_active":"2023-10-14T09:17:14.303743+0000","last_became_peered":"2023-10-14T09:17:14.303743+0000","last_unstale":"2023-10-14T09:17:25.064563+0000","last_undegraded":"2023-10-14T09:17:25.064563+0000","last_fullsized":"2023-10-14T09:17:25.064563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_clean_scrub_stamp":"2023-10-14T09:17:13.285641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:24.100243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057432+0000","last_change":"2023-10-14T09:17:24.646906+0000","last_active":"2023-10-14T09:17:26.057432+0000","last_peered":"2023-10-14T09:17:26.057432+0000","last_clean":"2023-10-14T09:17:26.057432+0000","last_became_active":"2023-10-14T09:17:24.646536+0000","last_became_peered":"2023-10-14T09:17:24.646536+0000","last_unstale":"2023-10-14T09:17:26.057432+0000","last_undegraded":"2023-10-14T09:17:26.057432+0000","last_fullsized":"2023-10-14T09:17:26.057432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:07.381571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149345+0000","last_change":"2023-10-14T09:17:25.065358+0000","last_active":"2023-10-14T09:17:26.149345+0000","last_peered":"2023-10-14T09:17:26.149345+0000","last_clean":"2023-10-14T09:17:26.149345+0000","last_became_active":"2023-10-14T09:17:25.065048+0000","last_became_peered":"2023-10-14T09:17:25.065048+0000","last_unstale":"2023-10-14T09:17:26.149345+0000","last_undegraded":"2023-10-14T09:17:26.149345+0000","last_fullsized":"2023-10-14T09:17:26.149345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:07.699759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147353+0000","last_change":"2023-10-14T09:17:24.663937+0000","last_active":"2023-10-14T09:17:26.147353+0000","last_peered":"2023-10-14T09:17:26.147353+0000","last_clean":"2023-10-14T09:17:26.147353+0000","last_became_active":"2023-10-14T09:17:24.663420+0000","last_became_peered":"2023-10-14T09:17:24.663420+0000","last_unstale":"2023-10-14T09:17:26.147353+0000","last_undegraded":"2023-10-14T09:17:26.147353+0000","last_fullsized":"2023-10-14T09:17:26.147353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148230+0000","last_change":"2023-10-14T09:17:25.079632+0000","last_active":"2023-10-14T09:17:26.148230+0000","last_peered":"2023-10-14T09:17:26.148230+0000","last_clean":"2023-10-14T09:17:26.148230+0000","last_became_active":"2023-10-14T09:17:25.079358+0000","last_became_peered":"2023-10-14T09:17:25.079358+0000","last_unstale":"2023-10-14T09:17:26.148230+0000","last_undegraded":"2023-10-14T09:17:26.148230+0000","last_fullsized":"2023-10-14T09:17:26.148230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:03.207187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148663+0000","last_change":"2023-10-14T09:17:24.646437+0000","last_active":"2023-10-14T09:17:26.148663+0000","last_peered":"2023-10-14T09:17:26.148663+0000","last_clean":"2023-10-14T09:17:26.148663+0000","last_became_active":"2023-10-14T09:17:24.645079+0000","last_became_peered":"2023-10-14T09:17:24.645079+0000","last_unstale":"2023-10-14T09:17:26.148663+0000","last_undegraded":"2023-10-14T09:17:26.148663+0000","last_fullsized":"2023-10-14T09:17:26.148663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:57.876385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057579+0000","last_change":"2023-10-14T09:17:25.057184+0000","last_active":"2023-10-14T09:17:26.057579+0000","last_peered":"2023-10-14T09:17:26.057579+0000","last_clean":"2023-10-14T09:17:26.057579+0000","last_became_active":"2023-10-14T09:17:25.056927+0000","last_became_peered":"2023-10-14T09:17:25.056927+0000","last_unstale":"2023-10-14T09:17:26.057579+0000","last_undegraded":"2023-10-14T09:17:26.057579+0000","last_fullsized":"2023-10-14T09:17:26.057579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057868+0000","last_change":"2023-10-14T09:17:24.654452+0000","last_active":"2023-10-14T09:17:26.057868+0000","last_peered":"2023-10-14T09:17:26.057868+0000","last_clean":"2023-10-14T09:17:26.057868+0000","last_became_active":"2023-10-14T09:17:24.654123+0000","last_became_peered":"2023-10-14T09:17:24.654123+0000","last_unstale":"2023-10-14T09:17:26.057868+0000","last_undegraded":"2023-10-14T09:17:26.057868+0000","last_fullsized":"2023-10-14T09:17:26.057868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:58:06.694051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057462+0000","last_change":"2023-10-14T09:17:25.065503+0000","last_active":"2023-10-14T09:17:26.057462+0000","last_peered":"2023-10-14T09:17:26.057462+0000","last_clean":"2023-10-14T09:17:26.057462+0000","last_became_active":"2023-10-14T09:17:25.065201+0000","last_became_peered":"2023-10-14T09:17:25.065201+0000","last_unstale":"2023-10-14T09:17:26.057462+0000","last_undegraded":"2023-10-14T09:17:26.057462+0000","last_fullsized":"2023-10-14T09:17:26.057462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:08.387279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057636+0000","last_change":"2023-10-14T09:17:24.654216+0000","last_active":"2023-10-14T09:17:26.057636+0000","last_peered":"2023-10-14T09:17:26.057636+0000","last_clean":"2023-10-14T09:17:26.057636+0000","last_became_active":"2023-10-14T09:17:24.653646+0000","last_became_peered":"2023-10-14T09:17:24.653646+0000","last_unstale":"2023-10-14T09:17:26.057636+0000","last_undegraded":"2023-10-14T09:17:26.057636+0000","last_fullsized":"2023-10-14T09:17:26.057636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057990+0000","last_change":"2023-10-14T09:17:25.072986+0000","last_active":"2023-10-14T09:17:26.057990+0000","last_peered":"2023-10-14T09:17:26.057990+0000","last_clean":"2023-10-14T09:17:26.057990+0000","last_became_active":"2023-10-14T09:17:25.072730+0000","last_became_peered":"2023-10-14T09:17:25.072730+0000","last_unstale":"2023-10-14T09:17:26.057990+0000","last_undegraded":"2023-10-14T09:17:26.057990+0000","last_fullsized":"2023-10-14T09:17:26.057990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:57.270296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147812+0000","last_change":"2023-10-14T09:17:24.663546+0000","last_active":"2023-10-14T09:17:26.147812+0000","last_peered":"2023-10-14T09:17:26.147812+0000","last_clean":"2023-10-14T09:17:26.147812+0000","last_became_active":"2023-10-14T09:17:24.663199+0000","last_became_peered":"2023-10-14T09:17:24.663199+0000","last_unstale":"2023-10-14T09:17:26.147812+0000","last_undegraded":"2023-10-14T09:17:26.147812+0000","last_fullsized":"2023-10-14T09:17:26.147812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:48.194426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057548+0000","last_change":"2023-10-14T09:17:25.061842+0000","last_active":"2023-10-14T09:17:26.057548+0000","last_peered":"2023-10-14T09:17:26.057548+0000","last_clean":"2023-10-14T09:17:26.057548+0000","last_became_active":"2023-10-14T09:17:25.061587+0000","last_became_peered":"2023-10-14T09:17:25.061587+0000","last_unstale":"2023-10-14T09:17:26.057548+0000","last_undegraded":"2023-10-14T09:17:26.057548+0000","last_fullsized":"2023-10-14T09:17:26.057548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:27.250002+0000","last_change":"2023-10-14T09:17:24.657107+0000","last_active":"2023-10-14T09:17:27.250002+0000","last_peered":"2023-10-14T09:17:27.250002+0000","last_clean":"2023-10-14T09:17:27.250002+0000","last_became_active":"2023-10-14T09:17:24.656772+0000","last_became_peered":"2023-10-14T09:17:24.656772+0000","last_unstale":"2023-10-14T09:17:27.250002+0000","last_undegraded":"2023-10-14T09:17:27.250002+0000","last_fullsized":"2023-10-14T09:17:27.250002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:41:33.644028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149658+0000","last_change":"2023-10-14T09:17:25.077360+0000","last_active":"2023-10-14T09:17:26.149658+0000","last_peered":"2023-10-14T09:17:26.149658+0000","last_clean":"2023-10-14T09:17:26.149658+0000","last_became_active":"2023-10-14T09:17:25.076972+0000","last_became_peered":"2023-10-14T09:17:25.076972+0000","last_unstale":"2023-10-14T09:17:26.149658+0000","last_undegraded":"2023-10-14T09:17:26.149658+0000","last_fullsized":"2023-10-14T09:17:26.149658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:15.931010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147675+0000","last_change":"2023-10-14T09:17:24.650946+0000","last_active":"2023-10-14T09:17:26.147675+0000","last_peered":"2023-10-14T09:17:26.147675+0000","last_clean":"2023-10-14T09:17:26.147675+0000","last_became_active":"2023-10-14T09:17:24.650657+0000","last_became_peered":"2023-10-14T09:17:24.650657+0000","last_unstale":"2023-10-14T09:17:26.147675+0000","last_undegraded":"2023-10-14T09:17:26.147675+0000","last_fullsized":"2023-10-14T09:17:26.147675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:02.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148670+0000","last_change":"2023-10-14T09:17:25.065959+0000","last_active":"2023-10-14T09:17:26.148670+0000","last_peered":"2023-10-14T09:17:26.148670+0000","last_clean":"2023-10-14T09:17:26.148670+0000","last_became_active":"2023-10-14T09:17:25.065708+0000","last_became_peered":"2023-10-14T09:17:25.065708+0000","last_unstale":"2023-10-14T09:17:26.148670+0000","last_undegraded":"2023-10-14T09:17:26.148670+0000","last_fullsized":"2023-10-14T09:17:26.148670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:57.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147118+0000","last_change":"2023-10-14T09:17:24.663717+0000","last_active":"2023-10-14T09:17:26.147118+0000","last_peered":"2023-10-14T09:17:26.147118+0000","last_clean":"2023-10-14T09:17:26.147118+0000","last_became_active":"2023-10-14T09:17:24.663082+0000","last_became_peered":"2023-10-14T09:17:24.663082+0000","last_unstale":"2023-10-14T09:17:26.147118+0000","last_undegraded":"2023-10-14T09:17:26.147118+0000","last_fullsized":"2023-10-14T09:17:26.147118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057370+0000","last_change":"2023-10-14T09:17:25.062652+0000","last_active":"2023-10-14T09:17:26.057370+0000","last_peered":"2023-10-14T09:17:26.057370+0000","last_clean":"2023-10-14T09:17:26.057370+0000","last_became_active":"2023-10-14T09:17:25.062345+0000","last_became_peered":"2023-10-14T09:17:25.062345+0000","last_unstale":"2023-10-14T09:17:26.057370+0000","last_undegraded":"2023-10-14T09:17:26.057370+0000","last_fullsized":"2023-10-14T09:17:26.057370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:26.084905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057462+0000","last_change":"2023-10-14T09:17:24.655398+0000","last_active":"2023-10-14T09:17:26.057462+0000","last_peered":"2023-10-14T09:17:26.057462+0000","last_clean":"2023-10-14T09:17:26.057462+0000","last_became_active":"2023-10-14T09:17:24.654885+0000","last_became_peered":"2023-10-14T09:17:24.654885+0000","last_unstale":"2023-10-14T09:17:26.057462+0000","last_undegraded":"2023-10-14T09:17:26.057462+0000","last_fullsized":"2023-10-14T09:17:26.057462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:01:36.633759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148294+0000","last_change":"2023-10-14T09:17:25.063668+0000","last_active":"2023-10-14T09:17:26.148294+0000","last_peered":"2023-10-14T09:17:26.148294+0000","last_clean":"2023-10-14T09:17:26.148294+0000","last_became_active":"2023-10-14T09:17:25.063408+0000","last_became_peered":"2023-10-14T09:17:25.063408+0000","last_unstale":"2023-10-14T09:17:26.148294+0000","last_undegraded":"2023-10-14T09:17:26.148294+0000","last_fullsized":"2023-10-14T09:17:26.148294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.057694+0000","last_change":"2023-10-14T09:17:24.652502+0000","last_active":"2023-10-14T09:17:26.057694+0000","last_peered":"2023-10-14T09:17:26.057694+0000","last_clean":"2023-10-14T09:17:26.057694+0000","last_became_active":"2023-10-14T09:17:24.652222+0000","last_became_peered":"2023-10-14T09:17:24.652222+0000","last_unstale":"2023-10-14T09:17:26.057694+0000","last_undegraded":"2023-10-14T09:17:26.057694+0000","last_fullsized":"2023-10-14T09:17:26.057694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:52:57.876385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149500+0000","last_change":"2023-10-14T09:17:25.070505+0000","last_active":"2023-10-14T09:17:26.149500+0000","last_peered":"2023-10-14T09:17:26.149500+0000","last_clean":"2023-10-14T09:17:26.149500+0000","last_became_active":"2023-10-14T09:17:25.070227+0000","last_became_peered":"2023-10-14T09:17:25.070227+0000","last_unstale":"2023-10-14T09:17:26.149500+0000","last_undegraded":"2023-10-14T09:17:26.149500+0000","last_fullsized":"2023-10-14T09:17:26.149500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:53.323475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147529+0000","last_change":"2023-10-14T09:17:24.663767+0000","last_active":"2023-10-14T09:17:26.147529+0000","last_peered":"2023-10-14T09:17:26.147529+0000","last_clean":"2023-10-14T09:17:26.147529+0000","last_became_active":"2023-10-14T09:17:24.663287+0000","last_became_peered":"2023-10-14T09:17:24.663287+0000","last_unstale":"2023-10-14T09:17:26.147529+0000","last_undegraded":"2023-10-14T09:17:26.147529+0000","last_fullsized":"2023-10-14T09:17:26.147529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:46:52.317766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147098+0000","last_change":"2023-10-14T09:17:25.083037+0000","last_active":"2023-10-14T09:17:26.147098+0000","last_peered":"2023-10-14T09:17:26.147098+0000","last_clean":"2023-10-14T09:17:26.147098+0000","last_became_active":"2023-10-14T09:17:25.082685+0000","last_became_peered":"2023-10-14T09:17:25.082685+0000","last_unstale":"2023-10-14T09:17:26.147098+0000","last_undegraded":"2023-10-14T09:17:26.147098+0000","last_fullsized":"2023-10-14T09:17:26.147098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:40.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058036+0000","last_change":"2023-10-14T09:17:25.070513+0000","last_active":"2023-10-14T09:17:26.058036+0000","last_peered":"2023-10-14T09:17:26.058036+0000","last_clean":"2023-10-14T09:17:26.058036+0000","last_became_active":"2023-10-14T09:17:25.070206+0000","last_became_peered":"2023-10-14T09:17:25.070206+0000","last_unstale":"2023-10-14T09:17:26.058036+0000","last_undegraded":"2023-10-14T09:17:26.058036+0000","last_fullsized":"2023-10-14T09:17:26.058036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:52.745681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147258+0000","last_change":"2023-10-14T09:17:24.663588+0000","last_active":"2023-10-14T09:17:26.147258+0000","last_peered":"2023-10-14T09:17:26.147258+0000","last_clean":"2023-10-14T09:17:26.147258+0000","last_became_active":"2023-10-14T09:17:24.663275+0000","last_became_peered":"2023-10-14T09:17:24.663275+0000","last_unstale":"2023-10-14T09:17:26.147258+0000","last_undegraded":"2023-10-14T09:17:26.147258+0000","last_fullsized":"2023-10-14T09:17:26.147258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.058308+0000","last_change":"2023-10-14T09:17:25.081621+0000","last_active":"2023-10-14T09:17:26.058308+0000","last_peered":"2023-10-14T09:17:26.058308+0000","last_clean":"2023-10-14T09:17:26.058308+0000","last_became_active":"2023-10-14T09:17:25.081183+0000","last_became_peered":"2023-10-14T09:17:25.081183+0000","last_unstale":"2023-10-14T09:17:26.058308+0000","last_undegraded":"2023-10-14T09:17:26.058308+0000","last_fullsized":"2023-10-14T09:17:26.058308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:08.172052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.147404+0000","last_change":"2023-10-14T09:17:24.664054+0000","last_active":"2023-10-14T09:17:26.147404+0000","last_peered":"2023-10-14T09:17:26.147404+0000","last_clean":"2023-10-14T09:17:26.147404+0000","last_became_active":"2023-10-14T09:17:24.663750+0000","last_became_peered":"2023-10-14T09:17:24.663750+0000","last_unstale":"2023-10-14T09:17:26.147404+0000","last_undegraded":"2023-10-14T09:17:26.147404+0000","last_fullsized":"2023-10-14T09:17:26.147404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.148919+0000","last_change":"2023-10-14T09:17:25.079820+0000","last_active":"2023-10-14T09:17:26.148919+0000","last_peered":"2023-10-14T09:17:26.148919+0000","last_clean":"2023-10-14T09:17:26.148919+0000","last_became_active":"2023-10-14T09:17:25.079573+0000","last_became_peered":"2023-10-14T09:17:25.079573+0000","last_unstale":"2023-10-14T09:17:26.148919+0000","last_undegraded":"2023-10-14T09:17:26.148919+0000","last_fullsized":"2023-10-14T09:17:26.148919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:54:53.513913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149601+0000","last_change":"2023-10-14T09:17:24.652635+0000","last_active":"2023-10-14T09:17:26.149601+0000","last_peered":"2023-10-14T09:17:26.149601+0000","last_clean":"2023-10-14T09:17:26.149601+0000","last_became_active":"2023-10-14T09:17:24.652363+0000","last_became_peered":"2023-10-14T09:17:24.652363+0000","last_unstale":"2023-10-14T09:17:26.149601+0000","last_undegraded":"2023-10-14T09:17:26.149601+0000","last_fullsized":"2023-10-14T09:17:26.149601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:01:53.499008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149517+0000","last_change":"2023-10-14T09:17:25.078752+0000","last_active":"2023-10-14T09:17:26.149517+0000","last_peered":"2023-10-14T09:17:26.149517+0000","last_clean":"2023-10-14T09:17:26.149517+0000","last_became_active":"2023-10-14T09:17:25.078504+0000","last_became_peered":"2023-10-14T09:17:25.078504+0000","last_unstale":"2023-10-14T09:17:26.149517+0000","last_undegraded":"2023-10-14T09:17:26.149517+0000","last_fullsized":"2023-10-14T09:17:26.149517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:24.621571+0000","last_clean_scrub_stamp":"2023-10-14T09:17:24.621571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:17.087005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T09:17:26.149133+0000","last_change":"2023-10-14T09:17:24.651100+0000","last_active":"2023-10-14T09:17:26.149133+0000","last_peered":"2023-10-14T09:17:26.149133+0000","last_clean":"2023-10-14T09:17:26.149133+0000","last_became_active":"2023-10-14T09:17:24.650418+0000","last_became_peered":"2023-10-14T09:17:24.650418+0000","last_unstale":"2023-10-14T09:17:26.149133+0000","last_undegraded":"2023-10-14T09:17:26.149133+0000","last_fullsized":"2023-10-14T09:17:26.149133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:23.615862+0000","last_clean_scrub_stamp":"2023-10-14T09:17:23.615862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:13.802103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":661848,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5389999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4489999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4770000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5119999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":661904,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:17:36.446 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T09:17:36.446 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T09:17:36.447 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T09:17:36.447 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T09:17:36.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.617+0000 7f0ca7c32640 1 Processor -- start 2023-10-14T09:17:36.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.617+0000 7f0ca7c32640 1 -- start start 2023-10-14T09:17:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.617+0000 7f0ca7c32640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ca00c1260 0x7f0ca00c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.617+0000 7f0ca7c32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0ca01513a0 0x7f0ca00c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.617+0000 7f0ca7c32640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca0070760 con 0x7f0ca014a8f0 2023-10-14T09:17:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.617+0000 7f0ca7c32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00c1b20 con 0x7f0ca01513a0 2023-10-14T09:17:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.617+0000 7f0ca7c32640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0151810 con 0x7f0ca00c1260 2023-10-14T09:17:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.617+0000 7f0ca59ce640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0ca014a8f0 0x7f0ca0070050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34004/0 (socket says 172.21.15.78:34004) 2023-10-14T09:17:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.617+0000 7f0ca59ce640 1 -- 172.21.15.78:0/854732548 learned_addr learned my addr 172.21.15.78:0/854732548 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.617+0000 7f0ca61cf640 1 --2- 172.21.15.78:0/854732548 >> v2:172.21.15.78:3300/0 conn(0x7f0ca01513a0 0x7f0ca00c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca51cd640 1 --2- 172.21.15.78:0/854732548 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ca00c1260 0x7f0ca00c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 -- 172.21.15.78:0/854732548 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ca00c1260 msgr2=0x7f0ca00c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca49cc640 1 -- 172.21.15.78:0/854732548 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771180785 0 0) 0x7f0ca0070760 con 0x7f0ca014a8f0 2023-10-14T09:17:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 --2- 172.21.15.78:0/854732548 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ca00c1260 0x7f0ca00c07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 -- 172.21.15.78:0/854732548 >> v1:172.21.15.78:6789/0 conn(0x7f0ca014a8f0 legacy=0x7f0ca0070050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 -- 172.21.15.78:0/854732548 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca00c1840 con 0x7f0ca01513a0 2023-10-14T09:17:36.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 --2- 172.21.15.78:0/854732548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca01513a0 0x7f0ca00c51d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009d90 tx=0x7f0c9801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fa051df4e62aab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:36.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca49cc640 1 -- 172.21.15.78:0/854732548 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980a5780 con 0x7f0ca01513a0 2023-10-14T09:17:36.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca49cc640 1 -- 172.21.15.78:0/854732548 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c980a58e0 con 0x7f0ca01513a0 2023-10-14T09:17:36.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca49cc640 1 -- 172.21.15.78:0/854732548 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980a5c70 con 0x7f0ca01513a0 2023-10-14T09:17:36.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 -- 172.21.15.78:0/854732548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca01513a0 msgr2=0x7f0ca00c51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 --2- 172.21.15.78:0/854732548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca01513a0 0x7f0ca00c51d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009d90 tx=0x7f0c9801c8c0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 -- 172.21.15.78:0/854732548 shutdown_connections 2023-10-14T09:17:36.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 --2- 172.21.15.78:0/854732548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca01513a0 0x7f0ca00c51d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 --2- 172.21.15.78:0/854732548 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ca00c1260 0x7f0ca00c07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 -- 172.21.15.78:0/854732548 >> 172.21.15.78:0/854732548 conn(0x7f0ca0069e90 msgr2=0x7f0ca006a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:36.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 -- 172.21.15.78:0/854732548 shutdown_connections 2023-10-14T09:17:36.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 -- 172.21.15.78:0/854732548 wait complete. 2023-10-14T09:17:36.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 Processor -- start 2023-10-14T09:17:36.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 -- start start 2023-10-14T09:17:36.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ca00c1260 0x7f0ca01598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ca014a8f0 0x7f0ca01efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca01513a0 0x7f0ca01f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01f06d0 con 0x7f0ca01513a0 2023-10-14T09:17:36.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01ec190 con 0x7f0ca014a8f0 2023-10-14T09:17:36.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca7c32640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01ef700 con 0x7f0ca00c1260 2023-10-14T09:17:36.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca01513a0 0x7f0ca01f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca01513a0 0x7f0ca01f0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39622/0 (socket says 172.21.15.78:39622) 2023-10-14T09:17:36.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 -- 172.21.15.78:0/3315918963 learned_addr learned my addr 172.21.15.78:0/3315918963 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:36.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca51cd640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ca014a8f0 0x7f0ca01efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca59ce640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ca00c1260 0x7f0ca01598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 -- 172.21.15.78:0/3315918963 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ca00c1260 msgr2=0x7f0ca01598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ca00c1260 0x7f0ca01598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 -- 172.21.15.78:0/3315918963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ca014a8f0 msgr2=0x7f0ca01efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ca014a8f0 0x7f0ca01efc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.625+0000 7f0ca61cf640 1 -- 172.21.15.78:0/3315918963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c98009a70 con 0x7f0ca01513a0 2023-10-14T09:17:36.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0ca61cf640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca01513a0 0x7f0ca01f0190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0c980b0040 tx=0x7f0c98019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:36.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0c967fc640 1 -- 172.21.15.78:0/3315918963 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980ad640 con 0x7f0ca01513a0 2023-10-14T09:17:36.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0c967fc640 1 -- 172.21.15.78:0/3315918963 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c980ad7a0 con 0x7f0ca01513a0 2023-10-14T09:17:36.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0c967fc640 1 -- 172.21.15.78:0/3315918963 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980adb30 con 0x7f0ca01513a0 2023-10-14T09:17:36.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0ca7c32640 1 -- 172.21.15.78:0/3315918963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca014ae50 con 0x7f0ca01513a0 2023-10-14T09:17:36.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0ca7c32640 1 -- 172.21.15.78:0/3315918963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca014afe0 con 0x7f0ca01513a0 2023-10-14T09:17:36.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0ca7c32640 1 -- 172.21.15.78:0/3315918963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca01ec300 con 0x7f0ca01513a0 2023-10-14T09:17:36.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0c967fc640 1 -- 172.21.15.78:0/3315918963 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0c980b4050 con 0x7f0ca01513a0 2023-10-14T09:17:36.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0c967fc640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0c840664a0 0x7f0c84068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0c967fc640 1 -- 172.21.15.78:0/3315918963 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c9811eea0 con 0x7f0ca01513a0 2023-10-14T09:17:36.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0ca59ce640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0c840664a0 0x7f0c84068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.629+0000 7f0ca59ce640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0c840664a0 0x7f0c84068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c007fd0 tx=0x7f0c9c007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:36.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.637+0000 7f0c967fc640 1 -- 172.21.15.78:0/3315918963 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ca01ec300 con 0x7f0ca01513a0 2023-10-14T09:17:36.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.817+0000 7f0ca7c32640 1 -- 172.21.15.78:0/3315918963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0ca01ec300 con 0x7f0ca01513a0 2023-10-14T09:17:36.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.817+0000 7f0c967fc640 1 -- 172.21.15.78:0/3315918963 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0c980b2040 con 0x7f0ca01513a0 2023-10-14T09:17:36.821 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:36.821 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T09:17:36.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 -- 172.21.15.78:0/3315918963 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0c840664a0 msgr2=0x7f0c84068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0c840664a0 0x7f0c84068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c007fd0 tx=0x7f0c9c007d60 comp rx=0 tx=0).stop 2023-10-14T09:17:36.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 -- 172.21.15.78:0/3315918963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca01513a0 msgr2=0x7f0ca01f0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca01513a0 0x7f0ca01f0190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0c980b0040 tx=0x7f0c98019660 comp rx=0 tx=0).stop 2023-10-14T09:17:36.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 -- 172.21.15.78:0/3315918963 shutdown_connections 2023-10-14T09:17:36.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca01513a0 0x7f0ca01f0190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ca014a8f0 0x7f0ca01efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0c840664a0 0x7f0c84068960 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 --2- 172.21.15.78:0/3315918963 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ca00c1260 0x7f0ca01598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 -- 172.21.15.78:0/3315918963 >> 172.21.15.78:0/3315918963 conn(0x7f0ca0069e90 msgr2=0x7f0ca0148770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:36.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 -- 172.21.15.78:0/3315918963 shutdown_connections 2023-10-14T09:17:36.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.821+0000 7f0ca7c32640 1 -- 172.21.15.78:0/3315918963 wait complete. 2023-10-14T09:17:36.842 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T09:17:36.842 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:36.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.977+0000 7f0724e79640 1 Processor -- start 2023-10-14T09:17:36.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.977+0000 7f0724e79640 1 -- start start 2023-10-14T09:17:36.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f0724e79640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f072014e0f0 0x7f0720152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f0724e79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f072014ed10 0x7f072014f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f0724e79640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f072014f6d0 0x7f0720150a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f0724e79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0720153e50 con 0x7f072014ed10 2023-10-14T09:17:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f0724e79640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07201531d0 con 0x7f072014f6d0 2023-10-14T09:17:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f0724e79640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07201534b0 con 0x7f072014e0f0 2023-10-14T09:17:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f071dd9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f072014ed10 0x7f072014f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f071dd9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f072014ed10 0x7f072014f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38594/0 (socket says 172.21.15.78:38594) 2023-10-14T09:17:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f071dd9b640 1 -- 172.21.15.78:0/3105344184 learned_addr learned my addr 172.21.15.78:0/3105344184 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:36.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f071e59c640 1 --2- 172.21.15.78:0/3105344184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f072014e0f0 0x7f0720152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f071ed9d640 1 --2- 172.21.15.78:0/3105344184 >> v2:172.21.15.157:3300/0 conn(0x7f072014f6d0 0x7f0720150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f071dd9b640 1 -- 172.21.15.78:0/3105344184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f072014e0f0 msgr2=0x7f0720152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f071dd9b640 1 --2- 172.21.15.78:0/3105344184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f072014e0f0 0x7f0720152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f071dd9b640 1 -- 172.21.15.78:0/3105344184 >> v2:172.21.15.157:3300/0 conn(0x7f072014f6d0 msgr2=0x7f0720150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:36.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f071dd9b640 1 --2- 172.21.15.78:0/3105344184 >> v2:172.21.15.157:3300/0 conn(0x7f072014f6d0 0x7f0720150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.981+0000 7f071dd9b640 1 -- 172.21.15.78:0/3105344184 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0720153790 con 0x7f072014ed10 2023-10-14T09:17:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f071dd9b640 1 --2- 172.21.15.78:0/3105344184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072014ed10 0x7f072014f190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07200bf7d0 tx=0x7f071401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24dfad3a1e4d69e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f071d59a640 1 -- 172.21.15.78:0/3105344184 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07140ab600 con 0x7f072014ed10 2023-10-14T09:17:36.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f071d59a640 1 -- 172.21.15.78:0/3105344184 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07140a7050 con 0x7f072014ed10 2023-10-14T09:17:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f071d59a640 1 -- 172.21.15.78:0/3105344184 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07140ab980 con 0x7f072014ed10 2023-10-14T09:17:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 -- 172.21.15.78:0/3105344184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072014ed10 msgr2=0x7f072014f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 --2- 172.21.15.78:0/3105344184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072014ed10 0x7f072014f190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07200bf7d0 tx=0x7f071401c470 comp rx=0 tx=0).stop 2023-10-14T09:17:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 -- 172.21.15.78:0/3105344184 shutdown_connections 2023-10-14T09:17:36.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 --2- 172.21.15.78:0/3105344184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072014ed10 0x7f072014f190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 --2- 172.21.15.78:0/3105344184 >> v2:172.21.15.157:3300/0 conn(0x7f072014f6d0 0x7f0720150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 --2- 172.21.15.78:0/3105344184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f072014e0f0 0x7f0720152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 -- 172.21.15.78:0/3105344184 >> 172.21.15.78:0/3105344184 conn(0x7f07200c1cc0 msgr2=0x7f07200c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:36.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 -- 172.21.15.78:0/3105344184 shutdown_connections 2023-10-14T09:17:36.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 -- 172.21.15.78:0/3105344184 wait complete. 2023-10-14T09:17:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 Processor -- start 2023-10-14T09:17:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 -- start start 2023-10-14T09:17:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f072014e0f0 0x7f0720070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072014ed10 0x7f0720159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f072014f6d0 0x7f07201466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07200c3de0 con 0x7f072014ed10 2023-10-14T09:17:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07200c43a0 con 0x7f072014f6d0 2023-10-14T09:17:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.985+0000 7f0724e79640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0720070720 con 0x7f072014e0f0 2023-10-14T09:17:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072014ed10 0x7f0720159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072014ed10 0x7f0720159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38610/0 (socket says 172.21.15.78:38610) 2023-10-14T09:17:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071dd9b640 1 -- 172.21.15.78:0/3554882708 learned_addr learned my addr 172.21.15.78:0/3554882708 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071ed9d640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f072014f6d0 0x7f07201466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071e59c640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f072014e0f0 0x7f0720070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071dd9b640 1 -- 172.21.15.78:0/3554882708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f072014e0f0 msgr2=0x7f0720070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071dd9b640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f072014e0f0 0x7f0720070100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071dd9b640 1 -- 172.21.15.78:0/3554882708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f072014f6d0 msgr2=0x7f07201466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071dd9b640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f072014f6d0 0x7f07201466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071dd9b640 1 -- 172.21.15.78:0/3554882708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07140094d0 con 0x7f072014ed10 2023-10-14T09:17:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071e59c640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f072014e0f0 0x7f0720070100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071ed9d640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f072014f6d0 0x7f07201466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f071dd9b640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072014ed10 0x7f0720159a20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f07140ae040 tx=0x7f0714019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f070effd640 1 -- 172.21.15.78:0/3554882708 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07140b37d0 con 0x7f072014ed10 2023-10-14T09:17:36.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f070effd640 1 -- 172.21.15.78:0/3554882708 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07140b3930 con 0x7f072014ed10 2023-10-14T09:17:36.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f070effd640 1 -- 172.21.15.78:0/3554882708 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07140b3ca0 con 0x7f072014ed10 2023-10-14T09:17:36.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f0724e79640 1 -- 172.21.15.78:0/3554882708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0720070a00 con 0x7f072014ed10 2023-10-14T09:17:36.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f0724e79640 1 -- 172.21.15.78:0/3554882708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0720159f60 con 0x7f072014ed10 2023-10-14T09:17:36.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f0724e79640 1 -- 172.21.15.78:0/3554882708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0720074180 con 0x7f072014ed10 2023-10-14T09:17:36.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f070effd640 1 -- 172.21.15.78:0/3554882708 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f07140b2070 con 0x7f072014ed10 2023-10-14T09:17:36.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f070effd640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f07000664a0 0x7f0700068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:36.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.989+0000 7f070effd640 1 -- 172.21.15.78:0/3554882708 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f071411e190 con 0x7f072014ed10 2023-10-14T09:17:36.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.993+0000 7f071e59c640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f07000664a0 0x7f0700068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:36.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.993+0000 7f071e59c640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f07000664a0 0x7f0700068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0710009f70 tx=0x7f071000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:36.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:36.993+0000 7f070effd640 1 -- 172.21.15.78:0/3554882708 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f07140eb6a0 con 0x7f072014ed10 2023-10-14T09:17:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.145+0000 7f0724e79640 1 -- 172.21.15.78:0/3554882708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07200c0230 con 0x7f072014ed10 2023-10-14T09:17:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f070effd640 1 -- 172.21.15.78:0/3554882708 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f07140eecc0 con 0x7f072014ed10 2023-10-14T09:17:37.149 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:37.150 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 -- 172.21.15.78:0/3554882708 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f07000664a0 msgr2=0x7f0700068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f07000664a0 0x7f0700068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0710009f70 tx=0x7f071000b040 comp rx=0 tx=0).stop 2023-10-14T09:17:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 -- 172.21.15.78:0/3554882708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072014ed10 msgr2=0x7f0720159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072014ed10 0x7f0720159a20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f07140ae040 tx=0x7f0714019210 comp rx=0 tx=0).stop 2023-10-14T09:17:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 -- 172.21.15.78:0/3554882708 shutdown_connections 2023-10-14T09:17:37.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f072014f6d0 0x7f07201466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f072014ed10 0x7f0720159a20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f07000664a0 0x7f0700068960 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 --2- 172.21.15.78:0/3554882708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f072014e0f0 0x7f0720070100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 -- 172.21.15.78:0/3554882708 >> 172.21.15.78:0/3554882708 conn(0x7f07200c1cc0 msgr2=0x7f0720150890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:37.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 -- 172.21.15.78:0/3554882708 shutdown_connections 2023-10-14T09:17:37.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.149+0000 7f0724e79640 1 -- 172.21.15.78:0/3554882708 wait complete. 2023-10-14T09:17:37.170 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:37.171 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:37.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c379d640 1 Processor -- start 2023-10-14T09:17:37.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c379d640 1 -- start start 2023-10-14T09:17:37.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c379d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 0x7f53bc0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c379d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f53bc153d90 0x7f53bc1541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c379d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53bc0c7af0 con 0x7f53bc0c4030 2023-10-14T09:17:37.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c379d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53bc0c5300 con 0x7f53bc153d90 2023-10-14T09:17:37.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c379d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc157360 con 0x7f53bc06cc50 2023-10-14T09:17:37.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c1d3a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f53bc153d90 0x7f53bc1541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c0d38640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 0x7f53bc0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c0d38640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 0x7f53bc0c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:40534/0 (socket says 172.21.15.78:40534) 2023-10-14T09:17:37.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c1d3a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f53bc153d90 0x7f53bc1541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:45144/0 (socket says 172.21.15.78:45144) 2023-10-14T09:17:37.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c0d38640 1 -- 172.21.15.78:0/708092841 learned_addr learned my addr 172.21.15.78:0/708092841 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:37.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c1539640 1 --1- 172.21.15.78:0/708092841 >> v1:172.21.15.157:6789/0 conn(0x7f53bc0c4030 0x7f53bc0c4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:47568/0 (socket says 172.21.15.78:47568) 2023-10-14T09:17:37.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c0d38640 1 -- 172.21.15.78:0/708092841 >> v2:172.21.15.157:3300/0 conn(0x7f53bc153d90 msgr2=0x7f53bc1541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:37.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c0d38640 1 --2- 172.21.15.78:0/708092841 >> v2:172.21.15.157:3300/0 conn(0x7f53bc153d90 0x7f53bc1541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c0d38640 1 -- 172.21.15.78:0/708092841 >> v1:172.21.15.157:6789/0 conn(0x7f53bc0c4030 legacy=0x7f53bc0c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.313+0000 7f53c0d38640 1 -- 172.21.15.78:0/708092841 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc157ee0 con 0x7f53bc06cc50 2023-10-14T09:17:37.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53c0d38640 1 --2- 172.21.15.78:0/708092841 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 0x7f53bc0c75b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009870 tx=0x7f53ac01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3955e18c053e9494 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:37.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53b3fff640 1 -- 172.21.15.78:0/708092841 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac0aa610 con 0x7f53bc06cc50 2023-10-14T09:17:37.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53b3fff640 1 -- 172.21.15.78:0/708092841 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac0a6040 con 0x7f53bc06cc50 2023-10-14T09:17:37.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53b3fff640 1 -- 172.21.15.78:0/708092841 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac0aa990 con 0x7f53bc06cc50 2023-10-14T09:17:37.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53c379d640 1 -- 172.21.15.78:0/708092841 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 msgr2=0x7f53bc0c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53c379d640 1 --2- 172.21.15.78:0/708092841 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 0x7f53bc0c75b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009870 tx=0x7f53ac01c4b0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53c379d640 1 -- 172.21.15.78:0/708092841 shutdown_connections 2023-10-14T09:17:37.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53c379d640 1 --2- 172.21.15.78:0/708092841 >> v2:172.21.15.157:3300/0 conn(0x7f53bc153d90 0x7f53bc1541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53c379d640 1 --2- 172.21.15.78:0/708092841 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 0x7f53bc0c75b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53c379d640 1 -- 172.21.15.78:0/708092841 >> 172.21.15.78:0/708092841 conn(0x7f53bc0ab240 msgr2=0x7f53bc0ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:37.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53c379d640 1 -- 172.21.15.78:0/708092841 shutdown_connections 2023-10-14T09:17:37.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.317+0000 7f53c379d640 1 -- 172.21.15.78:0/708092841 wait complete. 2023-10-14T09:17:37.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c379d640 1 Processor -- start 2023-10-14T09:17:37.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c379d640 1 -- start start 2023-10-14T09:17:37.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c379d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 0x7f53bc14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c379d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53bc0c4030 0x7f53bc14b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c379d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53bc153d90 0x7f53bc14b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c379d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc156020 con 0x7f53bc153d90 2023-10-14T09:17:37.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c379d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc0a9b60 con 0x7f53bc0c4030 2023-10-14T09:17:37.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c379d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc0aac70 con 0x7f53bc06cc50 2023-10-14T09:17:37.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c1d3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53bc153d90 0x7f53bc14b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c1d3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53bc153d90 0x7f53bc14b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38620/0 (socket says 172.21.15.78:38620) 2023-10-14T09:17:37.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c1d3a640 1 -- 172.21.15.78:0/1624766359 learned_addr learned my addr 172.21.15.78:0/1624766359 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:37.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c0d38640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53bc0c4030 0x7f53bc14b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c1539640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 0x7f53bc14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c1d3a640 1 -- 172.21.15.78:0/1624766359 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 msgr2=0x7f53bc14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c1d3a640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 0x7f53bc14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c1d3a640 1 -- 172.21.15.78:0/1624766359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53bc0c4030 msgr2=0x7f53bc14b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c1d3a640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53bc0c4030 0x7f53bc14b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c1d3a640 1 -- 172.21.15.78:0/1624766359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac0094d0 con 0x7f53bc153d90 2023-10-14T09:17:37.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c1d3a640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53bc153d90 0x7f53bc14b9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f53b400ec10 tx=0x7f53b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:37.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53b1ffb640 1 -- 172.21.15.78:0/1624766359 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b400cd20 con 0x7f53bc153d90 2023-10-14T09:17:37.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53b1ffb640 1 -- 172.21.15.78:0/1624766359 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b400f040 con 0x7f53bc153d90 2023-10-14T09:17:37.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c379d640 1 -- 172.21.15.78:0/1624766359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53bc0a9e00 con 0x7f53bc153d90 2023-10-14T09:17:37.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53b1ffb640 1 -- 172.21.15.78:0/1624766359 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40146c0 con 0x7f53bc153d90 2023-10-14T09:17:37.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.321+0000 7f53c379d640 1 -- 172.21.15.78:0/1624766359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53bc1504f0 con 0x7f53bc153d90 2023-10-14T09:17:37.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.325+0000 7f53c379d640 1 -- 172.21.15.78:0/1624766359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53bc0ae5e0 con 0x7f53bc153d90 2023-10-14T09:17:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.325+0000 7f53b1ffb640 1 -- 172.21.15.78:0/1624766359 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f53b4014a30 con 0x7f53bc153d90 2023-10-14T09:17:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.325+0000 7f53b1ffb640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f53a00664a0 0x7f53a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.325+0000 7f53b1ffb640 1 -- 172.21.15.78:0/1624766359 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53b4084a20 con 0x7f53bc153d90 2023-10-14T09:17:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.325+0000 7f53c1539640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f53a00664a0 0x7f53a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.325+0000 7f53c1539640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f53a00664a0 0x7f53a0068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f53b8000f70 tx=0x7f53b8007e50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:37.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.329+0000 7f53b1ffb640 1 -- 172.21.15.78:0/1624766359 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f53b4051eb0 con 0x7f53bc153d90 2023-10-14T09:17:37.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.477+0000 7f53c379d640 1 -- 172.21.15.78:0/1624766359 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53bc074110 con 0x7f53bc153d90 2023-10-14T09:17:37.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.477+0000 7f53b1ffb640 1 -- 172.21.15.78:0/1624766359 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53b40180a0 con 0x7f53bc153d90 2023-10-14T09:17:37.480 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:37.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 -- 172.21.15.78:0/1624766359 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f53a00664a0 msgr2=0x7f53a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f53a00664a0 0x7f53a0068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f53b8000f70 tx=0x7f53b8007e50 comp rx=0 tx=0).stop 2023-10-14T09:17:37.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 -- 172.21.15.78:0/1624766359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53bc153d90 msgr2=0x7f53bc14b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53bc153d90 0x7f53bc14b9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f53b400ec10 tx=0x7f53b400c490 comp rx=0 tx=0).stop 2023-10-14T09:17:37.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 -- 172.21.15.78:0/1624766359 shutdown_connections 2023-10-14T09:17:37.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53bc153d90 0x7f53bc14b9d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f53bc0c4030 0x7f53bc14b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f53a00664a0 0x7f53a0068960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 --2- 172.21.15.78:0/1624766359 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f53bc06cc50 0x7f53bc14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 -- 172.21.15.78:0/1624766359 >> 172.21.15.78:0/1624766359 conn(0x7f53bc0ab240 msgr2=0x7f53bc0ab620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:37.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 -- 172.21.15.78:0/1624766359 shutdown_connections 2023-10-14T09:17:37.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.481+0000 7f53c379d640 1 -- 172.21.15.78:0/1624766359 wait complete. 2023-10-14T09:17:37.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:17:37.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.637+0000 7fc92dfb8640 1 Processor -- start 2023-10-14T09:17:37.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc92dfb8640 1 -- start start 2023-10-14T09:17:37.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc92dfb8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc928139dc0 0x7fc9280718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc92dfb8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc928150f40 0x7fc9281539d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc92dfb8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc928151fd0 con 0x7fc928150ac0 2023-10-14T09:17:37.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc92dfb8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9280702c0 con 0x7fc928139dc0 2023-10-14T09:17:37.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc92dfb8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc928152ea0 con 0x7fc928150f40 2023-10-14T09:17:37.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc9277fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc928139dc0 0x7fc9280718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc926ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc928150ac0 0x7fc9281532c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47336/0 (socket says 172.21.15.78:47336) 2023-10-14T09:17:37.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc926ffd640 1 -- 172.21.15.78:0/1082752560 learned_addr learned my addr 172.21.15.78:0/1082752560 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:37.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc927fff640 1 --2- 172.21.15.78:0/1082752560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc928150f40 0x7fc9281539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc9277fe640 1 -- 172.21.15.78:0/1082752560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc928150f40 msgr2=0x7fc9281539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:37.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc9277fe640 1 --2- 172.21.15.78:0/1082752560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc928150f40 0x7fc9281539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc9277fe640 1 -- 172.21.15.78:0/1082752560 >> v1:172.21.15.78:6789/0 conn(0x7fc928150ac0 legacy=0x7fc9281532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc9277fe640 1 -- 172.21.15.78:0/1082752560 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9281513d0 con 0x7fc928139dc0 2023-10-14T09:17:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.641+0000 7fc9267fc640 1 -- 172.21.15.78:0/1082752560 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749137879 0 0) 0x7fc928151fd0 con 0x7fc928150ac0 2023-10-14T09:17:37.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc9277fe640 1 --2- 172.21.15.78:0/1082752560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc928139dc0 0x7fc9280718a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc91800ba60 tx=0x7fc91801eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44dae1d9e90d749 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:37.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc9267fc640 1 -- 172.21.15.78:0/1082752560 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9180a7980 con 0x7fc928139dc0 2023-10-14T09:17:37.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc9267fc640 1 -- 172.21.15.78:0/1082752560 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9180a7ae0 con 0x7fc928139dc0 2023-10-14T09:17:37.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc9267fc640 1 -- 172.21.15.78:0/1082752560 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9180a7e70 con 0x7fc928139dc0 2023-10-14T09:17:37.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1082752560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc928139dc0 msgr2=0x7fc9280718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc92dfb8640 1 --2- 172.21.15.78:0/1082752560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc928139dc0 0x7fc9280718a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc91800ba60 tx=0x7fc91801eac0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1082752560 shutdown_connections 2023-10-14T09:17:37.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc92dfb8640 1 --2- 172.21.15.78:0/1082752560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc928150f40 0x7fc9281539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc92dfb8640 1 --2- 172.21.15.78:0/1082752560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc928139dc0 0x7fc9280718a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1082752560 >> 172.21.15.78:0/1082752560 conn(0x7fc9280c1d00 msgr2=0x7fc9280c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:37.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1082752560 shutdown_connections 2023-10-14T09:17:37.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1082752560 wait complete. 2023-10-14T09:17:37.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc92dfb8640 1 Processor -- start 2023-10-14T09:17:37.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.645+0000 7fc92dfb8640 1 -- start start 2023-10-14T09:17:37.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc92dfb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc928139dc0 0x7fc9280bb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc92dfb8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928150ac0 0x7fc9281ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc92dfb8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc928150f40 0x7fc9281ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc92dfb8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9281f02b0 con 0x7fc928139dc0 2023-10-14T09:17:37.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc92dfb8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc928134d40 con 0x7fc928150ac0 2023-10-14T09:17:37.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc92dfb8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9281ef6a0 con 0x7fc928150f40 2023-10-14T09:17:37.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc9277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc928139dc0 0x7fc9280bb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc9277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc928139dc0 0x7fc9280bb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38638/0 (socket says 172.21.15.78:38638) 2023-10-14T09:17:37.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc9277fe640 1 -- 172.21.15.78:0/1432500003 learned_addr learned my addr 172.21.15.78:0/1432500003 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:37.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc926ffd640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928150ac0 0x7fc9281ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc927fff640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc928150f40 0x7fc9281ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc9277fe640 1 -- 172.21.15.78:0/1432500003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc928150f40 msgr2=0x7fc9281ec6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc9277fe640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc928150f40 0x7fc9281ec6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc9277fe640 1 -- 172.21.15.78:0/1432500003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928150ac0 msgr2=0x7fc9281ec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc9277fe640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928150ac0 0x7fc9281ec180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc9277fe640 1 -- 172.21.15.78:0/1432500003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91800b6c0 con 0x7fc928139dc0 2023-10-14T09:17:37.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc9277fe640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc928139dc0 0x7fc9280bb570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9180b2040 tx=0x7fc91801b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:37.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc90ffff640 1 -- 172.21.15.78:0/1432500003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9180af910 con 0x7fc928139dc0 2023-10-14T09:17:37.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc90ffff640 1 -- 172.21.15.78:0/1432500003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9180afa90 con 0x7fc928139dc0 2023-10-14T09:17:37.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1432500003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9281ef980 con 0x7fc928139dc0 2023-10-14T09:17:37.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc90ffff640 1 -- 172.21.15.78:0/1432500003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9180afe40 con 0x7fc928139dc0 2023-10-14T09:17:37.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1432500003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9281eff40 con 0x7fc928139dc0 2023-10-14T09:17:37.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.649+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1432500003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9281ebdc0 con 0x7fc928139dc0 2023-10-14T09:17:37.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.653+0000 7fc90ffff640 1 -- 172.21.15.78:0/1432500003 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc9180b6070 con 0x7fc928139dc0 2023-10-14T09:17:37.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.653+0000 7fc90ffff640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc9140664a0 0x7fc914068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.653+0000 7fc90ffff640 1 -- 172.21.15.78:0/1432500003 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc91811db10 con 0x7fc928139dc0 2023-10-14T09:17:37.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.653+0000 7fc926ffd640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc9140664a0 0x7fc914068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.653+0000 7fc926ffd640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc9140664a0 0x7fc914068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc9280bc250 tx=0x7fc91c007df0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:37.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.657+0000 7fc90ffff640 1 -- 172.21.15.78:0/1432500003 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc9180eb040 con 0x7fc928139dc0 2023-10-14T09:17:37.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1432500003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc928074110 con 0x7fc928139dc0 2023-10-14T09:17:37.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc90ffff640 1 -- 172.21.15.78:0/1432500003 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9180ee660 con 0x7fc928139dc0 2023-10-14T09:17:37.806 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:17:37.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1432500003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc9140664a0 msgr2=0x7fc914068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc9140664a0 0x7fc914068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc9280bc250 tx=0x7fc91c007df0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1432500003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc928139dc0 msgr2=0x7fc9280bb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc928139dc0 0x7fc9280bb570 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9180b2040 tx=0x7fc91801b860 comp rx=0 tx=0).stop 2023-10-14T09:17:37.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1432500003 shutdown_connections 2023-10-14T09:17:37.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc9140664a0 0x7fc914068960 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc928150f40 0x7fc9281ec6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc928150ac0 0x7fc9281ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 --2- 172.21.15.78:0/1432500003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc928139dc0 0x7fc9280bb570 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1432500003 >> 172.21.15.78:0/1432500003 conn(0x7fc9280c1d00 msgr2=0x7fc92814e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:37.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1432500003 shutdown_connections 2023-10-14T09:17:37.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.805+0000 7fc92dfb8640 1 -- 172.21.15.78:0/1432500003 wait complete. 2023-10-14T09:17:37.827 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:17:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce80ea640 1 Processor -- start 2023-10-14T09:17:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce80ea640 1 -- start start 2023-10-14T09:17:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce80ea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ce00c4030 0x7f8ce00c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce80ea640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8ce006cc50 0x7f8ce00c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce80ea640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce00c7af0 con 0x7f8ce0153d90 2023-10-14T09:17:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce80ea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce00c5300 con 0x7f8ce00c4030 2023-10-14T09:17:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce80ea640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce0157360 con 0x7f8ce006cc50 2023-10-14T09:17:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce5e86640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ce00c4030 0x7f8ce00c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce5e86640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ce00c4030 0x7f8ce00c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38646/0 (socket says 172.21.15.78:38646) 2023-10-14T09:17:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce5e86640 1 -- 172.21.15.78:0/1511269294 learned_addr learned my addr 172.21.15.78:0/1511269294 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce5685640 1 --2- 172.21.15.78:0/1511269294 >> v2:172.21.15.157:3300/0 conn(0x7f8ce006cc50 0x7f8ce00c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce5e86640 1 -- 172.21.15.78:0/1511269294 >> v2:172.21.15.157:3300/0 conn(0x7f8ce006cc50 msgr2=0x7f8ce00c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce5e86640 1 --2- 172.21.15.78:0/1511269294 >> v2:172.21.15.157:3300/0 conn(0x7f8ce006cc50 0x7f8ce00c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce5e86640 1 -- 172.21.15.78:0/1511269294 >> v1:172.21.15.157:6789/0 conn(0x7f8ce0153d90 legacy=0x7f8ce01541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce5e86640 1 -- 172.21.15.78:0/1511269294 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0157ee0 con 0x7f8ce00c4030 2023-10-14T09:17:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.965+0000 7f8ce5685640 1 --2- 172.21.15.78:0/1511269294 >> v2:172.21.15.157:3300/0 conn(0x7f8ce006cc50 0x7f8ce00c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce5e86640 1 --2- 172.21.15.78:0/1511269294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce00c4030 0x7f8ce00c75b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00c6d50 tx=0x7f8cdc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d01610c9710142a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce4e84640 1 -- 172.21.15.78:0/1511269294 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0ab600 con 0x7f8ce00c4030 2023-10-14T09:17:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce4e84640 1 -- 172.21.15.78:0/1511269294 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc0a7050 con 0x7f8ce00c4030 2023-10-14T09:17:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce4e84640 1 -- 172.21.15.78:0/1511269294 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0ab980 con 0x7f8ce00c4030 2023-10-14T09:17:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce80ea640 1 -- 172.21.15.78:0/1511269294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce00c4030 msgr2=0x7f8ce00c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce80ea640 1 --2- 172.21.15.78:0/1511269294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce00c4030 0x7f8ce00c75b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00c6d50 tx=0x7f8cdc01c430 comp rx=0 tx=0).stop 2023-10-14T09:17:37.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce80ea640 1 -- 172.21.15.78:0/1511269294 shutdown_connections 2023-10-14T09:17:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce80ea640 1 --2- 172.21.15.78:0/1511269294 >> v2:172.21.15.157:3300/0 conn(0x7f8ce006cc50 0x7f8ce00c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce80ea640 1 --2- 172.21.15.78:0/1511269294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce00c4030 0x7f8ce00c75b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce80ea640 1 -- 172.21.15.78:0/1511269294 >> 172.21.15.78:0/1511269294 conn(0x7f8ce00ab240 msgr2=0x7f8ce00ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce80ea640 1 -- 172.21.15.78:0/1511269294 shutdown_connections 2023-10-14T09:17:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.969+0000 7f8ce80ea640 1 -- 172.21.15.78:0/1511269294 wait complete. 2023-10-14T09:17:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce80ea640 1 Processor -- start 2023-10-14T09:17:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce80ea640 1 -- start start 2023-10-14T09:17:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce80ea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ce006cc50 0x7f8ce01ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce80ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce00c4030 0x7f8ce014d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce80ea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ce0153d90 0x7f8ce014deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce80ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce014e3f0 con 0x7f8ce00c4030 2023-10-14T09:17:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce80ea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce01f04a0 con 0x7f8ce0153d90 2023-10-14T09:17:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce80ea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00c3350 con 0x7f8ce006cc50 2023-10-14T09:17:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce5685640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce00c4030 0x7f8ce014d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce5685640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce00c4030 0x7f8ce014d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38654/0 (socket says 172.21.15.78:38654) 2023-10-14T09:17:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce5685640 1 -- 172.21.15.78:0/2658275281 learned_addr learned my addr 172.21.15.78:0/2658275281 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce5e86640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ce006cc50 0x7f8ce01ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce6687640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ce0153d90 0x7f8ce014deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce5685640 1 -- 172.21.15.78:0/2658275281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ce006cc50 msgr2=0x7f8ce01ef900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce5685640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ce006cc50 0x7f8ce01ef900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce5685640 1 -- 172.21.15.78:0/2658275281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ce0153d90 msgr2=0x7f8ce014deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:37.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce5685640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ce0153d90 0x7f8ce014deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce5685640 1 -- 172.21.15.78:0/2658275281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0094d0 con 0x7f8ce00c4030 2023-10-14T09:17:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce5e86640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ce006cc50 0x7f8ce01ef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce5685640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce00c4030 0x7f8ce014d970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c7f0 tx=0x7f8cd000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8cd67fc640 1 -- 172.21.15.78:0/2658275281 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000cea0 con 0x7f8ce00c4030 2023-10-14T09:17:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8cd67fc640 1 -- 172.21.15.78:0/2658275281 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd0007a30 con 0x7f8ce00c4030 2023-10-14T09:17:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce80ea640 1 -- 172.21.15.78:0/2658275281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce00c37e0 con 0x7f8ce00c4030 2023-10-14T09:17:37.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8cd67fc640 1 -- 172.21.15.78:0/2658275281 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0007de0 con 0x7f8ce00c4030 2023-10-14T09:17:37.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.973+0000 7f8ce80ea640 1 -- 172.21.15.78:0/2658275281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce00adda0 con 0x7f8ce00c4030 2023-10-14T09:17:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.977+0000 7f8ce80ea640 1 -- 172.21.15.78:0/2658275281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce0074110 con 0x7f8ce00c4030 2023-10-14T09:17:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.977+0000 7f8cd67fc640 1 -- 172.21.15.78:0/2658275281 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8cd00113f0 con 0x7f8ce00c4030 2023-10-14T09:17:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.977+0000 7f8cd67fc640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8cc40664a0 0x7f8cc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.977+0000 7f8cd67fc640 1 -- 172.21.15.78:0/2658275281 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cd0083f60 con 0x7f8ce00c4030 2023-10-14T09:17:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.977+0000 7f8ce5e86640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8cc40664a0 0x7f8cc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.977+0000 7f8ce5e86640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8cc40664a0 0x7f8cc4068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00c0710 tx=0x7f8cdc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:37.981+0000 7f8cd67fc640 1 -- 172.21.15.78:0/2658275281 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8cd00513d0 con 0x7f8ce00c4030 2023-10-14T09:17:38.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 -- 172.21.15.78:0/2658275281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ce00c7040 con 0x7f8ce00c4030 2023-10-14T09:17:38.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8cd67fc640 1 -- 172.21.15.78:0/2658275281 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8cd00549f0 con 0x7f8ce00c4030 2023-10-14T09:17:38.134 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:17:38.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 -- 172.21.15.78:0/2658275281 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8cc40664a0 msgr2=0x7f8cc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8cc40664a0 0x7f8cc4068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00c0710 tx=0x7f8cdc009040 comp rx=0 tx=0).stop 2023-10-14T09:17:38.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 -- 172.21.15.78:0/2658275281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce00c4030 msgr2=0x7f8ce014d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce00c4030 0x7f8ce014d970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c7f0 tx=0x7f8cd000ccb0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 -- 172.21.15.78:0/2658275281 shutdown_connections 2023-10-14T09:17:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8ce0153d90 0x7f8ce014deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce00c4030 0x7f8ce014d970 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8cc40664a0 0x7f8cc4068960 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 --2- 172.21.15.78:0/2658275281 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8ce006cc50 0x7f8ce01ef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 -- 172.21.15.78:0/2658275281 >> 172.21.15.78:0/2658275281 conn(0x7f8ce00ab240 msgr2=0x7f8ce0150d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:38.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 -- 172.21.15.78:0/2658275281 shutdown_connections 2023-10-14T09:17:38.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.133+0000 7f8ce80ea640 1 -- 172.21.15.78:0/2658275281 wait complete. 2023-10-14T09:17:38.154 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:17:38.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d73396640 1 Processor -- start 2023-10-14T09:17:38.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d73396640 1 -- start start 2023-10-14T09:17:38.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d73396640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d6c1514b0 0x7f9d6c0c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d73396640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d6c154920 0x7f9d6c0c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d73396640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f9d6c0c4810 0x7f9d6c0c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d73396640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6c153c30 con 0x7f9d6c1514b0 2023-10-14T09:17:38.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d73396640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6c154490 con 0x7f9d6c0c4810 2023-10-14T09:17:38.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d73396640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c0c5a00 con 0x7f9d6c154920 2023-10-14T09:17:38.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d72394640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d6c1514b0 0x7f9d6c0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d72394640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d6c1514b0 0x7f9d6c0c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38658/0 (socket says 172.21.15.78:38658) 2023-10-14T09:17:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d72394640 1 -- 172.21.15.78:0/3918464230 learned_addr learned my addr 172.21.15.78:0/3918464230 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d72b95640 1 --2- 172.21.15.78:0/3918464230 >> v2:172.21.15.157:3300/0 conn(0x7f9d6c0c4810 0x7f9d6c0c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d71b93640 1 --2- 172.21.15.78:0/3918464230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d6c154920 0x7f9d6c0c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d72394640 1 -- 172.21.15.78:0/3918464230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d6c154920 msgr2=0x7f9d6c0c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:38.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d72394640 1 --2- 172.21.15.78:0/3918464230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d6c154920 0x7f9d6c0c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d72394640 1 -- 172.21.15.78:0/3918464230 >> v2:172.21.15.157:3300/0 conn(0x7f9d6c0c4810 msgr2=0x7f9d6c0c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:38.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d72394640 1 --2- 172.21.15.78:0/3918464230 >> v2:172.21.15.157:3300/0 conn(0x7f9d6c0c4810 0x7f9d6c0c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d72394640 1 -- 172.21.15.78:0/3918464230 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c153e40 con 0x7f9d6c1514b0 2023-10-14T09:17:38.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.293+0000 7f9d71b93640 1 --2- 172.21.15.78:0/3918464230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d6c154920 0x7f9d6c0c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:38.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d72394640 1 --2- 172.21.15.78:0/3918464230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d6c1514b0 0x7f9d6c0c4d60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c08b680 tx=0x7f9d6801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef090852b7e266ac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:38.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d71392640 1 -- 172.21.15.78:0/3918464230 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d680ad640 con 0x7f9d6c1514b0 2023-10-14T09:17:38.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d71392640 1 -- 172.21.15.78:0/3918464230 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d680ad7a0 con 0x7f9d6c1514b0 2023-10-14T09:17:38.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d71392640 1 -- 172.21.15.78:0/3918464230 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d680adb30 con 0x7f9d6c1514b0 2023-10-14T09:17:38.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d73396640 1 -- 172.21.15.78:0/3918464230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d6c1514b0 msgr2=0x7f9d6c0c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d73396640 1 --2- 172.21.15.78:0/3918464230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d6c1514b0 0x7f9d6c0c4d60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c08b680 tx=0x7f9d6801c3b0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d73396640 1 -- 172.21.15.78:0/3918464230 shutdown_connections 2023-10-14T09:17:38.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d73396640 1 --2- 172.21.15.78:0/3918464230 >> v2:172.21.15.157:3300/0 conn(0x7f9d6c0c4810 0x7f9d6c0c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d73396640 1 --2- 172.21.15.78:0/3918464230 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d6c154920 0x7f9d6c0c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d73396640 1 --2- 172.21.15.78:0/3918464230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d6c1514b0 0x7f9d6c0c4d60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d73396640 1 -- 172.21.15.78:0/3918464230 >> 172.21.15.78:0/3918464230 conn(0x7f9d6c0c9430 msgr2=0x7f9d6c0c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:38.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d73396640 1 -- 172.21.15.78:0/3918464230 shutdown_connections 2023-10-14T09:17:38.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d73396640 1 -- 172.21.15.78:0/3918464230 wait complete. 2023-10-14T09:17:38.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d73396640 1 Processor -- start 2023-10-14T09:17:38.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.297+0000 7f9d73396640 1 -- start start 2023-10-14T09:17:38.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d73396640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d6c0c4810 0x7f9d6c1488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d73396640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d6c1514b0 0x7f9d6c1466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d73396640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d6c154920 0x7f9d6c146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d73396640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c1f0e00 con 0x7f9d6c1514b0 2023-10-14T09:17:38.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d73396640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c14dbb0 con 0x7f9d6c154920 2023-10-14T09:17:38.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d73396640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c147120 con 0x7f9d6c0c4810 2023-10-14T09:17:38.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d71b93640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d6c1514b0 0x7f9d6c1466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d71b93640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d6c1514b0 0x7f9d6c1466a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38666/0 (socket says 172.21.15.78:38666) 2023-10-14T09:17:38.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d71b93640 1 -- 172.21.15.78:0/4142877426 learned_addr learned my addr 172.21.15.78:0/4142877426 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:38.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d72b95640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d6c154920 0x7f9d6c146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d72394640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d6c0c4810 0x7f9d6c1488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d71b93640 1 -- 172.21.15.78:0/4142877426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d6c0c4810 msgr2=0x7f9d6c1488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d71b93640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d6c0c4810 0x7f9d6c1488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d71b93640 1 -- 172.21.15.78:0/4142877426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d6c154920 msgr2=0x7f9d6c146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d71b93640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d6c154920 0x7f9d6c146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d71b93640 1 -- 172.21.15.78:0/4142877426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d680094d0 con 0x7f9d6c1514b0 2023-10-14T09:17:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d71b93640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d6c1514b0 0x7f9d6c1466a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00d800 tx=0x7f9d5c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d62ffd640 1 -- 172.21.15.78:0/4142877426 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c0096c0 con 0x7f9d6c1514b0 2023-10-14T09:17:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d62ffd640 1 -- 172.21.15.78:0/4142877426 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c009820 con 0x7f9d6c1514b0 2023-10-14T09:17:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d62ffd640 1 -- 172.21.15.78:0/4142877426 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c009bd0 con 0x7f9d6c1514b0 2023-10-14T09:17:38.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d73396640 1 -- 172.21.15.78:0/4142877426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6c14a2f0 con 0x7f9d6c1514b0 2023-10-14T09:17:38.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d73396640 1 -- 172.21.15.78:0/4142877426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6c1f0460 con 0x7f9d6c1514b0 2023-10-14T09:17:38.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d73396640 1 -- 172.21.15.78:0/4142877426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6c04e9c0 con 0x7f9d6c1514b0 2023-10-14T09:17:38.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.301+0000 7f9d62ffd640 1 -- 172.21.15.78:0/4142877426 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9d5c009d30 con 0x7f9d6c1514b0 2023-10-14T09:17:38.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.305+0000 7f9d62ffd640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9d500664d0 0x7f9d50068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.305+0000 7f9d62ffd640 1 -- 172.21.15.78:0/4142877426 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d5c084400 con 0x7f9d6c1514b0 2023-10-14T09:17:38.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.305+0000 7f9d72394640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9d500664d0 0x7f9d50068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.305+0000 7f9d72394640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9d500664d0 0x7f9d50068990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d680af000 tx=0x7f9d68008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:38.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.309+0000 7f9d62ffd640 1 -- 172.21.15.78:0/4142877426 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9d5c051920 con 0x7f9d6c1514b0 2023-10-14T09:17:38.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.489+0000 7f9d73396640 1 -- 172.21.15.78:0/4142877426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d6c151f60 con 0x7f9d6c1514b0 2023-10-14T09:17:38.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.489+0000 7f9d62ffd640 1 -- 172.21.15.78:0/4142877426 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f9d5c054f40 con 0x7f9d6c1514b0 2023-10-14T09:17:38.493 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:38.493 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1987032053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1987032053},{"type":"v1","addr":"172.21.15.157:6834","nonce":1987032053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/20028755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":20028755},{"type":"v1","addr":"172.21.15.78:6836","nonce":20028755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3671283338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3671283338},{"type":"v1","addr":"172.21.15.78:6837","nonce":3671283338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:17:25.006130+0000","modified":"2023-10-14T09:17:28.036173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/3774780175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3774780175},{"type":"v1","addr":"172.21.15.157:6835","nonce":3774780175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:17:38.493 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-10-14T09:17:38.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 -- 172.21.15.78:0/4142877426 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9d500664d0 msgr2=0x7f9d50068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9d500664d0 0x7f9d50068990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d680af000 tx=0x7f9d68008040 comp rx=0 tx=0).stop 2023-10-14T09:17:38.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 -- 172.21.15.78:0/4142877426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d6c1514b0 msgr2=0x7f9d6c1466a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d6c1514b0 0x7f9d6c1466a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00d800 tx=0x7f9d5c00dcc0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 -- 172.21.15.78:0/4142877426 shutdown_connections 2023-10-14T09:17:38.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d6c154920 0x7f9d6c146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d6c1514b0 0x7f9d6c1466a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9d500664d0 0x7f9d50068990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 --2- 172.21.15.78:0/4142877426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d6c0c4810 0x7f9d6c1488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 -- 172.21.15.78:0/4142877426 >> 172.21.15.78:0/4142877426 conn(0x7f9d6c0c9430 msgr2=0x7f9d6c15d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:38.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 -- 172.21.15.78:0/4142877426 shutdown_connections 2023-10-14T09:17:38.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.493+0000 7f9d73396640 1 -- 172.21.15.78:0/4142877426 wait complete. 2023-10-14T09:17:38.514 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.649+0000 7f433e565640 1 Processor -- start 2023-10-14T09:17:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.649+0000 7f433e565640 1 -- start start 2023-10-14T09:17:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.649+0000 7f433e565640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f43380c1eb0 0x7f43380c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.649+0000 7f433e565640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4338151810 con 0x7f43380c7d30 2023-10-14T09:17:38.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.649+0000 7f433e565640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433806f760 con 0x7f4338151430 2023-10-14T09:17:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.649+0000 7f433e565640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43380c27d0 con 0x7f43380c1eb0 2023-10-14T09:17:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.649+0000 7f433cb02640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f43380c7d30 0x7f43380c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47338/0 (socket says 172.21.15.78:47338) 2023-10-14T09:17:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.649+0000 7f433cb02640 1 -- 172.21.15.78:0/3678111904 learned_addr learned my addr 172.21.15.78:0/3678111904 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.653+0000 7f43377fe640 1 --2- 172.21.15.78:0/3678111904 >> v2:172.21.15.157:3300/0 conn(0x7f43380c1eb0 0x7f43380c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.653+0000 7f4336ffd640 1 -- 172.21.15.78:0/3678111904 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178714377 0 0) 0x7f4338151810 con 0x7f43380c7d30 2023-10-14T09:17:38.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.653+0000 7f4336ffd640 1 -- 172.21.15.78:0/3678111904 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4320003530 con 0x7f43380c7d30 2023-10-14T09:17:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.653+0000 7f4336ffd640 1 -- 172.21.15.78:0/3678111904 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673249312 0 0) 0x7f433806f760 con 0x7f4338151430 2023-10-14T09:17:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.653+0000 7f4336ffd640 1 -- 172.21.15.78:0/3678111904 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4338151810 con 0x7f4338151430 2023-10-14T09:17:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.653+0000 7f43377fe640 1 -- 172.21.15.78:0/3678111904 >> v1:172.21.15.157:6789/0 conn(0x7f4338151430 legacy=0x7f43381547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.653+0000 7f43377fe640 1 -- 172.21.15.78:0/3678111904 >> v1:172.21.15.78:6789/0 conn(0x7f43380c7d30 legacy=0x7f43380c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.653+0000 7f43377fe640 1 -- 172.21.15.78:0/3678111904 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433806fa00 con 0x7f43380c1eb0 2023-10-14T09:17:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.653+0000 7f43377fe640 1 --2- 172.21.15.78:0/3678111904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43380c1eb0 0x7f43380c77f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f432c0097c0 tx=0x7f432c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92022bdf51166e6b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.653+0000 7f4336ffd640 1 -- 172.21.15.78:0/3678111904 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0ab600 con 0x7f43380c1eb0 2023-10-14T09:17:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.653+0000 7f4336ffd640 1 -- 172.21.15.78:0/3678111904 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c0a7050 con 0x7f43380c1eb0 2023-10-14T09:17:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f4336ffd640 1 -- 172.21.15.78:0/3678111904 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0ab980 con 0x7f43380c1eb0 2023-10-14T09:17:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 -- 172.21.15.78:0/3678111904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43380c1eb0 msgr2=0x7f43380c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 --2- 172.21.15.78:0/3678111904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43380c1eb0 0x7f43380c77f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f432c0097c0 tx=0x7f432c01c330 comp rx=0 tx=0).stop 2023-10-14T09:17:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 -- 172.21.15.78:0/3678111904 shutdown_connections 2023-10-14T09:17:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 --2- 172.21.15.78:0/3678111904 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f43380c1eb0 0x7f43380c77f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 -- 172.21.15.78:0/3678111904 >> 172.21.15.78:0/3678111904 conn(0x7f433806a060 msgr2=0x7f433806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 -- 172.21.15.78:0/3678111904 shutdown_connections 2023-10-14T09:17:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 -- 172.21.15.78:0/3678111904 wait complete. 2023-10-14T09:17:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 Processor -- start 2023-10-14T09:17:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 -- start start 2023-10-14T09:17:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43380c1eb0 0x7f4338157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43380c7d30 0x7f43380a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4338151430 0x7f433806c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43381558e0 con 0x7f43380c7d30 2023-10-14T09:17:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380a6710 con 0x7f4338151430 2023-10-14T09:17:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433e565640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4338155180 con 0x7f43380c1eb0 2023-10-14T09:17:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f43377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43380c7d30 0x7f43380a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f43377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43380c7d30 0x7f43380a44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38670/0 (socket says 172.21.15.78:38670) 2023-10-14T09:17:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f43377fe640 1 -- 172.21.15.78:0/2580463540 learned_addr learned my addr 172.21.15.78:0/2580463540 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f4337fff640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43380c1eb0 0x7f4338157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.657+0000 7f433cb02640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4338151430 0x7f433806c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f43377fe640 1 -- 172.21.15.78:0/2580463540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43380c1eb0 msgr2=0x7f4338157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f43377fe640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43380c1eb0 0x7f4338157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f43377fe640 1 -- 172.21.15.78:0/2580463540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4338151430 msgr2=0x7f433806c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f43377fe640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4338151430 0x7f433806c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f43377fe640 1 -- 172.21.15.78:0/2580463540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c009420 con 0x7f43380c7d30 2023-10-14T09:17:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f43377fe640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43380c7d30 0x7f43380a44a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f432c0097c0 tx=0x7f432c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f4334ff9640 1 -- 172.21.15.78:0/2580463540 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0abe50 con 0x7f43380c7d30 2023-10-14T09:17:38.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f4334ff9640 1 -- 172.21.15.78:0/2580463540 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c004030 con 0x7f43380c7d30 2023-10-14T09:17:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f4334ff9640 1 -- 172.21.15.78:0/2580463540 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0043e0 con 0x7f43380c7d30 2023-10-14T09:17:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f433e565640 1 -- 172.21.15.78:0/2580463540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4338157bc0 con 0x7f43380c7d30 2023-10-14T09:17:38.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f433e565640 1 -- 172.21.15.78:0/2580463540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43380a49e0 con 0x7f43380c7d30 2023-10-14T09:17:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f433e565640 1 -- 172.21.15.78:0/2580463540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4338152320 con 0x7f43380c7d30 2023-10-14T09:17:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f4334ff9640 1 -- 172.21.15.78:0/2580463540 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f432c0b2040 con 0x7f43380c7d30 2023-10-14T09:17:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f4334ff9640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f43240664a0 0x7f4324068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f4334ff9640 1 -- 172.21.15.78:0/2580463540 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f432c11dad0 con 0x7f43380c7d30 2023-10-14T09:17:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.661+0000 7f4337fff640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f43240664a0 0x7f4324068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.665+0000 7f4337fff640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f43240664a0 0x7f4324068960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f43280011f0 tx=0x7f4328009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.665+0000 7f4334ff9640 1 -- 172.21.15.78:0/2580463540 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f432c0eaff0 con 0x7f43380c7d30 2023-10-14T09:17:38.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.817+0000 7f433e565640 1 -- 172.21.15.78:0/2580463540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4338074180 con 0x7f43380c7d30 2023-10-14T09:17:38.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.817+0000 7f4334ff9640 1 -- 172.21.15.78:0/2580463540 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f432c0b0090 con 0x7f43380c7d30 2023-10-14T09:17:38.820 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:38.820 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:38.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 -- 172.21.15.78:0/2580463540 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f43240664a0 msgr2=0x7f4324068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f43240664a0 0x7f4324068960 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f43280011f0 tx=0x7f4328009040 comp rx=0 tx=0).stop 2023-10-14T09:17:38.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 -- 172.21.15.78:0/2580463540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43380c7d30 msgr2=0x7f43380a44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43380c7d30 0x7f43380a44a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f432c0097c0 tx=0x7f432c0190d0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 -- 172.21.15.78:0/2580463540 shutdown_connections 2023-10-14T09:17:38.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4338151430 0x7f433806c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43380c7d30 0x7f43380a44a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f43240664a0 0x7f4324068960 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 --2- 172.21.15.78:0/2580463540 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f43380c1eb0 0x7f4338157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 -- 172.21.15.78:0/2580463540 >> 172.21.15.78:0/2580463540 conn(0x7f433806a060 msgr2=0x7f4338152880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:38.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 -- 172.21.15.78:0/2580463540 shutdown_connections 2023-10-14T09:17:38.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.821+0000 7f433e565640 1 -- 172.21.15.78:0/2580463540 wait complete. 2023-10-14T09:17:38.840 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:38.841 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:38.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b8609640 1 Processor -- start 2023-10-14T09:17:38.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b8609640 1 -- start start 2023-10-14T09:17:38.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b8609640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90b015b530 0x7f90b015d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b8609640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b00c0310 con 0x7f90b00bbd90 2023-10-14T09:17:38.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b8609640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b0151c90 con 0x7f90b013af90 2023-10-14T09:17:38.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b8609640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00bc1f0 con 0x7f90b015b530 2023-10-14T09:17:38.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b5ba4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f90b00bbd90 0x7f90b006bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47344/0 (socket says 172.21.15.78:47344) 2023-10-14T09:17:38.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b5ba4640 1 -- 172.21.15.78:0/41136198 learned_addr learned my addr 172.21.15.78:0/41136198 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:38.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b6ba6640 1 --2- 172.21.15.78:0/41136198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90b015b530 0x7f90b015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b53a3640 1 -- 172.21.15.78:0/41136198 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688284789 0 0) 0x7f90b00c0310 con 0x7f90b00bbd90 2023-10-14T09:17:38.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b53a3640 1 -- 172.21.15.78:0/41136198 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f909c003530 con 0x7f90b00bbd90 2023-10-14T09:17:38.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b53a3640 1 -- 172.21.15.78:0/41136198 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820786814 0 0) 0x7f90b0151c90 con 0x7f90b013af90 2023-10-14T09:17:38.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b53a3640 1 -- 172.21.15.78:0/41136198 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b00c0310 con 0x7f90b013af90 2023-10-14T09:17:38.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b6ba6640 1 -- 172.21.15.78:0/41136198 >> v1:172.21.15.157:6789/0 conn(0x7f90b013af90 legacy=0x7f90b00bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b6ba6640 1 -- 172.21.15.78:0/41136198 >> v1:172.21.15.78:6789/0 conn(0x7f90b00bbd90 legacy=0x7f90b006bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.981+0000 7f90b6ba6640 1 -- 172.21.15.78:0/41136198 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b00bafd0 con 0x7f90b015b530 2023-10-14T09:17:38.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.985+0000 7f90b6ba6640 1 --2- 172.21.15.78:0/41136198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90b015b530 0x7f90b015d920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009dc0 tx=0x7f90a801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f47ee43a1b7b73b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:38.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.985+0000 7f90b53a3640 1 -- 172.21.15.78:0/41136198 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a80a5890 con 0x7f90b015b530 2023-10-14T09:17:38.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.985+0000 7f90b53a3640 1 -- 172.21.15.78:0/41136198 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a80a59f0 con 0x7f90b015b530 2023-10-14T09:17:38.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.985+0000 7f90b53a3640 1 -- 172.21.15.78:0/41136198 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a80a5d80 con 0x7f90b015b530 2023-10-14T09:17:38.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.985+0000 7f90b8609640 1 -- 172.21.15.78:0/41136198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90b015b530 msgr2=0x7f90b015d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.985+0000 7f90b8609640 1 --2- 172.21.15.78:0/41136198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90b015b530 0x7f90b015d920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009dc0 tx=0x7f90a801c8e0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.985+0000 7f90b8609640 1 -- 172.21.15.78:0/41136198 shutdown_connections 2023-10-14T09:17:38.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.985+0000 7f90b8609640 1 --2- 172.21.15.78:0/41136198 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90b015b530 0x7f90b015d920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.985+0000 7f90b8609640 1 -- 172.21.15.78:0/41136198 >> 172.21.15.78:0/41136198 conn(0x7f90b00c1d00 msgr2=0x7f90b00c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:38.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.985+0000 7f90b8609640 1 -- 172.21.15.78:0/41136198 shutdown_connections 2023-10-14T09:17:38.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.985+0000 7f90b8609640 1 -- 172.21.15.78:0/41136198 wait complete. 2023-10-14T09:17:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b8609640 1 Processor -- start 2023-10-14T09:17:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b8609640 1 -- start start 2023-10-14T09:17:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b8609640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90b00bbd90 0x7f90b00c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b8609640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90b013af90 0x7f90b00bdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b8609640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90b015b530 0x7f90b00be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b8609640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00aa080 con 0x7f90b00bbd90 2023-10-14T09:17:38.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b8609640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00a8fd0 con 0x7f90b013af90 2023-10-14T09:17:38.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b8609640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00be620 con 0x7f90b015b530 2023-10-14T09:17:38.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b63a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90b00bbd90 0x7f90b00c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b63a5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90b00bbd90 0x7f90b00c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38684/0 (socket says 172.21.15.78:38684) 2023-10-14T09:17:38.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b63a5640 1 -- 172.21.15.78:0/2932694021 learned_addr learned my addr 172.21.15.78:0/2932694021 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:38.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b5ba4640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90b013af90 0x7f90b00bdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b6ba6640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90b015b530 0x7f90b00be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:38.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b63a5640 1 -- 172.21.15.78:0/2932694021 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90b015b530 msgr2=0x7f90b00be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b63a5640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90b015b530 0x7f90b00be0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b63a5640 1 -- 172.21.15.78:0/2932694021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90b013af90 msgr2=0x7f90b00bdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:38.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b63a5640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90b013af90 0x7f90b00bdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:38.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b63a5640 1 -- 172.21.15.78:0/2932694021 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8009a70 con 0x7f90b00bbd90 2023-10-14T09:17:38.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b63a5640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90b00bbd90 0x7f90b00c0c70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00c460 tx=0x7f90ac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:38.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90a6ffd640 1 -- 172.21.15.78:0/2932694021 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac0052d0 con 0x7f90b00bbd90 2023-10-14T09:17:38.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90a6ffd640 1 -- 172.21.15.78:0/2932694021 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac005450 con 0x7f90b00bbd90 2023-10-14T09:17:38.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90a6ffd640 1 -- 172.21.15.78:0/2932694021 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac012870 con 0x7f90b00bbd90 2023-10-14T09:17:38.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b8609640 1 -- 172.21.15.78:0/2932694021 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b00a8d60 con 0x7f90b00bbd90 2023-10-14T09:17:38.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b8609640 1 -- 172.21.15.78:0/2932694021 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b00a9d10 con 0x7f90b00bbd90 2023-10-14T09:17:38.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.989+0000 7f90b8609640 1 -- 172.21.15.78:0/2932694021 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b0074110 con 0x7f90b00bbd90 2023-10-14T09:17:38.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.993+0000 7f90a6ffd640 1 -- 172.21.15.78:0/2932694021 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f90ac0129d0 con 0x7f90b00bbd90 2023-10-14T09:17:38.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.993+0000 7f90a6ffd640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90940664a0 0x7f9094068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:38.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.993+0000 7f90a6ffd640 1 -- 172.21.15.78:0/2932694021 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90ac0838b0 con 0x7f90b00bbd90 2023-10-14T09:17:39.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.993+0000 7f90b5ba4640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90940664a0 0x7f9094068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.993+0000 7f90b5ba4640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90940664a0 0x7f9094068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f90b01507a0 tx=0x7f90a0007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:39.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:38.997+0000 7f90a6ffd640 1 -- 172.21.15.78:0/2932694021 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90ac050dd0 con 0x7f90b00bbd90 2023-10-14T09:17:39.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 -- 172.21.15.78:0/2932694021 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90b006c8c0 con 0x7f90b00bbd90 2023-10-14T09:17:39.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90a6ffd640 1 -- 172.21.15.78:0/2932694021 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90ac0543f0 con 0x7f90b00bbd90 2023-10-14T09:17:39.151 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:39.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 -- 172.21.15.78:0/2932694021 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90940664a0 msgr2=0x7f9094068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90940664a0 0x7f9094068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f90b01507a0 tx=0x7f90a0007d40 comp rx=0 tx=0).stop 2023-10-14T09:17:39.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 -- 172.21.15.78:0/2932694021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90b00bbd90 msgr2=0x7f90b00c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90b00bbd90 0x7f90b00c0c70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00c460 tx=0x7f90ac00c920 comp rx=0 tx=0).stop 2023-10-14T09:17:39.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 -- 172.21.15.78:0/2932694021 shutdown_connections 2023-10-14T09:17:39.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f90940664a0 0x7f9094068960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f90b015b530 0x7f90b00be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f90b013af90 0x7f90b00bdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 --2- 172.21.15.78:0/2932694021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90b00bbd90 0x7f90b00c0c70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 -- 172.21.15.78:0/2932694021 >> 172.21.15.78:0/2932694021 conn(0x7f90b00c1d00 msgr2=0x7f90b0139240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 -- 172.21.15.78:0/2932694021 shutdown_connections 2023-10-14T09:17:39.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.149+0000 7f90b8609640 1 -- 172.21.15.78:0/2932694021 wait complete. 2023-10-14T09:17:39.171 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:17:39.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dda0ac640 1 Processor -- start 2023-10-14T09:17:39.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dda0ac640 1 -- start start 2023-10-14T09:17:39.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dda0ac640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8dd40aea80 0x7f8dd40ab040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dda0ac640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8dd406c940 0x7f8dd406b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dda0ac640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd40c3ea0 con 0x7f8dd40c7420 2023-10-14T09:17:39.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dda0ac640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd40c4460 con 0x7f8dd40aea80 2023-10-14T09:17:39.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dda0ac640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd4154680 con 0x7f8dd406c940 2023-10-14T09:17:39.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dd90aa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8dd40aea80 0x7f8dd40ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dd90aa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8dd40aea80 0x7f8dd40ab040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38694/0 (socket says 172.21.15.78:38694) 2023-10-14T09:17:39.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dd90aa640 1 -- 172.21.15.78:0/3721180178 learned_addr learned my addr 172.21.15.78:0/3721180178 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:39.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dd90aa640 1 -- 172.21.15.78:0/3721180178 >> v2:172.21.15.157:3300/0 conn(0x7f8dd406c940 msgr2=0x7f8dd406b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:39.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dd90aa640 1 --2- 172.21.15.78:0/3721180178 >> v2:172.21.15.157:3300/0 conn(0x7f8dd406c940 0x7f8dd406b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dd90aa640 1 -- 172.21.15.78:0/3721180178 >> v1:172.21.15.157:6789/0 conn(0x7f8dd40c7420 legacy=0x7f8dd406b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:39.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.313+0000 7f8dd90aa640 1 -- 172.21.15.78:0/3721180178 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd4154960 con 0x7f8dd40aea80 2023-10-14T09:17:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dd90aa640 1 --2- 172.21.15.78:0/3721180178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dd40aea80 0x7f8dd40ab040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40ca040 tx=0x7f8dd001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398474ff682d277 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dcbfff640 1 -- 172.21.15.78:0/3721180178 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00ad640 con 0x7f8dd40aea80 2023-10-14T09:17:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dcbfff640 1 -- 172.21.15.78:0/3721180178 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd00ad7a0 con 0x7f8dd40aea80 2023-10-14T09:17:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dcbfff640 1 -- 172.21.15.78:0/3721180178 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00adb30 con 0x7f8dd40aea80 2023-10-14T09:17:39.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dda0ac640 1 -- 172.21.15.78:0/3721180178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dd40aea80 msgr2=0x7f8dd40ab040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dda0ac640 1 --2- 172.21.15.78:0/3721180178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dd40aea80 0x7f8dd40ab040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40ca040 tx=0x7f8dd001c370 comp rx=0 tx=0).stop 2023-10-14T09:17:39.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dda0ac640 1 -- 172.21.15.78:0/3721180178 shutdown_connections 2023-10-14T09:17:39.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dda0ac640 1 --2- 172.21.15.78:0/3721180178 >> v2:172.21.15.157:3300/0 conn(0x7f8dd406c940 0x7f8dd406b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dda0ac640 1 --2- 172.21.15.78:0/3721180178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dd40aea80 0x7f8dd40ab040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dda0ac640 1 -- 172.21.15.78:0/3721180178 >> 172.21.15.78:0/3721180178 conn(0x7f8dd40c9520 msgr2=0x7f8dd40c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:39.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dda0ac640 1 -- 172.21.15.78:0/3721180178 shutdown_connections 2023-10-14T09:17:39.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.317+0000 7f8dda0ac640 1 -- 172.21.15.78:0/3721180178 wait complete. 2023-10-14T09:17:39.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dda0ac640 1 Processor -- start 2023-10-14T09:17:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dda0ac640 1 -- start start 2023-10-14T09:17:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dda0ac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dd406c940 0x7f8dd41eca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dda0ac640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dd40aea80 0x7f8dd41efee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dda0ac640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dd40c7420 0x7f8dd40add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dda0ac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd414d160 con 0x7f8dd406c940 2023-10-14T09:17:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dda0ac640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd41f0420 con 0x7f8dd40aea80 2023-10-14T09:17:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dda0ac640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd41ebfb0 con 0x7f8dd40c7420 2023-10-14T09:17:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd90aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dd406c940 0x7f8dd41eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd90aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dd406c940 0x7f8dd41eca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38704/0 (socket says 172.21.15.78:38704) 2023-10-14T09:17:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd90aa640 1 -- 172.21.15.78:0/1605635752 learned_addr learned my addr 172.21.15.78:0/1605635752 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:39.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd90aa640 1 -- 172.21.15.78:0/1605635752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dd40c7420 msgr2=0x7f8dd40add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd98ab640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dd40c7420 0x7f8dd40add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd88a9640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dd40aea80 0x7f8dd41efee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd90aa640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dd40c7420 0x7f8dd40add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd90aa640 1 -- 172.21.15.78:0/1605635752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dd40aea80 msgr2=0x7f8dd41efee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd90aa640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dd40aea80 0x7f8dd41efee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd90aa640 1 -- 172.21.15.78:0/1605635752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd00094d0 con 0x7f8dd406c940 2023-10-14T09:17:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd98ab640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dd40c7420 0x7f8dd40add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd88a9640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dd40aea80 0x7f8dd41efee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dd90aa640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dd406c940 0x7f8dd41eca70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8dd00b0040 tx=0x7f8dd0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dc9ffb640 1 -- 172.21.15.78:0/1605635752 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00b77f0 con 0x7f8dd406c940 2023-10-14T09:17:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dc9ffb640 1 -- 172.21.15.78:0/1605635752 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd00a6040 con 0x7f8dd406c940 2023-10-14T09:17:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dc9ffb640 1 -- 172.21.15.78:0/1605635752 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00b7bb0 con 0x7f8dd406c940 2023-10-14T09:17:39.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dda0ac640 1 -- 172.21.15.78:0/1605635752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd40c0bd0 con 0x7f8dd406c940 2023-10-14T09:17:39.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.321+0000 7f8dda0ac640 1 -- 172.21.15.78:0/1605635752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd41ec270 con 0x7f8dd406c940 2023-10-14T09:17:39.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.325+0000 7f8dda0ac640 1 -- 172.21.15.78:0/1605635752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd40c1080 con 0x7f8dd406c940 2023-10-14T09:17:39.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.325+0000 7f8dc9ffb640 1 -- 172.21.15.78:0/1605635752 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8dd00b7d10 con 0x7f8dd406c940 2023-10-14T09:17:39.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.325+0000 7f8dc9ffb640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8db80664d0 0x7f8db8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.325+0000 7f8dc9ffb640 1 -- 172.21.15.78:0/1605635752 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8dd011ecf0 con 0x7f8dd406c940 2023-10-14T09:17:39.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.325+0000 7f8dd88a9640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8db80664d0 0x7f8db8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.325+0000 7f8dd88a9640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8db80664d0 0x7f8db8068990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8dd415d640 tx=0x7f8dc4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:39.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.329+0000 7f8dc9ffb640 1 -- 172.21.15.78:0/1605635752 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8dd00ec280 con 0x7f8dd406c940 2023-10-14T09:17:39.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 -- 172.21.15.78:0/1605635752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8dd40c1080 con 0x7f8dd406c940 2023-10-14T09:17:39.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dc9ffb640 1 -- 172.21.15.78:0/1605635752 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8dd00b2020 con 0x7f8dd406c940 2023-10-14T09:17:39.482 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:17:39.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 -- 172.21.15.78:0/1605635752 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8db80664d0 msgr2=0x7f8db8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8db80664d0 0x7f8db8068990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8dd415d640 tx=0x7f8dc4008040 comp rx=0 tx=0).stop 2023-10-14T09:17:39.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 -- 172.21.15.78:0/1605635752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dd406c940 msgr2=0x7f8dd41eca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dd406c940 0x7f8dd41eca70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8dd00b0040 tx=0x7f8dd0019110 comp rx=0 tx=0).stop 2023-10-14T09:17:39.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 -- 172.21.15.78:0/1605635752 shutdown_connections 2023-10-14T09:17:39.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f8db80664d0 0x7f8db8068990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8dd40c7420 0x7f8dd40add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8dd40aea80 0x7f8dd41efee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 --2- 172.21.15.78:0/1605635752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8dd406c940 0x7f8dd41eca70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 -- 172.21.15.78:0/1605635752 >> 172.21.15.78:0/1605635752 conn(0x7f8dd40c9520 msgr2=0x7f8dd40ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:39.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 -- 172.21.15.78:0/1605635752 shutdown_connections 2023-10-14T09:17:39.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.481+0000 7f8dda0ac640 1 -- 172.21.15.78:0/1605635752 wait complete. 2023-10-14T09:17:39.502 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:17:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f261db9d640 1 Processor -- start 2023-10-14T09:17:39.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f261db9d640 1 -- start start 2023-10-14T09:17:39.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f261db9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f26180c4030 0x7f26180c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f261db9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f261806cc50 0x7f26180c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f261db9d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26180c7af0 con 0x7f2618153d90 2023-10-14T09:17:39.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f261db9d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26180c5300 con 0x7f261806cc50 2023-10-14T09:17:39.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f261db9d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2618157360 con 0x7f26180c4030 2023-10-14T09:17:39.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f260ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f261806cc50 0x7f26180c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f2617fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2618153d90 0x7f26181541e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47354/0 (socket says 172.21.15.78:47354) 2023-10-14T09:17:39.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f2617fff640 1 -- 172.21.15.78:0/3444561511 learned_addr learned my addr 172.21.15.78:0/3444561511 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:39.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f260ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f261806cc50 0x7f26180c4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38710/0 (socket says 172.21.15.78:38710) 2023-10-14T09:17:39.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f26177fe640 1 --2- 172.21.15.78:0/3444561511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f26180c4030 0x7f26180c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f260ffff640 1 -- 172.21.15.78:0/3444561511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f26180c4030 msgr2=0x7f26180c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:39.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f260ffff640 1 --2- 172.21.15.78:0/3444561511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f26180c4030 0x7f26180c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f260ffff640 1 -- 172.21.15.78:0/3444561511 >> v1:172.21.15.78:6789/0 conn(0x7f2618153d90 legacy=0x7f26181541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f260ffff640 1 -- 172.21.15.78:0/3444561511 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618157ee0 con 0x7f261806cc50 2023-10-14T09:17:39.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f26177fe640 1 --2- 172.21.15.78:0/3444561511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f26180c4030 0x7f26180c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:39.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.641+0000 7f2616ffd640 1 -- 172.21.15.78:0/3444561511 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888036813 0 0) 0x7f26180c7af0 con 0x7f2618153d90 2023-10-14T09:17:39.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f260ffff640 1 --2- 172.21.15.78:0/3444561511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f261806cc50 0x7f26180c4410 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f26000097c0 tx=0x7f260001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6475ba6948c3b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f2616ffd640 1 -- 172.21.15.78:0/3444561511 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26000ab600 con 0x7f261806cc50 2023-10-14T09:17:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f2616ffd640 1 -- 172.21.15.78:0/3444561511 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26000a7050 con 0x7f261806cc50 2023-10-14T09:17:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f2616ffd640 1 -- 172.21.15.78:0/3444561511 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26000ab980 con 0x7f261806cc50 2023-10-14T09:17:39.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f261db9d640 1 -- 172.21.15.78:0/3444561511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f261806cc50 msgr2=0x7f26180c4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f261db9d640 1 --2- 172.21.15.78:0/3444561511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f261806cc50 0x7f26180c4410 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f26000097c0 tx=0x7f260001c3f0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f261db9d640 1 -- 172.21.15.78:0/3444561511 shutdown_connections 2023-10-14T09:17:39.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f261db9d640 1 --2- 172.21.15.78:0/3444561511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f261806cc50 0x7f26180c4410 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f261db9d640 1 --2- 172.21.15.78:0/3444561511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f26180c4030 0x7f26180c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f261db9d640 1 -- 172.21.15.78:0/3444561511 >> 172.21.15.78:0/3444561511 conn(0x7f26180ab240 msgr2=0x7f26180ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:39.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f261db9d640 1 -- 172.21.15.78:0/3444561511 shutdown_connections 2023-10-14T09:17:39.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.645+0000 7f261db9d640 1 -- 172.21.15.78:0/3444561511 wait complete. 2023-10-14T09:17:39.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f261db9d640 1 Processor -- start 2023-10-14T09:17:39.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f261db9d640 1 -- start start 2023-10-14T09:17:39.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f261db9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f261806cc50 0x7f2618150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f261db9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26180c4030 0x7f26180ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f261db9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618153d90 0x7f26180ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f261db9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26181ec8a0 con 0x7f2618153d90 2023-10-14T09:17:39.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f261db9d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26181ebf90 con 0x7f26180c4030 2023-10-14T09:17:39.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f261db9d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26180c2e70 con 0x7f261806cc50 2023-10-14T09:17:39.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2617fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618153d90 0x7f26180ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2617fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618153d90 0x7f26180ac790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38722/0 (socket says 172.21.15.78:38722) 2023-10-14T09:17:39.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2617fff640 1 -- 172.21.15.78:0/633342133 learned_addr learned my addr 172.21.15.78:0/633342133 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:39.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f26177fe640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f261806cc50 0x7f2618150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f260ffff640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26180c4030 0x7f26180ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2617fff640 1 -- 172.21.15.78:0/633342133 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f261806cc50 msgr2=0x7f2618150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2617fff640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f261806cc50 0x7f2618150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2617fff640 1 -- 172.21.15.78:0/633342133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26180c4030 msgr2=0x7f26180ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2617fff640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26180c4030 0x7f26180ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2617fff640 1 -- 172.21.15.78:0/633342133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2600009420 con 0x7f2618153d90 2023-10-14T09:17:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f26177fe640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f261806cc50 0x7f2618150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f260ffff640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26180c4030 0x7f26180ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:39.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2617fff640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618153d90 0x7f26180ac790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f261000c780 tx=0x7f261000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:39.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2614ff9640 1 -- 172.21.15.78:0/633342133 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000ce30 con 0x7f2618153d90 2023-10-14T09:17:39.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2614ff9640 1 -- 172.21.15.78:0/633342133 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261000a640 con 0x7f2618153d90 2023-10-14T09:17:39.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f2614ff9640 1 -- 172.21.15.78:0/633342133 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000a9f0 con 0x7f2618153d90 2023-10-14T09:17:39.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f261db9d640 1 -- 172.21.15.78:0/633342133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26181ec250 con 0x7f2618153d90 2023-10-14T09:17:39.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.649+0000 7f261db9d640 1 -- 172.21.15.78:0/633342133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2618151140 con 0x7f2618153d90 2023-10-14T09:17:39.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.653+0000 7f261db9d640 1 -- 172.21.15.78:0/633342133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26181ec700 con 0x7f2618153d90 2023-10-14T09:17:39.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.653+0000 7f2614ff9640 1 -- 172.21.15.78:0/633342133 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f261000ab50 con 0x7f2618153d90 2023-10-14T09:17:39.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.653+0000 7f2614ff9640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25f80664a0 0x7f25f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.653+0000 7f2614ff9640 1 -- 172.21.15.78:0/633342133 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2610083340 con 0x7f2618153d90 2023-10-14T09:17:39.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.653+0000 7f26177fe640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25f80664a0 0x7f25f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.653+0000 7f26177fe640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25f80664a0 0x7f25f8068960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2608009970 tx=0x7f2608008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:39.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.657+0000 7f2614ff9640 1 -- 172.21.15.78:0/633342133 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f26181ec700 con 0x7f2618153d90 2023-10-14T09:17:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.805+0000 7f261db9d640 1 -- 172.21.15.78:0/633342133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26181eca50 con 0x7f2618153d90 2023-10-14T09:17:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.805+0000 7f2614ff9640 1 -- 172.21.15.78:0/633342133 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26181eca50 con 0x7f2618153d90 2023-10-14T09:17:39.808 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:17:39.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 -- 172.21.15.78:0/633342133 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25f80664a0 msgr2=0x7f25f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25f80664a0 0x7f25f8068960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2608009970 tx=0x7f2608008040 comp rx=0 tx=0).stop 2023-10-14T09:17:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 -- 172.21.15.78:0/633342133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618153d90 msgr2=0x7f26180ac790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618153d90 0x7f26180ac790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f261000c780 tx=0x7f261000cc40 comp rx=0 tx=0).stop 2023-10-14T09:17:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 -- 172.21.15.78:0/633342133 shutdown_connections 2023-10-14T09:17:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2618153d90 0x7f26180ac790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f26180c4030 0x7f26180ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25f80664a0 0x7f25f8068960 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 --2- 172.21.15.78:0/633342133 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f261806cc50 0x7f2618150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 -- 172.21.15.78:0/633342133 >> 172.21.15.78:0/633342133 conn(0x7f26180ab240 msgr2=0x7f26181535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:39.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 -- 172.21.15.78:0/633342133 shutdown_connections 2023-10-14T09:17:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.809+0000 7f261db9d640 1 -- 172.21.15.78:0/633342133 wait complete. 2023-10-14T09:17:39.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:17:39.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5f653e640 1 Processor -- start 2023-10-14T09:17:39.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5f653e640 1 -- start start 2023-10-14T09:17:39.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5f653e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc5f014ddb0 0x7fc5f00c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5f653e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5f0153e80 0x7fc5f006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5f653e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5f00c6910 0x7fc5f00c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5f653e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f00c64f0 con 0x7fc5f0153e80 2023-10-14T09:17:39.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5f653e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f00c5300 con 0x7fc5f014ddb0 2023-10-14T09:17:39.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5f653e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f006c470 con 0x7fc5f00c6910 2023-10-14T09:17:39.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5ef7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5f0153e80 0x7fc5f006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5ef7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5f0153e80 0x7fc5f006bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38730/0 (socket says 172.21.15.78:38730) 2023-10-14T09:17:39.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5ef7fe640 1 -- 172.21.15.78:0/3139935239 learned_addr learned my addr 172.21.15.78:0/3139935239 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:39.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5effff640 1 --2- 172.21.15.78:0/3139935239 >> v2:172.21.15.157:3300/0 conn(0x7fc5f014ddb0 0x7fc5f00c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5f4adb640 1 --2- 172.21.15.78:0/3139935239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5f00c6910 0x7fc5f00c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5ef7fe640 1 -- 172.21.15.78:0/3139935239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5f00c6910 msgr2=0x7fc5f00c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:39.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5ef7fe640 1 --2- 172.21.15.78:0/3139935239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5f00c6910 0x7fc5f00c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5ef7fe640 1 -- 172.21.15.78:0/3139935239 >> v2:172.21.15.157:3300/0 conn(0x7fc5f014ddb0 msgr2=0x7fc5f00c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:39.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5ef7fe640 1 --2- 172.21.15.78:0/3139935239 >> v2:172.21.15.157:3300/0 conn(0x7fc5f014ddb0 0x7fc5f00c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.965+0000 7fc5ef7fe640 1 -- 172.21.15.78:0/3139935239 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f006c750 con 0x7fc5f0153e80 2023-10-14T09:17:39.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5ef7fe640 1 --2- 172.21.15.78:0/3139935239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5f0153e80 0x7fc5f006bb70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00a8d80 tx=0x7fc5e401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4d0eb5dcce23c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:39.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5eeffd640 1 -- 172.21.15.78:0/3139935239 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40ab600 con 0x7fc5f0153e80 2023-10-14T09:17:39.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5eeffd640 1 -- 172.21.15.78:0/3139935239 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e40a7050 con 0x7fc5f0153e80 2023-10-14T09:17:39.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5eeffd640 1 -- 172.21.15.78:0/3139935239 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40ab980 con 0x7fc5f0153e80 2023-10-14T09:17:39.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5f653e640 1 -- 172.21.15.78:0/3139935239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5f0153e80 msgr2=0x7fc5f006bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5f653e640 1 --2- 172.21.15.78:0/3139935239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5f0153e80 0x7fc5f006bb70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00a8d80 tx=0x7fc5e401c3b0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5f653e640 1 -- 172.21.15.78:0/3139935239 shutdown_connections 2023-10-14T09:17:39.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5f653e640 1 --2- 172.21.15.78:0/3139935239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5f0153e80 0x7fc5f006bb70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5f653e640 1 --2- 172.21.15.78:0/3139935239 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5f00c6910 0x7fc5f00c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5f653e640 1 --2- 172.21.15.78:0/3139935239 >> v2:172.21.15.157:3300/0 conn(0x7fc5f014ddb0 0x7fc5f00c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5f653e640 1 -- 172.21.15.78:0/3139935239 >> 172.21.15.78:0/3139935239 conn(0x7fc5f00ab1f0 msgr2=0x7fc5f00ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:39.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5f653e640 1 -- 172.21.15.78:0/3139935239 shutdown_connections 2023-10-14T09:17:39.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.969+0000 7fc5f653e640 1 -- 172.21.15.78:0/3139935239 wait complete. 2023-10-14T09:17:39.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f653e640 1 Processor -- start 2023-10-14T09:17:39.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f653e640 1 -- start start 2023-10-14T09:17:39.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f653e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5f00c6910 0x7fc5f014be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f653e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5f014ddb0 0x7fc5f01f0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f653e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5f0153e80 0x7fc5f01463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f653e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f0156d70 con 0x7fc5f00c6910 2023-10-14T09:17:39.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f653e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f0157050 con 0x7fc5f0153e80 2023-10-14T09:17:39.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f653e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00bc570 con 0x7fc5f014ddb0 2023-10-14T09:17:39.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5f00c6910 0x7fc5f014be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5f00c6910 0x7fc5f014be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38734/0 (socket says 172.21.15.78:38734) 2023-10-14T09:17:39.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5effff640 1 -- 172.21.15.78:0/1389199459 learned_addr learned my addr 172.21.15.78:0/1389199459 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:39.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f4adb640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5f0153e80 0x7fc5f01463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5ef7fe640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5f014ddb0 0x7fc5f01f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5effff640 1 -- 172.21.15.78:0/1389199459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5f014ddb0 msgr2=0x7fc5f01f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5effff640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5f014ddb0 0x7fc5f01f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5effff640 1 -- 172.21.15.78:0/1389199459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5f0153e80 msgr2=0x7fc5f01463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:39.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5effff640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5f0153e80 0x7fc5f01463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:39.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5effff640 1 -- 172.21.15.78:0/1389199459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e40094d0 con 0x7fc5f00c6910 2023-10-14T09:17:39.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5ef7fe640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5f014ddb0 0x7fc5f01f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:39.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f4adb640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5f0153e80 0x7fc5f01463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:39.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5effff640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5f00c6910 0x7fc5f014be50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000d800 tx=0x7fc5e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:39.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5ecff9640 1 -- 172.21.15.78:0/1389199459 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000b6c0 con 0x7fc5f00c6910 2023-10-14T09:17:39.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5ecff9640 1 -- 172.21.15.78:0/1389199459 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e000b820 con 0x7fc5f00c6910 2023-10-14T09:17:39.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f653e640 1 -- 172.21.15.78:0/1389199459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f00bc850 con 0x7fc5f00c6910 2023-10-14T09:17:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5ecff9640 1 -- 172.21.15.78:0/1389199459 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000bb90 con 0x7fc5f00c6910 2023-10-14T09:17:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f653e640 1 -- 172.21.15.78:0/1389199459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f0155080 con 0x7fc5f00c6910 2023-10-14T09:17:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.973+0000 7fc5f653e640 1 -- 172.21.15.78:0/1389199459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f0074180 con 0x7fc5f00c6910 2023-10-14T09:17:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.977+0000 7fc5ecff9640 1 -- 172.21.15.78:0/1389199459 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc5e000bcf0 con 0x7fc5f00c6910 2023-10-14T09:17:39.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.977+0000 7fc5ecff9640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5dc0664a0 0x7fc5dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.977+0000 7fc5ecff9640 1 -- 172.21.15.78:0/1389199459 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5e0084380 con 0x7fc5f00c6910 2023-10-14T09:17:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.977+0000 7fc5ef7fe640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5dc0664a0 0x7fc5dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:39.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.977+0000 7fc5ef7fe640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5dc0664a0 0x7fc5dc068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40ad000 tx=0x7fc5e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:39.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:39.981+0000 7fc5ecff9640 1 -- 172.21.15.78:0/1389199459 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc5e0051890 con 0x7fc5f00c6910 2023-10-14T09:17:40.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.165+0000 7fc5f653e640 1 -- 172.21.15.78:0/1389199459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5f00bca40 con 0x7fc5f00c6910 2023-10-14T09:17:40.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5ecff9640 1 -- 172.21.15.78:0/1389199459 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fc5e0011340 con 0x7fc5f00c6910 2023-10-14T09:17:40.169 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:40.169 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1987032053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1987032053},{"type":"v1","addr":"172.21.15.157:6834","nonce":1987032053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/20028755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":20028755},{"type":"v1","addr":"172.21.15.78:6836","nonce":20028755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3671283338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3671283338},{"type":"v1","addr":"172.21.15.78:6837","nonce":3671283338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:17:25.006130+0000","modified":"2023-10-14T09:17:28.036173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/3774780175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3774780175},{"type":"v1","addr":"172.21.15.157:6835","nonce":3774780175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:17:40.170 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-10-14T09:17:40.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 -- 172.21.15.78:0/1389199459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5dc0664a0 msgr2=0x7fc5dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5dc0664a0 0x7fc5dc068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40ad000 tx=0x7fc5e4008040 comp rx=0 tx=0).stop 2023-10-14T09:17:40.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 -- 172.21.15.78:0/1389199459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5f00c6910 msgr2=0x7fc5f014be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5f00c6910 0x7fc5f014be50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000d800 tx=0x7fc5e000dcc0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 -- 172.21.15.78:0/1389199459 shutdown_connections 2023-10-14T09:17:40.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5f0153e80 0x7fc5f01463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5dc0664a0 0x7fc5dc068960 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc5f014ddb0 0x7fc5f01f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 --2- 172.21.15.78:0/1389199459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5f00c6910 0x7fc5f014be50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 -- 172.21.15.78:0/1389199459 >> 172.21.15.78:0/1389199459 conn(0x7fc5f00ab1f0 msgr2=0x7fc5f00aa930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:40.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 -- 172.21.15.78:0/1389199459 shutdown_connections 2023-10-14T09:17:40.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.169+0000 7fc5f653e640 1 -- 172.21.15.78:0/1389199459 wait complete. 2023-10-14T09:17:40.190 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:40.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.325+0000 7f40df79d640 1 Processor -- start 2023-10-14T09:17:40.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.325+0000 7f40df79d640 1 -- start start 2023-10-14T09:17:40.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40df79d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f40d814e0f0 0x7f40d8152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40df79d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40d8150a90 0x7f40d8150e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40df79d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d81531d0 con 0x7f40d814ed10 2023-10-14T09:17:40.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40df79d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d8153e50 con 0x7f40d8150a90 2023-10-14T09:17:40.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40df79d640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d81534b0 con 0x7f40d814e0f0 2023-10-14T09:17:40.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40ddd3a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40d8150a90 0x7f40d8150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40ddd3a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f40d8150a90 0x7f40d8150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38744/0 (socket says 172.21.15.78:38744) 2023-10-14T09:17:40.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40ddd3a640 1 -- 172.21.15.78:0/3318440715 learned_addr learned my addr 172.21.15.78:0/3318440715 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:40.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40dd539640 1 --2- 172.21.15.78:0/3318440715 >> v2:172.21.15.157:3300/0 conn(0x7f40d814e0f0 0x7f40d8152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40ddd3a640 1 -- 172.21.15.78:0/3318440715 >> v2:172.21.15.157:3300/0 conn(0x7f40d814e0f0 msgr2=0x7f40d8152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:40.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40ddd3a640 1 --2- 172.21.15.78:0/3318440715 >> v2:172.21.15.157:3300/0 conn(0x7f40d814e0f0 0x7f40d8152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40ddd3a640 1 -- 172.21.15.78:0/3318440715 >> v1:172.21.15.157:6789/0 conn(0x7f40d814ed10 legacy=0x7f40d814f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:40.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.329+0000 7f40ddd3a640 1 -- 172.21.15.78:0/3318440715 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d8153790 con 0x7f40d8150a90 2023-10-14T09:17:40.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40ddd3a640 1 --2- 172.21.15.78:0/3318440715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d8150a90 0x7f40d8150e70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40d80c16f0 tx=0x7f40d001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82225da233db47db server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:40.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40cffff640 1 -- 172.21.15.78:0/3318440715 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00a5690 con 0x7f40d8150a90 2023-10-14T09:17:40.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40cffff640 1 -- 172.21.15.78:0/3318440715 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d00a57f0 con 0x7f40d8150a90 2023-10-14T09:17:40.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40cffff640 1 -- 172.21.15.78:0/3318440715 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00a5b80 con 0x7f40d8150a90 2023-10-14T09:17:40.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 -- 172.21.15.78:0/3318440715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d8150a90 msgr2=0x7f40d8150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 --2- 172.21.15.78:0/3318440715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d8150a90 0x7f40d8150e70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40d80c16f0 tx=0x7f40d001c900 comp rx=0 tx=0).stop 2023-10-14T09:17:40.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 -- 172.21.15.78:0/3318440715 shutdown_connections 2023-10-14T09:17:40.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 --2- 172.21.15.78:0/3318440715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d8150a90 0x7f40d8150e70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 --2- 172.21.15.78:0/3318440715 >> v2:172.21.15.157:3300/0 conn(0x7f40d814e0f0 0x7f40d8152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 -- 172.21.15.78:0/3318440715 >> 172.21.15.78:0/3318440715 conn(0x7f40d80c1cc0 msgr2=0x7f40d80c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:40.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 -- 172.21.15.78:0/3318440715 shutdown_connections 2023-10-14T09:17:40.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 -- 172.21.15.78:0/3318440715 wait complete. 2023-10-14T09:17:40.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 Processor -- start 2023-10-14T09:17:40.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 -- start start 2023-10-14T09:17:40.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d814e0f0 0x7f40d81edc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d814ed10 0x7f40d80c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40d8150a90 0x7f40d81e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8143bc0 con 0x7f40d814e0f0 2023-10-14T09:17:40.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8071230 con 0x7f40d814ed10 2023-10-14T09:17:40.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.333+0000 7f40df79d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8143690 con 0x7f40d8150a90 2023-10-14T09:17:40.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40dd539640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d814e0f0 0x7f40d81edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40dd539640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d814e0f0 0x7f40d81edc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38746/0 (socket says 172.21.15.78:38746) 2023-10-14T09:17:40.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40dd539640 1 -- 172.21.15.78:0/1110770719 learned_addr learned my addr 172.21.15.78:0/1110770719 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:40.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40ddd3a640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40d8150a90 0x7f40d81e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40dcd38640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d814ed10 0x7f40d80c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40dd539640 1 -- 172.21.15.78:0/1110770719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40d8150a90 msgr2=0x7f40d81e9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40dd539640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40d8150a90 0x7f40d81e9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40dd539640 1 -- 172.21.15.78:0/1110770719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d814ed10 msgr2=0x7f40d80c2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40dd539640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d814ed10 0x7f40d80c2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40dd539640 1 -- 172.21.15.78:0/1110770719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0009b30 con 0x7f40d814e0f0 2023-10-14T09:17:40.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40dcd38640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d814ed10 0x7f40d80c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:40.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40dd539640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d814e0f0 0x7f40d81edc80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f40d400d5f0 tx=0x7f40d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:40.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40cdffb640 1 -- 172.21.15.78:0/1110770719 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d40125f0 con 0x7f40d814e0f0 2023-10-14T09:17:40.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40cdffb640 1 -- 172.21.15.78:0/1110770719 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d4012750 con 0x7f40d814e0f0 2023-10-14T09:17:40.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40df79d640 1 -- 172.21.15.78:0/1110770719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d81ed7f0 con 0x7f40d814e0f0 2023-10-14T09:17:40.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40cdffb640 1 -- 172.21.15.78:0/1110770719 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4012ae0 con 0x7f40d814e0f0 2023-10-14T09:17:40.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40df79d640 1 -- 172.21.15.78:0/1110770719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d81ee210 con 0x7f40d814e0f0 2023-10-14T09:17:40.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40df79d640 1 -- 172.21.15.78:0/1110770719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d8074180 con 0x7f40d814e0f0 2023-10-14T09:17:40.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40cdffb640 1 -- 172.21.15.78:0/1110770719 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f40d4012c40 con 0x7f40d814e0f0 2023-10-14T09:17:40.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.337+0000 7f40cdffb640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f40bc0664a0 0x7f40bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.341+0000 7f40cdffb640 1 -- 172.21.15.78:0/1110770719 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40d40842a0 con 0x7f40d814e0f0 2023-10-14T09:17:40.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.341+0000 7f40dcd38640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f40bc0664a0 0x7f40bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.341+0000 7f40dcd38640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f40bc0664a0 0x7f40bc068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40d815a690 tx=0x7f40c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:40.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.345+0000 7f40cdffb640 1 -- 172.21.15.78:0/1110770719 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f40d4051710 con 0x7f40d814e0f0 2023-10-14T09:17:40.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.493+0000 7f40df79d640 1 -- 172.21.15.78:0/1110770719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40d80c0230 con 0x7f40d814e0f0 2023-10-14T09:17:40.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.493+0000 7f40cdffb640 1 -- 172.21.15.78:0/1110770719 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f40d4054d30 con 0x7f40d814e0f0 2023-10-14T09:17:40.497 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:40.497 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 -- 172.21.15.78:0/1110770719 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f40bc0664a0 msgr2=0x7f40bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f40bc0664a0 0x7f40bc068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40d815a690 tx=0x7f40c8008040 comp rx=0 tx=0).stop 2023-10-14T09:17:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 -- 172.21.15.78:0/1110770719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d814e0f0 msgr2=0x7f40d81edc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d814e0f0 0x7f40d81edc80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f40d400d5f0 tx=0x7f40d400dab0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 -- 172.21.15.78:0/1110770719 shutdown_connections 2023-10-14T09:17:40.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f40bc0664a0 0x7f40bc068960 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f40d8150a90 0x7f40d81e9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40d814ed10 0x7f40d80c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 --2- 172.21.15.78:0/1110770719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40d814e0f0 0x7f40d81edc80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 -- 172.21.15.78:0/1110770719 >> 172.21.15.78:0/1110770719 conn(0x7f40d80c1cc0 msgr2=0x7f40d8145df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:40.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 -- 172.21.15.78:0/1110770719 shutdown_connections 2023-10-14T09:17:40.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.497+0000 7f40df79d640 1 -- 172.21.15.78:0/1110770719 wait complete. 2023-10-14T09:17:40.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:17:40.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.653+0000 7f141e949640 1 Processor -- start 2023-10-14T09:17:40.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.653+0000 7f141e949640 1 -- start start 2023-10-14T09:17:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141e949640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1418151200 0x7f14180c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141e949640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f14180c73b0 0x7f1418153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141e949640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14181515e0 con 0x7f14180c4370 2023-10-14T09:17:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141e949640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1418157b60 con 0x7f14180c73b0 2023-10-14T09:17:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141e949640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1418157d60 con 0x7f1418151200 2023-10-14T09:17:40.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141d146640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f14180c73b0 0x7f1418153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141d146640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f14180c73b0 0x7f1418153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38752/0 (socket says 172.21.15.78:38752) 2023-10-14T09:17:40.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141d146640 1 -- 172.21.15.78:0/553362791 learned_addr learned my addr 172.21.15.78:0/553362791 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:40.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141d947640 1 --2- 172.21.15.78:0/553362791 >> v2:172.21.15.157:3300/0 conn(0x7f1418151200 0x7f14180c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141d146640 1 -- 172.21.15.78:0/553362791 >> v2:172.21.15.157:3300/0 conn(0x7f1418151200 msgr2=0x7f14180c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:40.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141d146640 1 --2- 172.21.15.78:0/553362791 >> v2:172.21.15.157:3300/0 conn(0x7f1418151200 0x7f14180c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141d146640 1 -- 172.21.15.78:0/553362791 >> v1:172.21.15.157:6789/0 conn(0x7f14180c4370 legacy=0x7f1418154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:40.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141d146640 1 -- 172.21.15.78:0/553362791 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14180c64c0 con 0x7f14180c73b0 2023-10-14T09:17:40.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.657+0000 7f141d947640 1 --2- 172.21.15.78:0/553362791 >> v2:172.21.15.157:3300/0 conn(0x7f1418151200 0x7f14180c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141d146640 1 --2- 172.21.15.78:0/553362791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14180c73b0 0x7f1418153bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f141806bcc0 tx=0x7f140801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce55c51788e399a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141c945640 1 -- 172.21.15.78:0/553362791 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080ab600 con 0x7f14180c73b0 2023-10-14T09:17:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141c945640 1 -- 172.21.15.78:0/553362791 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14080a7050 con 0x7f14180c73b0 2023-10-14T09:17:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141c945640 1 -- 172.21.15.78:0/553362791 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080ab980 con 0x7f14180c73b0 2023-10-14T09:17:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141e949640 1 -- 172.21.15.78:0/553362791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14180c73b0 msgr2=0x7f1418153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141e949640 1 --2- 172.21.15.78:0/553362791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14180c73b0 0x7f1418153bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f141806bcc0 tx=0x7f140801c3a0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141e949640 1 -- 172.21.15.78:0/553362791 shutdown_connections 2023-10-14T09:17:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141e949640 1 --2- 172.21.15.78:0/553362791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14180c73b0 0x7f1418153bc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141e949640 1 --2- 172.21.15.78:0/553362791 >> v2:172.21.15.157:3300/0 conn(0x7f1418151200 0x7f14180c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141e949640 1 -- 172.21.15.78:0/553362791 >> 172.21.15.78:0/553362791 conn(0x7f14180719c0 msgr2=0x7f1418071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141e949640 1 -- 172.21.15.78:0/553362791 shutdown_connections 2023-10-14T09:17:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141e949640 1 -- 172.21.15.78:0/553362791 wait complete. 2023-10-14T09:17:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141e949640 1 Processor -- start 2023-10-14T09:17:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.661+0000 7f141e949640 1 -- start start 2023-10-14T09:17:40.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141e949640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14180c4370 0x7f1418151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141e949640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14180c73b0 0x7f14181535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141e949640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1418151200 0x7f1418147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141e949640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418152a90 con 0x7f14180c73b0 2023-10-14T09:17:40.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141e949640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14181ebbd0 con 0x7f1418151200 2023-10-14T09:17:40.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141e949640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14181482e0 con 0x7f14180c4370 2023-10-14T09:17:40.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141d146640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14180c73b0 0x7f14181535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141d947640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14180c4370 0x7f1418151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141d146640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14180c73b0 0x7f14181535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38760/0 (socket says 172.21.15.78:38760) 2023-10-14T09:17:40.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141d947640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14180c4370 0x7f1418151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:40664/0 (socket says 172.21.15.78:40664) 2023-10-14T09:17:40.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141d146640 1 -- 172.21.15.78:0/3067131949 learned_addr learned my addr 172.21.15.78:0/3067131949 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:40.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141e148640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1418151200 0x7f1418147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141d146640 1 -- 172.21.15.78:0/3067131949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14180c4370 msgr2=0x7f1418151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141d146640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14180c4370 0x7f1418151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141d146640 1 -- 172.21.15.78:0/3067131949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1418151200 msgr2=0x7f1418147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141d146640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1418151200 0x7f1418147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141d146640 1 -- 172.21.15.78:0/3067131949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080094d0 con 0x7f14180c73b0 2023-10-14T09:17:40.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141e148640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1418151200 0x7f1418147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:40.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141d146640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14180c73b0 0x7f14181535c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f14080ae040 tx=0x7f1408019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:40.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f140e7fc640 1 -- 172.21.15.78:0/3067131949 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080b37d0 con 0x7f14180c73b0 2023-10-14T09:17:40.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f140e7fc640 1 -- 172.21.15.78:0/3067131949 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14080b3950 con 0x7f14180c73b0 2023-10-14T09:17:40.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141e949640 1 -- 172.21.15.78:0/3067131949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14181efc80 con 0x7f14180c73b0 2023-10-14T09:17:40.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f140e7fc640 1 -- 172.21.15.78:0/3067131949 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080b3d00 con 0x7f14180c73b0 2023-10-14T09:17:40.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141e949640 1 -- 172.21.15.78:0/3067131949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141814b870 con 0x7f14180c73b0 2023-10-14T09:17:40.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f141e949640 1 -- 172.21.15.78:0/3067131949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14180679c0 con 0x7f14180c73b0 2023-10-14T09:17:40.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.665+0000 7f140e7fc640 1 -- 172.21.15.78:0/3067131949 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f14080b2070 con 0x7f14180c73b0 2023-10-14T09:17:40.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.669+0000 7f140e7fc640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f13fc0664a0 0x7f13fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:40.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.669+0000 7f140e7fc640 1 -- 172.21.15.78:0/3067131949 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f140811e0e0 con 0x7f14180c73b0 2023-10-14T09:17:40.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.669+0000 7f141d947640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f13fc0664a0 0x7f13fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:40.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.669+0000 7f141d947640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f13fc0664a0 0x7f13fc068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1418146060 tx=0x7f1414008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:40.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.673+0000 7f140e7fc640 1 -- 172.21.15.78:0/3067131949 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14080eb550 con 0x7f14180c73b0 2023-10-14T09:17:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.853+0000 7f141e949640 1 -- 172.21.15.78:0/3067131949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1418151aa0 con 0x7f14180c73b0 2023-10-14T09:17:40.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.853+0000 7f140e7fc640 1 -- 172.21.15.78:0/3067131949 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f1418151aa0 con 0x7f14180c73b0 2023-10-14T09:17:40.855 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:40.856 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1987032053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1987032053},{"type":"v1","addr":"172.21.15.157:6834","nonce":1987032053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/20028755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":20028755},{"type":"v1","addr":"172.21.15.78:6836","nonce":20028755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3671283338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3671283338},{"type":"v1","addr":"172.21.15.78:6837","nonce":3671283338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:17:25.006130+0000","modified":"2023-10-14T09:17:28.036173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/3774780175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3774780175},{"type":"v1","addr":"172.21.15.157:6835","nonce":3774780175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:17:40.856 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-10-14T09:17:40.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 -- 172.21.15.78:0/3067131949 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f13fc0664a0 msgr2=0x7f13fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f13fc0664a0 0x7f13fc068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1418146060 tx=0x7f1414008040 comp rx=0 tx=0).stop 2023-10-14T09:17:40.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 -- 172.21.15.78:0/3067131949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14180c73b0 msgr2=0x7f14181535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:40.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14180c73b0 0x7f14181535c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f14080ae040 tx=0x7f1408019140 comp rx=0 tx=0).stop 2023-10-14T09:17:40.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 -- 172.21.15.78:0/3067131949 shutdown_connections 2023-10-14T09:17:40.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1418151200 0x7f1418147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14180c73b0 0x7f14181535c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f13fc0664a0 0x7f13fc068960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 --2- 172.21.15.78:0/3067131949 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14180c4370 0x7f1418151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 -- 172.21.15.78:0/3067131949 >> 172.21.15.78:0/3067131949 conn(0x7f14180719c0 msgr2=0x7f1418156920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 -- 172.21.15.78:0/3067131949 shutdown_connections 2023-10-14T09:17:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:40.857+0000 7f141e949640 1 -- 172.21.15.78:0/3067131949 wait complete. 2023-10-14T09:17:41.278 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T09:17:25.006130+0000', 'modified': '2023-10-14T09:17:28.036173+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.157:6835/3774780175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6833', 'nonce': 3774780175}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 3774780175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T09:17:41.279 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T09:17:41.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-14T09:17:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94f75b8640 1 Processor -- start 2023-10-14T09:17:41.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94f75b8640 1 -- start start 2023-10-14T09:17:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94f75b8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f94f0153e80 0x7f94f00c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94f75b8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f006c470 con 0x7f94f014ddb0 2023-10-14T09:17:41.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94f75b8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f006c750 con 0x7f94f00c6910 2023-10-14T09:17:41.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94f75b8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f00c64f0 con 0x7f94f0153e80 2023-10-14T09:17:41.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94f5354640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f94f014ddb0 0x7f94f006bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47358/0 (socket says 172.21.15.78:47358) 2023-10-14T09:17:41.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94f5354640 1 -- 172.21.15.78:0/368577464 learned_addr learned my addr 172.21.15.78:0/368577464 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:41.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219712048 0 0) 0x7f94f006c470 con 0x7f94f014ddb0 2023-10-14T09:17:41.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94f4b53640 1 --2- 172.21.15.78:0/368577464 >> v2:172.21.15.157:3300/0 conn(0x7f94f0153e80 0x7f94f00c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94dc003530 con 0x7f94f014ddb0 2023-10-14T09:17:41.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835081904 0 0) 0x7f94dc003530 con 0x7f94f014ddb0 2023-10-14T09:17:41.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 >> v2:172.21.15.157:3300/0 conn(0x7f94f0153e80 msgr2=0x7f94f00c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 --2- 172.21.15.78:0/368577464 >> v2:172.21.15.157:3300/0 conn(0x7f94f0153e80 0x7f94f00c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 >> v1:172.21.15.157:6789/0 conn(0x7f94f00c6910 legacy=0x7f94f00c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f006ca30 con 0x7f94f014ddb0 2023-10-14T09:17:41.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f94ec001680 con 0x7f94f014ddb0 2023-10-14T09:17:41.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 >> v1:172.21.15.78:6789/0 conn(0x7f94f014ddb0 legacy=0x7f94f006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94dc003980 0x7f94dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94dc0047d0 0x7f94dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94dc005390 0x7f94dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f00c64f0 con 0x7f94dc0047d0 2023-10-14T09:17:41.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc00c220 con 0x7f94dc005390 2023-10-14T09:17:41.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.417+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc00c3e0 con 0x7f94dc003980 2023-10-14T09:17:41.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94f4b53640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94dc0047d0 0x7f94dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94f5354640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94dc003980 0x7f94dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94f5b55640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94dc005390 0x7f94dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94f4b53640 1 -- 172.21.15.78:0/368577464 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94dc003980 msgr2=0x7f94dc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94f4b53640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94dc003980 0x7f94dc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94f4b53640 1 -- 172.21.15.78:0/368577464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94dc005390 msgr2=0x7f94dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94f4b53640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94dc005390 0x7f94dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94f4b53640 1 -- 172.21.15.78:0/368577464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc003530 con 0x7f94dc0047d0 2023-10-14T09:17:41.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94f5b55640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94dc005390 0x7f94dc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:41.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94f5b55640 1 -- 172.21.15.78:0/368577464 reap_dead start 2023-10-14T09:17:41.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94f4b53640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94dc0047d0 0x7f94dc004c50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f94e000ba30 tx=0x7f94e001c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fbffa542ababb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:41.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00ae410 con 0x7f94dc0047d0 2023-10-14T09:17:41.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e00a8030 con 0x7f94dc0047d0 2023-10-14T09:17:41.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.421+0000 7f94e7fff640 1 -- 172.21.15.78:0/368577464 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00ae7b0 con 0x7f94dc0047d0 2023-10-14T09:17:41.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 -- 172.21.15.78:0/368577464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94dc0047d0 msgr2=0x7f94dc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94dc0047d0 0x7f94dc004c50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f94e000ba30 tx=0x7f94e001c680 comp rx=0 tx=0).stop 2023-10-14T09:17:41.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 -- 172.21.15.78:0/368577464 shutdown_connections 2023-10-14T09:17:41.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 --2- 172.21.15.78:0/368577464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94dc0047d0 0x7f94dc004c50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 -- 172.21.15.78:0/368577464 >> 172.21.15.78:0/368577464 conn(0x7f94f00ab1f0 msgr2=0x7f94f00ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:41.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 -- 172.21.15.78:0/368577464 shutdown_connections 2023-10-14T09:17:41.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 -- 172.21.15.78:0/368577464 wait complete. 2023-10-14T09:17:41.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 Processor -- start 2023-10-14T09:17:41.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 -- start start 2023-10-14T09:17:41.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94dc0047d0 0x7f94f01ef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94f00c2840 0x7f94f014bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94f01ec640 0x7f94f01ecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f01579c0 con 0x7f94f01ec640 2023-10-14T09:17:41.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f01f0400 con 0x7f94f00c2840 2023-10-14T09:17:41.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f75b8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f01efb60 con 0x7f94dc0047d0 2023-10-14T09:17:41.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f5b55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94f01ec640 0x7f94f01ecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f5b55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94f01ec640 0x7f94f01ecaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38788/0 (socket says 172.21.15.78:38788) 2023-10-14T09:17:41.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f5b55640 1 -- 172.21.15.78:0/3568090575 learned_addr learned my addr 172.21.15.78:0/3568090575 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:41.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f4b53640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94f00c2840 0x7f94f014bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f5354640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94dc0047d0 0x7f94f01ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f5b55640 1 -- 172.21.15.78:0/3568090575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94dc0047d0 msgr2=0x7f94f01ef580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f5b55640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94dc0047d0 0x7f94f01ef580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f5b55640 1 -- 172.21.15.78:0/3568090575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94f00c2840 msgr2=0x7f94f014bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f5b55640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94f00c2840 0x7f94f014bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f5b55640 1 -- 172.21.15.78:0/3568090575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f01efe40 con 0x7f94f01ec640 2023-10-14T09:17:41.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.425+0000 7f94f5b55640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94f01ec640 0x7f94f01ecaa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f94f0154260 tx=0x7f94e800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:41.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94e5ffb640 1 -- 172.21.15.78:0/3568090575 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e800eed0 con 0x7f94f01ec640 2023-10-14T09:17:41.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94e5ffb640 1 -- 172.21.15.78:0/3568090575 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e8003980 con 0x7f94f01ec640 2023-10-14T09:17:41.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94e5ffb640 1 -- 172.21.15.78:0/3568090575 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8003cf0 con 0x7f94f01ec640 2023-10-14T09:17:41.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94f75b8640 1 -- 172.21.15.78:0/3568090575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f01f0120 con 0x7f94f01ec640 2023-10-14T09:17:41.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94f75b8640 1 -- 172.21.15.78:0/3568090575 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f014c280 con 0x7f94f01ec640 2023-10-14T09:17:41.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94e5ffb640 1 -- 172.21.15.78:0/3568090575 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f94e80050d0 con 0x7f94f01ec640 2023-10-14T09:17:41.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94e5ffb640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94d40664d0 0x7f94d4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94e5ffb640 1 -- 172.21.15.78:0/3568090575 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94e8083b20 con 0x7f94f01ec640 2023-10-14T09:17:41.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94f5354640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94d40664d0 0x7f94d4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94fa945000 1 Processor -- start 2023-10-14T09:17:41.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94f5354640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94d40664d0 0x7f94d4068990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0010f0 tx=0x7f94ec001be0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:41.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.429+0000 7f94fa945000 1 -- start start 2023-10-14T09:17:41.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f979ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97a530 0x55909f97a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909f97b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909f771cc0 con 0x55909f9b7d70 2023-10-14T09:17:41.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909f7d4920 con 0x55909f97ae50 2023-10-14T09:17:41.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55909f7d1e50 con 0x55909f97a530 2023-10-14T09:17:41.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94f5354640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f979ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94f5354640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f979ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38796/0 (socket says 172.21.15.78:38796) 2023-10-14T09:17:41.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94f5354640 1 -- 172.21.15.78:0/2644922349 learned_addr learned my addr 172.21.15.78:0/2644922349 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:41.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94f5b55640 1 --2- 172.21.15.78:0/2644922349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909f97b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94f4b53640 1 --2- 172.21.15.78:0/2644922349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97a530 0x55909f97a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94f5354640 1 -- 172.21.15.78:0/2644922349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97a530 msgr2=0x55909f97a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94f5354640 1 --2- 172.21.15.78:0/2644922349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97a530 0x55909f97a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94f5354640 1 -- 172.21.15.78:0/2644922349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 msgr2=0x55909f97b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94f5354640 1 --2- 172.21.15.78:0/2644922349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909f97b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94f5354640 1 -- 172.21.15.78:0/2644922349 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55909f4c6890 con 0x55909f9b7d70 2023-10-14T09:17:41.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94f5354640 1 --2- 172.21.15.78:0/2644922349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f979ff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0014d0 tx=0x7f94ec00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223e43a6c29e680d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:41.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94d2ffd640 1 -- 172.21.15.78:0/2644922349 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec01a040 con 0x55909f9b7d70 2023-10-14T09:17:41.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94d2ffd640 1 -- 172.21.15.78:0/2644922349 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec0159c0 con 0x55909f9b7d70 2023-10-14T09:17:41.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94d2ffd640 1 -- 172.21.15.78:0/2644922349 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec015d30 con 0x55909f9b7d70 2023-10-14T09:17:41.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 -- 172.21.15.78:0/2644922349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 msgr2=0x55909f979ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 --2- 172.21.15.78:0/2644922349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f979ff0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0014d0 tx=0x7f94ec00c000 comp rx=0 tx=0).stop 2023-10-14T09:17:41.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 -- 172.21.15.78:0/2644922349 shutdown_connections 2023-10-14T09:17:41.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 --2- 172.21.15.78:0/2644922349 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909f97b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 --2- 172.21.15.78:0/2644922349 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97a530 0x55909f97a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 --2- 172.21.15.78:0/2644922349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f979ff0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 -- 172.21.15.78:0/2644922349 >> 172.21.15.78:0/2644922349 conn(0x55909f982c90 msgr2=0x55909f9ba5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:41.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 -- 172.21.15.78:0/2644922349 shutdown_connections 2023-10-14T09:17:41.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 -- 172.21.15.78:0/2644922349 wait complete. 2023-10-14T09:17:41.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 -- start start 2023-10-14T09:17:41.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.433+0000 7f94fa945000 1 Processor -- start 2023-10-14T09:17:41.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97a530 0x55909f9b6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909f9b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f97da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909f7cd740 con 0x55909f9b7d70 2023-10-14T09:17:41.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909f78cd10 con 0x55909f97ae50 2023-10-14T09:17:41.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55909f78c9b0 con 0x55909f97a530 2023-10-14T09:17:41.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 10 client.0 _ll_register_callbacks cb 0x55909f968390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:17:41.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5b55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f97da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5b55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f97da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38798/0 (socket says 172.21.15.78:38798) 2023-10-14T09:17:41.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5b55640 1 -- 172.21.15.78:0/923789825 learned_addr learned my addr 172.21.15.78:0/923789825 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:41.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5354640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97a530 0x55909f9b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f4b53640 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909f9b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5b55640 1 -- 172.21.15.78:0/923789825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97a530 msgr2=0x55909f9b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5b55640 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97a530 0x55909f9b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5b55640 1 -- 172.21.15.78:0/923789825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 msgr2=0x55909f9b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5b55640 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909f9b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5b55640 1 -- 172.21.15.78:0/923789825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f006ca30 con 0x55909f9b7d70 2023-10-14T09:17:41.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5b55640 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f97da60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94e8054c00 tx=0x7f94e805cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e1d9458d7da0c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:41.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:17:41.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94cbfff640 1 -- 172.21.15.78:0/923789825 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e805cc30 con 0x55909f9b7d70 2023-10-14T09:17:41.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94cbfff640 1 -- 172.21.15.78:0/923789825 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94e8050a60 con 0x55909f9b7d70 2023-10-14T09:17:41.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 1 -- 172.21.15.78:0/923789825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55909f781370 con 0x55909f9b7d70 2023-10-14T09:17:41.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94cbfff640 1 -- 172.21.15.78:0/923789825 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94e8050c20 con 0x55909f9b7d70 2023-10-14T09:17:41.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 10 client.4668 fetch_fsmap learned FSMap version 8 2023-10-14T09:17:41.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 1 -- 172.21.15.78:0/923789825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55909f78f460 con 0x55909f9b7d70 2023-10-14T09:17:41.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94cbfff640 1 -- 172.21.15.78:0/923789825 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55909f781370 con 0x55909f9b7d70 2023-10-14T09:17:41.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94cbfff640 1 -- 172.21.15.78:0/923789825 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f94e8053bd0 con 0x55909f9b7d70 2023-10-14T09:17:41.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T09:17:41.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 10 client.4668 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T09:17:41.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 20 client.4668 populate_metadata read hostname 'smithi078' 2023-10-14T09:17:41.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.157:6833/3774780175,v1:172.21.15.157:6835/3774780175] conn(0x55909f97e800 0x55909f97ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 4 client.4668 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:17:41.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94fa945000 1 -- 172.21.15.78:0/923789825 --> [v2:172.21.15.157:6833/3774780175,v1:172.21.15.157:6835/3774780175] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55909f7672d0 con 0x55909f97e800 2023-10-14T09:17:41.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5354640 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.157:6833/3774780175,v1:172.21.15.157:6835/3774780175] conn(0x55909f97e800 0x55909f97ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94cbfff640 10 client.4668 ms_handle_connect on v2:172.21.15.157:6833/3774780175 2023-10-14T09:17:41.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.437+0000 7f94f5354640 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.157:6833/3774780175,v1:172.21.15.157:6835/3774780175] conn(0x55909f97e800 0x55909f97ebe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5adf214072c03ec server_cookie=253444ec80619b53 in_seq=0 out_seq=0 2023-10-14T09:17:41.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94cbfff640 1 -- 172.21.15.78:0/923789825 <== mds.0 v2:172.21.15.157:6833/3774780175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55909f7672d0 con 0x55909f97e800 2023-10-14T09:17:41.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94cbfff640 10 client.4668 handle_command_reply: tid=0 2023-10-14T09:17:41.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 1 client.4668 shutdown 2023-10-14T09:17:41.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 1 -- 172.21.15.78:0/923789825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 msgr2=0x55909f97da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f97da60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94e8054c00 tx=0x7f94e805cec0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 1 -- 172.21.15.78:0/923789825 shutdown_connections 2023-10-14T09:17:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.157:6833/3774780175,v1:172.21.15.157:6835/3774780175] conn(0x55909f97e800 0x55909f97ebe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f9b7d70 0x55909f97da60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909f9b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94cbfff640 0 client.4668 ms_handle_reset on v2:172.21.15.157:6833/3774780175 2023-10-14T09:17:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 1 --2- 172.21.15.78:0/923789825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97a530 0x55909f9b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 1 -- 172.21.15.78:0/923789825 >> 172.21.15.78:0/923789825 conn(0x55909f982c90 msgr2=0x55909f9796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:41.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 1 -- 172.21.15.78:0/923789825 shutdown_connections 2023-10-14T09:17:41.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 1 -- 172.21.15.78:0/923789825 wait complete. 2023-10-14T09:17:41.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.441+0000 7f94fa945000 20 client.4668 trim_cache size 0 max 16384 2023-10-14T09:17:41.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 Processor -- start 2023-10-14T09:17:41.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 -- start start 2023-10-14T09:17:41.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f982c90 0x55909f979760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909f9ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97ae50 0x55909f9cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909f487940 con 0x55909f97a530 2023-10-14T09:17:41.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909f9b6bb0 con 0x55909f982c90 2023-10-14T09:17:41.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55909f7d28b0 con 0x55909f97ae50 2023-10-14T09:17:41.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94f4b53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909f9ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94f4b53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909f9ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38802/0 (socket says 172.21.15.78:38802) 2023-10-14T09:17:41.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94f4b53640 1 -- 172.21.15.78:0/1677493654 learned_addr learned my addr 172.21.15.78:0/1677493654 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:41.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94f4b53640 1 -- 172.21.15.78:0/1677493654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97ae50 msgr2=0x55909f9cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94f4b53640 1 --2- 172.21.15.78:0/1677493654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97ae50 0x55909f9cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94f4b53640 1 -- 172.21.15.78:0/1677493654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f982c90 msgr2=0x55909f979760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94f4b53640 1 --2- 172.21.15.78:0/1677493654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f982c90 0x55909f979760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94f4b53640 1 -- 172.21.15.78:0/1677493654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55909f775760 con 0x55909f97a530 2023-10-14T09:17:41.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94f4b53640 1 --2- 172.21.15.78:0/1677493654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909f9ccdc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f94e000ba30 tx=0x7f94e00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d74cfdc8a23f5e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:41.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94d37fe640 1 -- 172.21.15.78:0/1677493654 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0004020 con 0x55909f97a530 2023-10-14T09:17:41.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94d37fe640 1 -- 172.21.15.78:0/1677493654 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e0004180 con 0x55909f97a530 2023-10-14T09:17:41.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94d37fe640 1 -- 172.21.15.78:0/1677493654 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00042f0 con 0x55909f97a530 2023-10-14T09:17:41.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 -- 172.21.15.78:0/1677493654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 msgr2=0x55909f9ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 --2- 172.21.15.78:0/1677493654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909f9ccdc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f94e000ba30 tx=0x7f94e00046d0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 -- 172.21.15.78:0/1677493654 shutdown_connections 2023-10-14T09:17:41.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 --2- 172.21.15.78:0/1677493654 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f97ae50 0x55909f9cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 --2- 172.21.15.78:0/1677493654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909f9ccdc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 --2- 172.21.15.78:0/1677493654 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f982c90 0x55909f979760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 -- 172.21.15.78:0/1677493654 >> 172.21.15.78:0/1677493654 conn(0x55909f9b74c0 msgr2=0x55909fa143e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 -- 172.21.15.78:0/1677493654 shutdown_connections 2023-10-14T09:17:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 -- 172.21.15.78:0/1677493654 wait complete. 2023-10-14T09:17:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 -- start start 2023-10-14T09:17:41.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.457+0000 7f94fa945000 1 Processor -- start 2023-10-14T09:17:41.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909fa1cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909fa1d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f982c90 0x55909f9cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909f7d7200 con 0x55909f97a530 2023-10-14T09:17:41.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55909f80eba0 con 0x55909f97ae50 2023-10-14T09:17:41.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55909f77b6c0 con 0x55909f982c90 2023-10-14T09:17:41.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 10 client.0 _ll_register_callbacks cb 0x55909f775530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:17:41.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f5354640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909fa1cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f5354640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909fa1cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38812/0 (socket says 172.21.15.78:38812) 2023-10-14T09:17:41.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f5354640 1 -- 172.21.15.78:0/2909282790 learned_addr learned my addr 172.21.15.78:0/2909282790 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:41.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f5b55640 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f982c90 0x55909f9cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f4b53640 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909fa1d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f5354640 1 -- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f982c90 msgr2=0x55909f9cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f5354640 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f982c90 0x55909f9cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f5354640 1 -- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 msgr2=0x55909fa1d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f5354640 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909fa1d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f5354640 1 -- 172.21.15.78:0/2909282790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc003530 con 0x55909f97a530 2023-10-14T09:17:41.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f5354640 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909fa1cae0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0014a0 tx=0x7f94ec001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b115d2e15e0238 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:41.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:17:41.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94cbfff640 1 -- 172.21.15.78:0/2909282790 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec022620 con 0x55909f97a530 2023-10-14T09:17:41.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94cbfff640 1 -- 172.21.15.78:0/2909282790 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94ec022780 con 0x55909f97a530 2023-10-14T09:17:41.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 1 -- 172.21.15.78:0/2909282790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55909f7656f0 con 0x55909f97a530 2023-10-14T09:17:41.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94cbfff640 1 -- 172.21.15.78:0/2909282790 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94ec001700 con 0x55909f97a530 2023-10-14T09:17:41.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 10 client.4674 fetch_fsmap learned FSMap version 8 2023-10-14T09:17:41.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 1 -- 172.21.15.78:0/2909282790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55909f4c6cc0 con 0x55909f97a530 2023-10-14T09:17:41.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94cbfff640 1 -- 172.21.15.78:0/2909282790 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55909f7656f0 con 0x55909f97a530 2023-10-14T09:17:41.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94cbfff640 1 -- 172.21.15.78:0/2909282790 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f94ec020040 con 0x55909f97a530 2023-10-14T09:17:41.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 10 client.4674 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T09:17:41.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 10 client.4674 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T09:17:41.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 20 client.4674 populate_metadata read hostname 'smithi078' 2023-10-14T09:17:41.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:6833/3774780175,v1:172.21.15.157:6835/3774780175] conn(0x55909f9b7d70 0x55909fa259c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 4 client.4674 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T09:17:41.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 1 -- 172.21.15.78:0/2909282790 --> [v2:172.21.15.157:6833/3774780175,v1:172.21.15.157:6835/3774780175] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55909f7c6720 con 0x55909f9b7d70 2023-10-14T09:17:41.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f4b53640 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:6833/3774780175,v1:172.21.15.157:6835/3774780175] conn(0x55909f9b7d70 0x55909fa259c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94f4b53640 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:6833/3774780175,v1:172.21.15.157:6835/3774780175] conn(0x55909f9b7d70 0x55909fa259c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5b3e80715bf6e98 server_cookie=598115f8ed902762 in_seq=0 out_seq=0 2023-10-14T09:17:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94cbfff640 10 client.4674 ms_handle_connect on v2:172.21.15.157:6833/3774780175 2023-10-14T09:17:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94cbfff640 1 -- 172.21.15.78:0/2909282790 <== mds.0 v2:172.21.15.157:6833/3774780175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55909f7c6720 con 0x55909f9b7d70 2023-10-14T09:17:41.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94cbfff640 10 client.4674 handle_command_reply: tid=0 2023-10-14T09:17:41.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.461+0000 7f94fa945000 1 client.4674 shutdown 2023-10-14T09:17:41.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94fa945000 1 -- 172.21.15.78:0/2909282790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 msgr2=0x55909fa1cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94fa945000 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909fa1cae0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0014a0 tx=0x7f94ec001e80 comp rx=0 tx=0).stop 2023-10-14T09:17:41.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94fa945000 1 -- 172.21.15.78:0/2909282790 shutdown_connections 2023-10-14T09:17:41.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94fa945000 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:6833/3774780175,v1:172.21.15.157:6835/3774780175] conn(0x55909f9b7d70 0x55909fa259c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94fa945000 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55909f982c90 0x55909f9cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94fa945000 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55909f97ae50 0x55909fa1d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94cbfff640 0 client.4674 ms_handle_reset on v2:172.21.15.157:6833/3774780175 2023-10-14T09:17:41.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94fa945000 1 --2- 172.21.15.78:0/2909282790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55909f97a530 0x55909fa1cae0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94fa945000 1 -- 172.21.15.78:0/2909282790 >> 172.21.15.78:0/2909282790 conn(0x55909f9b74c0 msgr2=0x55909f978fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:41.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94fa945000 1 -- 172.21.15.78:0/2909282790 shutdown_connections 2023-10-14T09:17:41.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94fa945000 1 -- 172.21.15.78:0/2909282790 wait complete. 2023-10-14T09:17:41.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94fa945000 20 client.4674 trim_cache size 0 max 16384 2023-10-14T09:17:41.481 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:17:41.481 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "1f80be0e-0937-433c-91b2-bf32e5285783", 2023-10-14T09:17:41.481 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-10-14T09:17:41.481 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4296, 2023-10-14T09:17:41.482 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-10-14T09:17:41.482 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-10-14T09:17:41.482 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-10-14T09:17:41.482 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 15.823881958999999, 2023-10-14T09:17:41.482 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 8, 2023-10-14T09:17:41.483 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 20, 2023-10-14T09:17:41.483 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 20, 2023-10-14T09:17:41.483 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 22.855450686000001 2023-10-14T09:17:41.483 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:17:41.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 -- 172.21.15.78:0/3568090575 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94d40664d0 msgr2=0x7f94d4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94d40664d0 0x7f94d4068990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0010f0 tx=0x7f94ec001be0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 -- 172.21.15.78:0/3568090575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94f01ec640 msgr2=0x7f94f01ecaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94f01ec640 0x7f94f01ecaa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f94f0154260 tx=0x7f94e800eb90 comp rx=0 tx=0).stop 2023-10-14T09:17:41.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 -- 172.21.15.78:0/3568090575 shutdown_connections 2023-10-14T09:17:41.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94f01ec640 0x7f94f01ecaa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94f00c2840 0x7f94f014bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94d40664d0 0x7f94d4068990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 --2- 172.21.15.78:0/3568090575 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f94dc0047d0 0x7f94f01ef580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 -- 172.21.15.78:0/3568090575 >> 172.21.15.78:0/3568090575 conn(0x7f94f00ab1f0 msgr2=0x7f94f0152820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:41.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 -- 172.21.15.78:0/3568090575 shutdown_connections 2023-10-14T09:17:41.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.465+0000 7f94f75b8640 1 -- 172.21.15.78:0/3568090575 wait complete. 2023-10-14T09:17:41.487 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-14T09:17:41.511 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-14T09:17:41.511 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2023-10-14T09:17:41.511 INFO:tasks.ceph_fuse:client.0 config is {'disabled': True} 2023-10-14T09:17:41.512 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T09:17:41.512 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T09:17:41.513 INFO:tasks.ceph_fuse:client.1 config is {'disabled': True} 2023-10-14T09:17:41.513 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T09:17:41.513 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T09:17:41.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:41.514 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2023-10-14T09:17:41.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:41.526 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2023-10-14T09:17:41.592 INFO:teuthology.orchestra.run.smithi157.stderr:Cannot find device "ceph-brx" 2023-10-14T09:17:41.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:17:41.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:41.594 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-10-14T09:17:41.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:41.605 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-10-14T09:17:41.671 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2023-10-14T09:17:41.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:17:41.674 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-14T09:17:41.674 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T09:17:41.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.853+0000 7f36c7d65640 1 Processor -- start 2023-10-14T09:17:41.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c7d65640 1 -- start start 2023-10-14T09:17:41.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c7d65640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 0x7f36c00c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c7d65640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36c00c6910 0x7f36c00c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c7d65640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c006c470 con 0x7f36c0153e80 2023-10-14T09:17:41.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c7d65640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c00c64f0 con 0x7f36c00c6910 2023-10-14T09:17:41.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c7d65640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c00c5300 con 0x7f36c014ddb0 2023-10-14T09:17:41.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c6302640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36c00c6910 0x7f36c00c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c6302640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f36c00c6910 0x7f36c00c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38814/0 (socket says 172.21.15.78:38814) 2023-10-14T09:17:41.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c5300640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f36c0153e80 0x7f36c006bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:47372/0 (socket says 172.21.15.78:47372) 2023-10-14T09:17:41.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c6302640 1 -- 172.21.15.78:0/2136850059 learned_addr learned my addr 172.21.15.78:0/2136850059 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:41.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c5b01640 1 --2- 172.21.15.78:0/2136850059 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 0x7f36c00c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c6302640 1 -- 172.21.15.78:0/2136850059 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 msgr2=0x7f36c00c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c6302640 1 --2- 172.21.15.78:0/2136850059 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 0x7f36c00c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c6302640 1 -- 172.21.15.78:0/2136850059 >> v1:172.21.15.78:6789/0 conn(0x7f36c0153e80 legacy=0x7f36c006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c6302640 1 -- 172.21.15.78:0/2136850059 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c006c750 con 0x7f36c00c6910 2023-10-14T09:17:41.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c4aff640 1 -- 172.21.15.78:0/2136850059 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386170260 0 0) 0x7f36c006c470 con 0x7f36c0153e80 2023-10-14T09:17:41.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.857+0000 7f36c5b01640 1 --2- 172.21.15.78:0/2136850059 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 0x7f36c00c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c6302640 1 --2- 172.21.15.78:0/2136850059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36c00c6910 0x7f36c00c3fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009e50 tx=0x7f36b801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325cfafea3518006 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:41.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c4aff640 1 -- 172.21.15.78:0/2136850059 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b80a56a0 con 0x7f36c00c6910 2023-10-14T09:17:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c4aff640 1 -- 172.21.15.78:0/2136850059 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b80a5800 con 0x7f36c00c6910 2023-10-14T09:17:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c4aff640 1 -- 172.21.15.78:0/2136850059 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b80a5b90 con 0x7f36c00c6910 2023-10-14T09:17:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c7d65640 1 -- 172.21.15.78:0/2136850059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36c00c6910 msgr2=0x7f36c00c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c7d65640 1 --2- 172.21.15.78:0/2136850059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36c00c6910 0x7f36c00c3fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009e50 tx=0x7f36b801c8f0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c7d65640 1 -- 172.21.15.78:0/2136850059 shutdown_connections 2023-10-14T09:17:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c7d65640 1 --2- 172.21.15.78:0/2136850059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36c00c6910 0x7f36c00c3fe0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c7d65640 1 --2- 172.21.15.78:0/2136850059 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 0x7f36c00c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c7d65640 1 -- 172.21.15.78:0/2136850059 >> 172.21.15.78:0/2136850059 conn(0x7f36c00ab1f0 msgr2=0x7f36c00ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c7d65640 1 -- 172.21.15.78:0/2136850059 shutdown_connections 2023-10-14T09:17:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c7d65640 1 -- 172.21.15.78:0/2136850059 wait complete. 2023-10-14T09:17:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c7d65640 1 Processor -- start 2023-10-14T09:17:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.861+0000 7f36c7d65640 1 -- start start 2023-10-14T09:17:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c7d65640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36c00c6910 0x7f36c00c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c7d65640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 0x7f36c0157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c7d65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36c0153e80 0x7f36c0152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c7d65640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c0157620 con 0x7f36c0153e80 2023-10-14T09:17:41.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c7d65640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c01582b0 con 0x7f36c00c6910 2023-10-14T09:17:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c7d65640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c014ba30 con 0x7f36c014ddb0 2023-10-14T09:17:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c6302640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36c0153e80 0x7f36c0152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c6302640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36c0153e80 0x7f36c0152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38824/0 (socket says 172.21.15.78:38824) 2023-10-14T09:17:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c6302640 1 -- 172.21.15.78:0/1577748186 learned_addr learned my addr 172.21.15.78:0/1577748186 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c5b01640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36c00c6910 0x7f36c00c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c5300640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 0x7f36c0157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c6302640 1 -- 172.21.15.78:0/1577748186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 msgr2=0x7f36c0157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c6302640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 0x7f36c0157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c6302640 1 -- 172.21.15.78:0/1577748186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36c00c6910 msgr2=0x7f36c00c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c6302640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36c00c6910 0x7f36c00c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c6302640 1 -- 172.21.15.78:0/1577748186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b8009b30 con 0x7f36c0153e80 2023-10-14T09:17:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c5b01640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36c00c6910 0x7f36c00c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c5300640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 0x7f36c0157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c6302640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36c0153e80 0x7f36c0152b20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009e50 tx=0x7f36b8019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36b67fc640 1 -- 172.21.15.78:0/1577748186 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b80b8470 con 0x7f36c0153e80 2023-10-14T09:17:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36b67fc640 1 -- 172.21.15.78:0/1577748186 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b80b85d0 con 0x7f36c0153e80 2023-10-14T09:17:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36b67fc640 1 -- 172.21.15.78:0/1577748186 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b80b8980 con 0x7f36c0153e80 2023-10-14T09:17:41.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c7d65640 1 -- 172.21.15.78:0/1577748186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c01578c0 con 0x7f36c0153e80 2023-10-14T09:17:41.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c7d65640 1 -- 172.21.15.78:0/1577748186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c0153bf0 con 0x7f36c0153e80 2023-10-14T09:17:41.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36c7d65640 1 -- 172.21.15.78:0/1577748186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c0157a50 con 0x7f36c0153e80 2023-10-14T09:17:41.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.865+0000 7f36b67fc640 1 -- 172.21.15.78:0/1577748186 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f36b80b8ae0 con 0x7f36c0153e80 2023-10-14T09:17:41.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.869+0000 7f36b67fc640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a40664a0 0x7f36a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:41.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.869+0000 7f36b67fc640 1 -- 172.21.15.78:0/1577748186 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36b811efc0 con 0x7f36c0153e80 2023-10-14T09:17:41.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.869+0000 7f36c5b01640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a40664a0 0x7f36a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.869+0000 7f36c5b01640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a40664a0 0x7f36a4068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00a9b0 tx=0x7f36bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:41.873+0000 7f36b67fc640 1 -- 172.21.15.78:0/1577748186 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f36b8150090 con 0x7f36c0153e80 2023-10-14T09:17:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.053+0000 7f36c7d65640 1 -- 172.21.15.78:0/1577748186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f36c0074180 con 0x7f36c0153e80 2023-10-14T09:17:42.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.053+0000 7f36b67fc640 1 -- 172.21.15.78:0/1577748186 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f36b80bc060 con 0x7f36c0153e80 2023-10-14T09:17:42.057 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T09:17:42.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 -- 172.21.15.78:0/1577748186 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a40664a0 msgr2=0x7f36a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:42.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a40664a0 0x7f36a4068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00a9b0 tx=0x7f36bc008040 comp rx=0 tx=0).stop 2023-10-14T09:17:42.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 -- 172.21.15.78:0/1577748186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36c0153e80 msgr2=0x7f36c0152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:42.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36c0153e80 0x7f36c0152b20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009e50 tx=0x7f36b8019690 comp rx=0 tx=0).stop 2023-10-14T09:17:42.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 -- 172.21.15.78:0/1577748186 shutdown_connections 2023-10-14T09:17:42.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36c0153e80 0x7f36c0152b20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:42.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36a40664a0 0x7f36a4068960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36c014ddb0 0x7f36c0157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 --2- 172.21.15.78:0/1577748186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f36c00c6910 0x7f36c00c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 -- 172.21.15.78:0/1577748186 >> 172.21.15.78:0/1577748186 conn(0x7f36c00ab1f0 msgr2=0x7f36c006bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 -- 172.21.15.78:0/1577748186 shutdown_connections 2023-10-14T09:17:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:42.057+0000 7f36c7d65640 1 -- 172.21.15.78:0/1577748186 wait complete. 2023-10-14T09:17:42.076 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T09:17:42.077 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T09:17:42.077 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-10-14T09:17:42.078 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T09:17:42.078 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T09:17:42.078 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T09:17:42.078 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T09:17:42.079 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T09:17:42.079 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T09:17:42.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:42.080 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-10-14T09:17:42.090 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T09:17:42.091 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T09:17:42.091 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T09:17:42.091 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:17:42.091 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-10-14T09:17:42.091 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:17:42.092 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T09:17:42.092 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:17:42.092 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-10-14T09:17:42.092 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T09:17:42.093 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:17:42.093 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-10-14T09:17:42.093 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T09:17:42.093 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T09:17:42.093 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T09:17:42.093 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-10-14T09:17:42.094 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-14T09:17:42.094 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42371sec preferred_lft 42371sec 2023-10-14T09:17:42.094 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-10-14T09:17:42.094 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:17:42.095 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T09:17:42.095 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:6a:98:2c:25 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:17:42.095 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T09:17:42.095 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:17:42.096 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T09:17:42.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:42.097 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-14T09:17:42.097 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-14T09:17:42.097 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2023-10-14T09:17:42.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2023-10-14T09:17:42.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2023-10-14T09:17:42.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T09:17:42.099 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-14T09:17:42.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:42.207 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T09:17:42.226 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-10-14T09:17:42.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:42.228 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-10-14T09:17:42.332 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-10-14T09:17:42.332 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T09:17:42.332 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-14T09:17:42.332 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T09:17:42.333 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T09:17:42.333 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T09:17:42.333 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T09:17:42.333 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T09:17:42.333 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T09:17:42.334 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T09:17:42.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:42.334 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-14T09:17:42.335 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-14T09:17:42.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T09:17:42.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T09:17:42.336 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T09:17:42.336 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-14T09:17:42.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:42.388 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-10-14T09:17:42.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:42.398 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-10-14T09:17:42.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:42.454 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-14T09:17:42.455 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-14T09:17:42.455 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:17:42.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-14T09:17:42.456 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-14T09:17:42.536 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-14T09:17:42.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:42.537 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-14T09:17:42.538 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-14T09:17:42.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-14T09:17:42.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T09:17:42.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-14T09:17:42.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-14T09:17:42.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-14T09:17:42.539 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-14T09:17:42.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:42.708 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-10-14T09:17:42.708 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-10-14T09:17:42.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-10-14T09:17:42.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T09:17:42.709 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-10-14T09:17:42.750 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'disabled': True} 2023-10-14T09:17:42.751 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:17:42.751 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T09:17:42.805 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T09:17:42.806 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:17:42.806 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T09:17:42.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-10-14T09:17:42.929 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T09:17:42.984 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-10-14T09:17:42.984 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-10-14T09:17:42.985 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-10-14T09:17:42.985 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-10-14T09:17:42.985 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-10-14T09:17:42.986 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-10-14T09:17:42.986 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-10-14T09:17:42.986 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-10-14T09:17:42.987 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-10-14T09:17:42.987 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-10-14T09:17:42.987 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-10-14T09:17:42.988 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-10-14T09:17:42.988 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T09:17:42.988 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-10-14T09:17:42.988 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-10-14T09:17:42.988 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-10-14T09:17:42.989 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-10-14T09:17:42.989 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-10-14T09:17:42.989 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-10-14T09:17:42.989 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-10-14T09:17:42.989 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T09:17:42.990 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-10-14T09:17:42.990 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-10-14T09:17:42.990 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-10-14T09:17:42.990 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T09:17:42.990 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T09:17:42.990 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T09:17:42.991 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T09:17:42.991 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-10-14T09:17:42.991 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:17:42.991 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:17:42.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:42.992 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-10-14T09:17:43.036 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T09:17:43.037 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-14T09:17:43.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-10-14T09:17:43.105 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T09:17:43.159 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-10-14T09:17:43.159 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-10-14T09:17:43.159 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-10-14T09:17:43.159 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-10-14T09:17:43.160 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-10-14T09:17:43.160 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-10-14T09:17:43.160 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-10-14T09:17:43.160 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-10-14T09:17:43.161 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-10-14T09:17:43.161 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-10-14T09:17:43.161 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-10-14T09:17:43.161 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-10-14T09:17:43.161 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T09:17:43.161 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-10-14T09:17:43.162 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-10-14T09:17:43.162 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-10-14T09:17:43.162 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-10-14T09:17:43.162 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-10-14T09:17:43.163 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-10-14T09:17:43.163 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-10-14T09:17:43.163 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T09:17:43.163 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-10-14T09:17:43.163 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-10-14T09:17:43.164 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-10-14T09:17:43.164 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T09:17:43.164 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T09:17:43.164 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T09:17:43.164 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T09:17:43.165 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-10-14T09:17:43.165 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:17:43.165 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:17:43.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:43.167 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-10-14T09:17:43.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:2023-10-14T09:17:43.181+0000 7feda1ea8580 -1 init, newargv = 0x558f47388e00 newargc=15 2023-10-14T09:17:43.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[43993]: starting ceph client 2023-10-14T09:17:43.194 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[43993]: starting fuse 2023-10-14T09:17:44.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-10-14T09:17:44.320 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T09:17:44.379 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-10-14T09:17:44.379 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-10-14T09:17:44.379 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-10-14T09:17:44.380 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-10-14T09:17:44.380 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-10-14T09:17:44.380 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-10-14T09:17:44.380 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-10-14T09:17:44.380 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-10-14T09:17:44.381 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-10-14T09:17:44.381 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-10-14T09:17:44.381 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-10-14T09:17:44.381 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-10-14T09:17:44.381 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T09:17:44.382 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-10-14T09:17:44.382 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-10-14T09:17:44.382 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-10-14T09:17:44.382 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-10-14T09:17:44.382 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-10-14T09:17:44.383 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-10-14T09:17:44.383 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-10-14T09:17:44.383 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T09:17:44.383 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-10-14T09:17:44.383 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-10-14T09:17:44.384 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-10-14T09:17:44.384 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T09:17:44.384 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T09:17:44.384 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T09:17:44.384 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T09:17:44.385 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-10-14T09:17:44.385 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:17:44.385 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:17:44.385 INFO:teuthology.orchestra.run.smithi078.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-14T09:17:44.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:44.387 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-10-14T09:17:44.442 INFO:teuthology.orchestra.run.smithi078.stdout:43 2023-10-14T09:17:44.443 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-14T09:17:44.444 DEBUG:teuthology.orchestra.run.smithi078:> sudo stdin-killer -- python3 -c ' 2023-10-14T09:17:44.444 DEBUG:teuthology.orchestra.run.smithi078:> import glob 2023-10-14T09:17:44.445 DEBUG:teuthology.orchestra.run.smithi078:> import re 2023-10-14T09:17:44.445 DEBUG:teuthology.orchestra.run.smithi078:> import os 2023-10-14T09:17:44.445 DEBUG:teuthology.orchestra.run.smithi078:> import subprocess 2023-10-14T09:17:44.446 DEBUG:teuthology.orchestra.run.smithi078:> 2023-10-14T09:17:44.447 DEBUG:teuthology.orchestra.run.smithi078:> def _find_admin_socket(client_name): 2023-10-14T09:17:44.447 DEBUG:teuthology.orchestra.run.smithi078:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-14T09:17:44.447 DEBUG:teuthology.orchestra.run.smithi078:> files = glob.glob(asok_path) 2023-10-14T09:17:44.447 DEBUG:teuthology.orchestra.run.smithi078:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-14T09:17:44.448 DEBUG:teuthology.orchestra.run.smithi078:> 2023-10-14T09:17:44.448 DEBUG:teuthology.orchestra.run.smithi078:> # Given a non-glob path, it better be there 2023-10-14T09:17:44.448 DEBUG:teuthology.orchestra.run.smithi078:> if "*" not in asok_path: 2023-10-14T09:17:44.449 DEBUG:teuthology.orchestra.run.smithi078:> assert(len(files) == 1) 2023-10-14T09:17:44.449 DEBUG:teuthology.orchestra.run.smithi078:> return files[0] 2023-10-14T09:17:44.449 DEBUG:teuthology.orchestra.run.smithi078:> 2023-10-14T09:17:44.450 DEBUG:teuthology.orchestra.run.smithi078:> for f in files: 2023-10-14T09:17:44.450 DEBUG:teuthology.orchestra.run.smithi078:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T09:17:44.450 DEBUG:teuthology.orchestra.run.smithi078:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T09:17:44.451 DEBUG:teuthology.orchestra.run.smithi078:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T09:17:44.451 DEBUG:teuthology.orchestra.run.smithi078:> contents = proc_f.read() 2023-10-14T09:17:44.452 DEBUG:teuthology.orchestra.run.smithi078:> if mountpoint in contents: 2023-10-14T09:17:44.452 DEBUG:teuthology.orchestra.run.smithi078:> return f 2023-10-14T09:17:44.453 DEBUG:teuthology.orchestra.run.smithi078:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T09:17:44.453 DEBUG:teuthology.orchestra.run.smithi078:> 2023-10-14T09:17:44.454 DEBUG:teuthology.orchestra.run.smithi078:> print(_find_admin_socket("client.0")) 2023-10-14T09:17:44.454 DEBUG:teuthology.orchestra.run.smithi078:> ' 2023-10-14T09:17:44.573 INFO:teuthology.orchestra.run.smithi078.stdout:/var/run/ceph/ceph-client.0.43993.asok 2023-10-14T09:17:44.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T09:17:44.586 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43993.asok 2023-10-14T09:17:44.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:44.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43993.asok status 2023-10-14T09:17:44.760 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:17:44.761 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": { 2023-10-14T09:17:44.761 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T09:17:44.761 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T09:17:44.761 INFO:teuthology.orchestra.run.smithi078.stdout: "entity_id": "0", 2023-10-14T09:17:44.761 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": "smithi078", 2023-10-14T09:17:44.762 INFO:teuthology.orchestra.run.smithi078.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-14T09:17:44.762 INFO:teuthology.orchestra.run.smithi078.stdout: "pid": "43993", 2023-10-14T09:17:44.762 INFO:teuthology.orchestra.run.smithi078.stdout: "root": "/" 2023-10-14T09:17:44.762 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:17:44.762 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_count": 0, 2023-10-14T09:17:44.763 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_pinned_count": 0, 2023-10-14T09:17:44.763 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4689, 2023-10-14T09:17:44.763 INFO:teuthology.orchestra.run.smithi078.stdout: "inst": { 2023-10-14T09:17:44.763 INFO:teuthology.orchestra.run.smithi078.stdout: "name": { 2023-10-14T09:17:44.763 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "client", 2023-10-14T09:17:44.764 INFO:teuthology.orchestra.run.smithi078.stdout: "num": 4689 2023-10-14T09:17:44.764 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:17:44.764 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-10-14T09:17:44.764 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-10-14T09:17:44.764 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2023-10-14T09:17:44.765 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 462807426 2023-10-14T09:17:44.765 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:17:44.765 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:17:44.765 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-10-14T09:17:44.765 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-10-14T09:17:44.766 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2023-10-14T09:17:44.766 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 462807426 2023-10-14T09:17:44.766 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:17:44.766 INFO:teuthology.orchestra.run.smithi078.stdout: "inst_str": "client.4689 192.168.0.1:0/462807426", 2023-10-14T09:17:44.766 INFO:teuthology.orchestra.run.smithi078.stdout: "addr_str": "192.168.0.1:0/462807426", 2023-10-14T09:17:44.767 INFO:teuthology.orchestra.run.smithi078.stdout: "inode_count": 1, 2023-10-14T09:17:44.767 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_epoch": 8, 2023-10-14T09:17:44.767 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch": 20, 2023-10-14T09:17:44.767 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch_barrier": 0, 2023-10-14T09:17:44.767 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklisted": false, 2023-10-14T09:17:44.768 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs" 2023-10-14T09:17:44.768 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:17:44.775 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T09:17:44.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f387da17640 1 Processor -- start 2023-10-14T09:17:44.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f387da17640 1 -- start start 2023-10-14T09:17:44.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f387da17640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f387814ddb0 0x7f38780c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:44.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f387da17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3878153e80 0x7f387806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:44.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f387da17640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387806c470 con 0x7f38780c6910 2023-10-14T09:17:44.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f387da17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38780c64f0 con 0x7f3878153e80 2023-10-14T09:17:44.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f387da17640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38780c5300 con 0x7f387814ddb0 2023-10-14T09:17:44.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f386ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3878153e80 0x7f387806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:44.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f386ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3878153e80 0x7f387806bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38826/0 (socket says 172.21.15.78:38826) 2023-10-14T09:17:44.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f386ffff640 1 -- 172.21.15.78:0/4181617606 learned_addr learned my addr 172.21.15.78:0/4181617606 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:44.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f3876ffd640 1 --2- 172.21.15.78:0/4181617606 >> v2:172.21.15.157:3300/0 conn(0x7f387814ddb0 0x7f38780c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:44.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f386ffff640 1 -- 172.21.15.78:0/4181617606 >> v2:172.21.15.157:3300/0 conn(0x7f387814ddb0 msgr2=0x7f38780c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:44.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f386ffff640 1 --2- 172.21.15.78:0/4181617606 >> v2:172.21.15.157:3300/0 conn(0x7f387814ddb0 0x7f38780c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:44.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f386ffff640 1 -- 172.21.15.78:0/4181617606 >> v1:172.21.15.157:6789/0 conn(0x7f38780c6910 legacy=0x7f38780c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:44.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.912+0000 7f386ffff640 1 -- 172.21.15.78:0/4181617606 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387806c750 con 0x7f3878153e80 2023-10-14T09:17:44.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f386ffff640 1 --2- 172.21.15.78:0/4181617606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3878153e80 0x7f387806bb70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f38780a8d80 tx=0x7f386001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0b741641b97ea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:44.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f38767fc640 1 -- 172.21.15.78:0/4181617606 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38600ac410 con 0x7f3878153e80 2023-10-14T09:17:44.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f38767fc640 1 -- 172.21.15.78:0/4181617606 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38600ac570 con 0x7f3878153e80 2023-10-14T09:17:44.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f38767fc640 1 -- 172.21.15.78:0/4181617606 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38600ac900 con 0x7f3878153e80 2023-10-14T09:17:44.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f387da17640 1 -- 172.21.15.78:0/4181617606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3878153e80 msgr2=0x7f387806bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:44.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f387da17640 1 --2- 172.21.15.78:0/4181617606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3878153e80 0x7f387806bb70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f38780a8d80 tx=0x7f386001c3b0 comp rx=0 tx=0).stop 2023-10-14T09:17:44.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f387da17640 1 -- 172.21.15.78:0/4181617606 shutdown_connections 2023-10-14T09:17:44.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f387da17640 1 --2- 172.21.15.78:0/4181617606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3878153e80 0x7f387806bb70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:44.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f387da17640 1 --2- 172.21.15.78:0/4181617606 >> v2:172.21.15.157:3300/0 conn(0x7f387814ddb0 0x7f38780c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:44.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f387da17640 1 -- 172.21.15.78:0/4181617606 >> 172.21.15.78:0/4181617606 conn(0x7f38780ab1f0 msgr2=0x7f38780ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:44.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f387da17640 1 -- 172.21.15.78:0/4181617606 shutdown_connections 2023-10-14T09:17:44.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f387da17640 1 -- 172.21.15.78:0/4181617606 wait complete. 2023-10-14T09:17:44.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f387da17640 1 Processor -- start 2023-10-14T09:17:44.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.916+0000 7f387da17640 1 -- start start 2023-10-14T09:17:44.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f387da17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38780c6910 0x7f38780c0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:44.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f387da17640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f387814ddb0 0x7f38780c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:44.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f387da17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3878153e80 0x7f3878153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:44.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f387da17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38780c1140 con 0x7f38780c6910 2023-10-14T09:17:44.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f387da17640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38781577c0 con 0x7f387814ddb0 2023-10-14T09:17:44.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f387da17640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38781ecda0 con 0x7f3878153e80 2023-10-14T09:17:44.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3876ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38780c6910 0x7f38780c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:44.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3876ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38780c6910 0x7f38780c0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38828/0 (socket says 172.21.15.78:38828) 2023-10-14T09:17:44.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3876ffd640 1 -- 172.21.15.78:0/726779110 learned_addr learned my addr 172.21.15.78:0/726779110 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:44.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f386ffff640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f387814ddb0 0x7f38780c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:44.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f38777fe640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3878153e80 0x7f3878153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:44.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3876ffd640 1 -- 172.21.15.78:0/726779110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3878153e80 msgr2=0x7f3878153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:44.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3876ffd640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3878153e80 0x7f3878153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:44.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3876ffd640 1 -- 172.21.15.78:0/726779110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f387814ddb0 msgr2=0x7f38780c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:44.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3876ffd640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f387814ddb0 0x7f38780c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:44.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3876ffd640 1 -- 172.21.15.78:0/726779110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38600094d0 con 0x7f38780c6910 2023-10-14T09:17:44.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f386ffff640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f387814ddb0 0x7f38780c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:44.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3876ffd640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38780c6910 0x7f38780c0730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f386800e930 tx=0x7f386800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:44.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3874ff9640 1 -- 172.21.15.78:0/726779110 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868009690 con 0x7f38780c6910 2023-10-14T09:17:44.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3874ff9640 1 -- 172.21.15.78:0/726779110 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386800ca00 con 0x7f38780c6910 2023-10-14T09:17:44.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3874ff9640 1 -- 172.21.15.78:0/726779110 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800cd70 con 0x7f38780c6910 2023-10-14T09:17:44.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f387da17640 1 -- 172.21.15.78:0/726779110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38781ed080 con 0x7f38780c6910 2023-10-14T09:17:44.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f387da17640 1 -- 172.21.15.78:0/726779110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38780c1390 con 0x7f38780c6910 2023-10-14T09:17:44.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f387da17640 1 -- 172.21.15.78:0/726779110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3878074180 con 0x7f38780c6910 2023-10-14T09:17:44.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.920+0000 7f3874ff9640 1 -- 172.21.15.78:0/726779110 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3868013470 con 0x7f38780c6910 2023-10-14T09:17:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.924+0000 7f3874ff9640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f38580664a0 0x7f3858068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.924+0000 7f3874ff9640 1 -- 172.21.15.78:0/726779110 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3868084170 con 0x7f38780c6910 2023-10-14T09:17:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.924+0000 7f386ffff640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f38580664a0 0x7f3858068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.924+0000 7f386ffff640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f38580664a0 0x7f3858068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f38600ae000 tx=0x7f3860008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:44.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:44.928+0000 7f3874ff9640 1 -- 172.21.15.78:0/726779110 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3868051610 con 0x7f38780c6910 2023-10-14T09:17:45.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 -- 172.21.15.78:0/726779110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f38780c3a90 con 0x7f38780c6910 2023-10-14T09:17:45.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f3874ff9640 1 -- 172.21.15.78:0/726779110 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3868054c30 con 0x7f38780c6910 2023-10-14T09:17:45.114 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T09:17:45.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 -- 172.21.15.78:0/726779110 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f38580664a0 msgr2=0x7f3858068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:45.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f38580664a0 0x7f3858068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f38600ae000 tx=0x7f3860008040 comp rx=0 tx=0).stop 2023-10-14T09:17:45.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 -- 172.21.15.78:0/726779110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38780c6910 msgr2=0x7f38780c0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:45.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38780c6910 0x7f38780c0730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f386800e930 tx=0x7f386800edf0 comp rx=0 tx=0).stop 2023-10-14T09:17:45.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 -- 172.21.15.78:0/726779110 shutdown_connections 2023-10-14T09:17:45.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f38580664a0 0x7f3858068960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:45.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3878153e80 0x7f3878153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:45.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f387814ddb0 0x7f38780c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:45.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 --2- 172.21.15.78:0/726779110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38780c6910 0x7f38780c0730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:45.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 -- 172.21.15.78:0/726779110 >> 172.21.15.78:0/726779110 conn(0x7f38780ab1f0 msgr2=0x7f38780c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:45.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 -- 172.21.15.78:0/726779110 shutdown_connections 2023-10-14T09:17:45.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:45.112+0000 7f387da17640 1 -- 172.21.15.78:0/726779110 wait complete. 2023-10-14T09:17:45.134 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T09:17:45.134 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T09:17:45.135 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2023-10-14T09:17:45.135 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T09:17:45.135 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T09:17:45.135 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T09:17:45.136 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T09:17:45.136 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T09:17:45.136 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T09:17:45.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:45.137 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2023-10-14T09:17:45.147 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T09:17:45.148 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T09:17:45.148 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T09:17:45.148 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:17:45.148 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2023-10-14T09:17:45.148 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:17:45.149 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T09:17:45.149 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:17:45.149 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f0 2023-10-14T09:17:45.149 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T09:17:45.150 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:17:45.150 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f1 2023-10-14T09:17:45.150 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-14T09:17:45.150 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:17:45.150 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T09:17:45.151 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:17:45.151 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-14T09:17:45.151 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 42403sec preferred_lft 42403sec 2023-10-14T09:17:45.151 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link 2023-10-14T09:17:45.151 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:17:45.152 INFO:teuthology.orchestra.run.smithi157.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-14T09:17:45.152 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 02:42:7c:0f:d1:07 brd ff:ff:ff:ff:ff:ff 2023-10-14T09:17:45.152 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-14T09:17:45.152 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2023-10-14T09:17:45.153 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T09:17:45.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:45.154 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-14T09:17:45.155 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-14T09:17:45.155 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add name ceph-brx type bridge 2023-10-14T09:17:45.156 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr flush dev ceph-brx 2023-10-14T09:17:45.156 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set ceph-brx up 2023-10-14T09:17:45.157 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T09:17:45.157 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-14T09:17:45.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:45.272 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T09:17:45.292 INFO:teuthology.orchestra.run.smithi157.stdout:1 2023-10-14T09:17:45.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:45.295 DEBUG:teuthology.orchestra.run.smithi157:> route 2023-10-14T09:17:45.371 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2023-10-14T09:17:45.371 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T09:17:45.371 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-14T09:17:45.371 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T09:17:45.372 INFO:teuthology.orchestra.run.smithi157.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-14T09:17:45.372 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T09:17:45.372 INFO:teuthology.orchestra.run.smithi157.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T09:17:45.372 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T09:17:45.372 INFO:teuthology.orchestra.run.smithi157.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-14T09:17:45.373 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T09:17:45.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:45.373 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-14T09:17:45.374 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-14T09:17:45.374 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T09:17:45.374 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T09:17:45.375 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T09:17:45.375 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-14T09:17:45.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:45.467 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2023-10-14T09:17:45.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:45.511 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list-id 2023-10-14T09:17:45.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:45.563 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-14T09:17:45.563 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-14T09:17:45.563 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T09:17:45.564 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-14T09:17:45.564 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-14T09:17:45.645 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-14T09:17:45.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:45.646 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-14T09:17:45.646 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-14T09:17:45.647 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-14T09:17:45.647 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T09:17:45.647 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-14T09:17:45.647 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-14T09:17:45.648 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-14T09:17:45.648 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-14T09:17:45.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:45.816 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2023-10-14T09:17:45.817 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2023-10-14T09:17:45.817 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.0 up 2023-10-14T09:17:45.817 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T09:17:45.818 DEBUG:teuthology.orchestra.run.smithi157:> ') 2023-10-14T09:17:45.859 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'disabled': True} 2023-10-14T09:17:45.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:17:45.859 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T09:17:45.914 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T09:17:45.915 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T09:17:45.915 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T09:17:45.965 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2023-10-14T09:17:46.026 DEBUG:teuthology.orchestra.run.smithi157:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T09:17:46.083 INFO:teuthology.orchestra.run.smithi157.stdout:/sys 2023-10-14T09:17:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/proc 2023-10-14T09:17:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/dev 2023-10-14T09:17:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/pts 2023-10-14T09:17:46.084 INFO:teuthology.orchestra.run.smithi157.stdout:/run 2023-10-14T09:17:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:/ 2023-10-14T09:17:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/security 2023-10-14T09:17:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/shm 2023-10-14T09:17:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:/run/lock 2023-10-14T09:17:46.085 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup 2023-10-14T09:17:46.086 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/pstore 2023-10-14T09:17:46.086 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/bpf 2023-10-14T09:17:46.086 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T09:17:46.086 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/hugepages 2023-10-14T09:17:46.086 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/mqueue 2023-10-14T09:17:46.087 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/debug 2023-10-14T09:17:46.087 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/tracing 2023-10-14T09:17:46.087 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/fs/nfsd 2023-10-14T09:17:46.087 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/fuse/connections 2023-10-14T09:17:46.088 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/config 2023-10-14T09:17:46.088 INFO:teuthology.orchestra.run.smithi157.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T09:17:46.088 INFO:teuthology.orchestra.run.smithi157.stdout:/run/rpc_pipefs 2023-10-14T09:17:46.088 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/1000 2023-10-14T09:17:46.088 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph 2023-10-14T09:17:46.089 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph/osd/ceph-4 2023-10-14T09:17:46.089 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph/osd/ceph-5 2023-10-14T09:17:46.089 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph/osd/ceph-6 2023-10-14T09:17:46.089 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph/osd/ceph-7 2023-10-14T09:17:46.090 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns 2023-10-14T09:17:46.090 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T09:17:46.090 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T09:17:46.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:46.091 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2023-10-14T09:17:46.142 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T09:17:46.142 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-14T09:17:46.189 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2023-10-14T09:17:46.214 DEBUG:teuthology.orchestra.run.smithi157:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T09:17:46.271 INFO:teuthology.orchestra.run.smithi157.stdout:/sys 2023-10-14T09:17:46.272 INFO:teuthology.orchestra.run.smithi157.stdout:/proc 2023-10-14T09:17:46.272 INFO:teuthology.orchestra.run.smithi157.stdout:/dev 2023-10-14T09:17:46.272 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/pts 2023-10-14T09:17:46.272 INFO:teuthology.orchestra.run.smithi157.stdout:/run 2023-10-14T09:17:46.273 INFO:teuthology.orchestra.run.smithi157.stdout:/ 2023-10-14T09:17:46.273 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/security 2023-10-14T09:17:46.273 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/shm 2023-10-14T09:17:46.273 INFO:teuthology.orchestra.run.smithi157.stdout:/run/lock 2023-10-14T09:17:46.273 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup 2023-10-14T09:17:46.274 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/pstore 2023-10-14T09:17:46.274 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/bpf 2023-10-14T09:17:46.274 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T09:17:46.274 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/hugepages 2023-10-14T09:17:46.274 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/mqueue 2023-10-14T09:17:46.275 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/debug 2023-10-14T09:17:46.275 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/tracing 2023-10-14T09:17:46.275 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/fs/nfsd 2023-10-14T09:17:46.275 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/fuse/connections 2023-10-14T09:17:46.275 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/config 2023-10-14T09:17:46.276 INFO:teuthology.orchestra.run.smithi157.stdout:/run/credentials/systemd-sysusers.service 2023-10-14T09:17:46.276 INFO:teuthology.orchestra.run.smithi157.stdout:/run/rpc_pipefs 2023-10-14T09:17:46.276 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/1000 2023-10-14T09:17:46.276 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph 2023-10-14T09:17:46.276 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph/osd/ceph-4 2023-10-14T09:17:46.277 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph/osd/ceph-5 2023-10-14T09:17:46.277 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph/osd/ceph-6 2023-10-14T09:17:46.277 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph/osd/ceph-7 2023-10-14T09:17:46.277 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns 2023-10-14T09:17:46.277 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T09:17:46.278 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T09:17:46.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:46.279 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2023-10-14T09:17:46.299 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi157.stderr:2023-10-14T09:17:46.295+0000 7f8ad4055580 -1 init, newargv = 0x55d82a3b2fe0 newargc=15 2023-10-14T09:17:46.299 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi157.stderr:ceph-fuse[42133]: starting ceph client 2023-10-14T09:17:46.306 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi157.stderr:ceph-fuse[42133]: starting fuse 2023-10-14T09:17:46.308 INFO:teuthology.orchestra.run.smithi157.stdout:43 2023-10-14T09:17:46.308 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-10-14T09:17:46.309 DEBUG:teuthology.orchestra.run.smithi157:> sudo stdin-killer -- python3 -c ' 2023-10-14T09:17:46.309 DEBUG:teuthology.orchestra.run.smithi157:> import glob 2023-10-14T09:17:46.309 DEBUG:teuthology.orchestra.run.smithi157:> import re 2023-10-14T09:17:46.309 DEBUG:teuthology.orchestra.run.smithi157:> import os 2023-10-14T09:17:46.310 DEBUG:teuthology.orchestra.run.smithi157:> import subprocess 2023-10-14T09:17:46.310 DEBUG:teuthology.orchestra.run.smithi157:> 2023-10-14T09:17:46.310 DEBUG:teuthology.orchestra.run.smithi157:> def _find_admin_socket(client_name): 2023-10-14T09:17:46.311 DEBUG:teuthology.orchestra.run.smithi157:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-14T09:17:46.311 DEBUG:teuthology.orchestra.run.smithi157:> files = glob.glob(asok_path) 2023-10-14T09:17:46.311 DEBUG:teuthology.orchestra.run.smithi157:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-14T09:17:46.312 DEBUG:teuthology.orchestra.run.smithi157:> 2023-10-14T09:17:46.312 DEBUG:teuthology.orchestra.run.smithi157:> # Given a non-glob path, it better be there 2023-10-14T09:17:46.312 DEBUG:teuthology.orchestra.run.smithi157:> if "*" not in asok_path: 2023-10-14T09:17:46.312 DEBUG:teuthology.orchestra.run.smithi157:> assert(len(files) == 1) 2023-10-14T09:17:46.313 DEBUG:teuthology.orchestra.run.smithi157:> return files[0] 2023-10-14T09:17:46.313 DEBUG:teuthology.orchestra.run.smithi157:> 2023-10-14T09:17:46.313 DEBUG:teuthology.orchestra.run.smithi157:> for f in files: 2023-10-14T09:17:46.313 DEBUG:teuthology.orchestra.run.smithi157:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T09:17:46.314 DEBUG:teuthology.orchestra.run.smithi157:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T09:17:46.314 DEBUG:teuthology.orchestra.run.smithi157:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T09:17:46.314 DEBUG:teuthology.orchestra.run.smithi157:> contents = proc_f.read() 2023-10-14T09:17:46.315 DEBUG:teuthology.orchestra.run.smithi157:> if mountpoint in contents: 2023-10-14T09:17:46.315 DEBUG:teuthology.orchestra.run.smithi157:> return f 2023-10-14T09:17:46.315 DEBUG:teuthology.orchestra.run.smithi157:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T09:17:46.316 DEBUG:teuthology.orchestra.run.smithi157:> 2023-10-14T09:17:46.316 DEBUG:teuthology.orchestra.run.smithi157:> print(_find_admin_socket("client.1")) 2023-10-14T09:17:46.316 DEBUG:teuthology.orchestra.run.smithi157:> ' 2023-10-14T09:17:46.434 INFO:teuthology.orchestra.run.smithi157.stdout:/var/run/ceph/ceph-client.1.42133.asok 2023-10-14T09:17:46.437 INFO:teuthology.orchestra.run.smithi157.stderr:2023-10-14T09:17:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T09:17:46.445 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42133.asok 2023-10-14T09:17:46.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:46.446 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42133.asok status 2023-10-14T09:17:46.618 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2023-10-14T09:17:46.619 INFO:teuthology.orchestra.run.smithi157.stdout: "metadata": { 2023-10-14T09:17:46.619 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T09:17:46.619 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T09:17:46.619 INFO:teuthology.orchestra.run.smithi157.stdout: "entity_id": "1", 2023-10-14T09:17:46.620 INFO:teuthology.orchestra.run.smithi157.stdout: "hostname": "smithi157", 2023-10-14T09:17:46.620 INFO:teuthology.orchestra.run.smithi157.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-14T09:17:46.620 INFO:teuthology.orchestra.run.smithi157.stdout: "pid": "42133", 2023-10-14T09:17:46.620 INFO:teuthology.orchestra.run.smithi157.stdout: "root": "/" 2023-10-14T09:17:46.620 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-14T09:17:46.621 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_count": 0, 2023-10-14T09:17:46.621 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_pinned_count": 0, 2023-10-14T09:17:46.621 INFO:teuthology.orchestra.run.smithi157.stdout: "id": 4544, 2023-10-14T09:17:46.621 INFO:teuthology.orchestra.run.smithi157.stdout: "inst": { 2023-10-14T09:17:46.621 INFO:teuthology.orchestra.run.smithi157.stdout: "name": { 2023-10-14T09:17:46.621 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "client", 2023-10-14T09:17:46.622 INFO:teuthology.orchestra.run.smithi157.stdout: "num": 4544 2023-10-14T09:17:46.622 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-14T09:17:46.622 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2023-10-14T09:17:46.622 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2023-10-14T09:17:46.622 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "192.168.0.1:0", 2023-10-14T09:17:46.623 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 3339410121 2023-10-14T09:17:46.623 INFO:teuthology.orchestra.run.smithi157.stdout: } 2023-10-14T09:17:46.623 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-14T09:17:46.623 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2023-10-14T09:17:46.623 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2023-10-14T09:17:46.624 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "192.168.0.1:0", 2023-10-14T09:17:46.624 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 3339410121 2023-10-14T09:17:46.624 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2023-10-14T09:17:46.624 INFO:teuthology.orchestra.run.smithi157.stdout: "inst_str": "client.4544 192.168.0.1:0/3339410121", 2023-10-14T09:17:46.624 INFO:teuthology.orchestra.run.smithi157.stdout: "addr_str": "192.168.0.1:0/3339410121", 2023-10-14T09:17:46.624 INFO:teuthology.orchestra.run.smithi157.stdout: "inode_count": 1, 2023-10-14T09:17:46.625 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_epoch": 8, 2023-10-14T09:17:46.625 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch": 20, 2023-10-14T09:17:46.625 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch_barrier": 0, 2023-10-14T09:17:46.625 INFO:teuthology.orchestra.run.smithi157.stdout: "blocklisted": false, 2023-10-14T09:17:46.625 INFO:teuthology.orchestra.run.smithi157.stdout: "fs_name": "cephfs" 2023-10-14T09:17:46.626 INFO:teuthology.orchestra.run.smithi157.stdout:} 2023-10-14T09:17:46.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:46.634 DEBUG:teuthology.orchestra.run.smithi078:> stat --file-system '--printf=%T 2023-10-14T09:17:46.634 DEBUG:teuthology.orchestra.run.smithi078:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-14T09:17:46.645 INFO:teuthology.orchestra.run.smithi078.stdout:fuseblk 2023-10-14T09:17:46.645 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-14T09:17:46.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:46.646 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T09:17:46.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:46.712 DEBUG:teuthology.orchestra.run.smithi157:> stat --file-system '--printf=%T 2023-10-14T09:17:46.713 DEBUG:teuthology.orchestra.run.smithi157:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-14T09:17:46.722 INFO:teuthology.orchestra.run.smithi157.stdout:fuseblk 2023-10-14T09:17:46.722 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-14T09:17:46.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:46.723 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T09:17:46.790 INFO:teuthology.run_tasks:Running task exec... 2023-10-14T09:17:46.799 INFO:teuthology.task.exec:Executing custom commands... 2023-10-14T09:17:46.800 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:17:46.800 DEBUG:teuthology.orchestra.run.smithi078:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/crash/warn_recent_interval 0' 2023-10-14T09:17:46.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.940+0000 7fae07068640 1 Processor -- start 2023-10-14T09:17:46.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.940+0000 7fae07068640 1 -- start start 2023-10-14T09:17:46.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae07068640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fae0013a080 0x7fae00151f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:46.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae07068640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fae000bfb90 0x7fae00152460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:46.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae07068640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae001529a0 0x7fae00150a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:46.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae07068640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae000a8900 con 0x7fae001529a0 2023-10-14T09:17:46.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae07068640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae00072150 con 0x7fae0013a080 2023-10-14T09:17:46.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae07068640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0006c6a0 con 0x7fae000bfb90 2023-10-14T09:17:46.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae05605640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae001529a0 0x7fae00150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:46.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae05605640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae001529a0 0x7fae00150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51176/0 (socket says 172.21.15.78:51176) 2023-10-14T09:17:46.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae05605640 1 -- 172.21.15.78:0/3880945776 learned_addr learned my addr 172.21.15.78:0/3880945776 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:46.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae04e04640 1 --2- 172.21.15.78:0/3880945776 >> v2:172.21.15.157:3300/0 conn(0x7fae0013a080 0x7fae00151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:46.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fadf7fff640 1 --2- 172.21.15.78:0/3880945776 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fae000bfb90 0x7fae00152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:46.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae05605640 1 -- 172.21.15.78:0/3880945776 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fae000bfb90 msgr2=0x7fae00152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:46.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae05605640 1 --2- 172.21.15.78:0/3880945776 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fae000bfb90 0x7fae00152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:46.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae05605640 1 -- 172.21.15.78:0/3880945776 >> v2:172.21.15.157:3300/0 conn(0x7fae0013a080 msgr2=0x7fae00151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:46.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae05605640 1 --2- 172.21.15.78:0/3880945776 >> v2:172.21.15.157:3300/0 conn(0x7fae0013a080 0x7fae00151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:46.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.944+0000 7fae05605640 1 -- 172.21.15.78:0/3880945776 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0006c980 con 0x7fae001529a0 2023-10-14T09:17:46.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae05605640 1 --2- 172.21.15.78:0/3880945776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae001529a0 0x7fae00150a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fae0006b900 tx=0x7fadf801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426b7668b0a8fe6f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:46.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fadf77fe640 1 -- 172.21.15.78:0/3880945776 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80a5820 con 0x7fae001529a0 2023-10-14T09:17:46.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fadf77fe640 1 -- 172.21.15.78:0/3880945776 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf80a5980 con 0x7fae001529a0 2023-10-14T09:17:46.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fadf77fe640 1 -- 172.21.15.78:0/3880945776 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80a5d10 con 0x7fae001529a0 2023-10-14T09:17:46.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae07068640 1 -- 172.21.15.78:0/3880945776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae001529a0 msgr2=0x7fae00150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:46.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae07068640 1 --2- 172.21.15.78:0/3880945776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae001529a0 0x7fae00150a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fae0006b900 tx=0x7fadf801c9a0 comp rx=0 tx=0).stop 2023-10-14T09:17:46.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae07068640 1 -- 172.21.15.78:0/3880945776 shutdown_connections 2023-10-14T09:17:46.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae07068640 1 --2- 172.21.15.78:0/3880945776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae001529a0 0x7fae00150a20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:46.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae07068640 1 --2- 172.21.15.78:0/3880945776 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fae000bfb90 0x7fae00152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:46.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae07068640 1 --2- 172.21.15.78:0/3880945776 >> v2:172.21.15.157:3300/0 conn(0x7fae0013a080 0x7fae00151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:46.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae07068640 1 -- 172.21.15.78:0/3880945776 >> 172.21.15.78:0/3880945776 conn(0x7fae000c5210 msgr2=0x7fae000c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:46.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae07068640 1 -- 172.21.15.78:0/3880945776 shutdown_connections 2023-10-14T09:17:46.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae07068640 1 -- 172.21.15.78:0/3880945776 wait complete. 2023-10-14T09:17:46.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae07068640 1 Processor -- start 2023-10-14T09:17:46.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.948+0000 7fae07068640 1 -- start start 2023-10-14T09:17:46.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae07068640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae000bfb90 0x7fae00135650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:46.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae07068640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0013a080 0x7fae000c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:46.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae07068640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fae001529a0 0x7fae000c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:46.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae07068640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae000a9e90 con 0x7fae000bfb90 2023-10-14T09:17:46.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae07068640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae001ed0c0 con 0x7fae0013a080 2023-10-14T09:17:46.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae07068640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae000c4c40 con 0x7fae001529a0 2023-10-14T09:17:46.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae04e04640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae000bfb90 0x7fae00135650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:46.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae04e04640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae000bfb90 0x7fae00135650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51178/0 (socket says 172.21.15.78:51178) 2023-10-14T09:17:46.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae04e04640 1 -- 172.21.15.78:0/4165860651 learned_addr learned my addr 172.21.15.78:0/4165860651 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:46.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fadf7fff640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0013a080 0x7fae000c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:46.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae05605640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fae001529a0 0x7fae000c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:46.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae04e04640 1 -- 172.21.15.78:0/4165860651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fae001529a0 msgr2=0x7fae000c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:46.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae04e04640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fae001529a0 0x7fae000c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:46.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae04e04640 1 -- 172.21.15.78:0/4165860651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0013a080 msgr2=0x7fae000c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:46.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae04e04640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0013a080 0x7fae000c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:46.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae04e04640 1 -- 172.21.15.78:0/4165860651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf8009b30 con 0x7fae000bfb90 2023-10-14T09:17:46.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae04e04640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae000bfb90 0x7fae00135650 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00d800 tx=0x7fadfc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:46.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fadf57fa640 1 -- 172.21.15.78:0/4165860651 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00b6c0 con 0x7fae000bfb90 2023-10-14T09:17:46.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fadf57fa640 1 -- 172.21.15.78:0/4165860651 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc00b820 con 0x7fae000bfb90 2023-10-14T09:17:46.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae07068640 1 -- 172.21.15.78:0/4165860651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae000ab370 con 0x7fae000bfb90 2023-10-14T09:17:46.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fadf57fa640 1 -- 172.21.15.78:0/4165860651 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00bb90 con 0x7fae000bfb90 2023-10-14T09:17:46.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae07068640 1 -- 172.21.15.78:0/4165860651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae001ecce0 con 0x7fae000bfb90 2023-10-14T09:17:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fae07068640 1 -- 172.21.15.78:0/4165860651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae00073bb0 con 0x7fae000bfb90 2023-10-14T09:17:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.952+0000 7fadf57fa640 1 -- 172.21.15.78:0/4165860651 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fadfc00bcf0 con 0x7fae000bfb90 2023-10-14T09:17:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.956+0000 7fadf57fa640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fadec0664a0 0x7fadec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:46.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.956+0000 7fadf57fa640 1 -- 172.21.15.78:0/4165860651 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadfc084240 con 0x7fae000bfb90 2023-10-14T09:17:46.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.956+0000 7fadf7fff640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fadec0664a0 0x7fadec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:46.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.956+0000 7fadf7fff640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fadec0664a0 0x7fadec068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fae00135f20 tx=0x7fadf0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:46.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:46.960+0000 7fadf57fa640 1 -- 172.21.15.78:0/4165860651 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fadfc051800 con 0x7fae000bfb90 2023-10-14T09:17:47.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.108+0000 7fae07068640 1 -- 172.21.15.78:0/4165860651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mgr/crash/warn_recent_interval}] v 0) v1 -- 0x7fae00071a20 con 0x7fae000bfb90 2023-10-14T09:17:47.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.112+0000 7fadf57fa640 1 -- 172.21.15.78:0/4165860651 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/crash/warn_recent_interval}]=0 v10)=0 v10) v1 ==== 128+0+0 (secure 0 0 0) 0x7fadfc054e20 con 0x7fae000bfb90 2023-10-14T09:17:47.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 -- 172.21.15.78:0/4165860651 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fadec0664a0 msgr2=0x7fadec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fadec0664a0 0x7fadec068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fae00135f20 tx=0x7fadf0008040 comp rx=0 tx=0).stop 2023-10-14T09:17:47.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 -- 172.21.15.78:0/4165860651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae000bfb90 msgr2=0x7fae00135650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae000bfb90 0x7fae00135650 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00d800 tx=0x7fadfc00dcc0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 -- 172.21.15.78:0/4165860651 shutdown_connections 2023-10-14T09:17:47.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fadec0664a0 0x7fadec068960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fae001529a0 0x7fae000c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae0013a080 0x7fae000c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 --2- 172.21.15.78:0/4165860651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae000bfb90 0x7fae00135650 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 -- 172.21.15.78:0/4165860651 >> 172.21.15.78:0/4165860651 conn(0x7fae000c5210 msgr2=0x7fae000c0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:47.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 -- 172.21.15.78:0/4165860651 shutdown_connections 2023-10-14T09:17:47.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.116+0000 7fae07068640 1 -- 172.21.15.78:0/4165860651 wait complete. 2023-10-14T09:17:47.138 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-14T09:17:47.154 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:47.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f695d491640 1 Processor -- start 2023-10-14T09:17:47.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f695d491640 1 -- start start 2023-10-14T09:17:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f695d491640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69580c4fa0 0x7f6958157e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f695d491640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69580c4400 0x7f69580c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f695d491640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69580c4950 con 0x7f6958151240 2023-10-14T09:17:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f695d491640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69580c7bf0 con 0x7f69580c4400 2023-10-14T09:17:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f695d491640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6958157370 con 0x7f69580c4fa0 2023-10-14T09:17:47.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f6956ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6958151240 0x7f69580c74e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35984/0 (socket says 172.21.15.78:35984) 2023-10-14T09:17:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f6956ffd640 1 -- 172.21.15.78:0/3595932698 learned_addr learned my addr 172.21.15.78:0/3595932698 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f69577fe640 1 --2- 172.21.15.78:0/3595932698 >> v2:172.21.15.78:3300/0 conn(0x7f69580c4400 0x7f69580c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f694ffff640 1 --2- 172.21.15.78:0/3595932698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69580c4fa0 0x7f6958157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f69567fc640 1 -- 172.21.15.78:0/3595932698 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718655255 0 0) 0x7f69580c4950 con 0x7f6958151240 2023-10-14T09:17:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f69567fc640 1 -- 172.21.15.78:0/3595932698 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6944003530 con 0x7f6958151240 2023-10-14T09:17:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f69577fe640 1 -- 172.21.15.78:0/3595932698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69580c4fa0 msgr2=0x7f6958157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f69577fe640 1 --2- 172.21.15.78:0/3595932698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69580c4fa0 0x7f6958157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f69577fe640 1 -- 172.21.15.78:0/3595932698 >> v1:172.21.15.78:6789/0 conn(0x7f6958151240 legacy=0x7f69580c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.292+0000 7f69577fe640 1 -- 172.21.15.78:0/3595932698 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6958157650 con 0x7f69580c4400 2023-10-14T09:17:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f69577fe640 1 --2- 172.21.15.78:0/3595932698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69580c4400 0x7f69580c5410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6950009dc0 tx=0x7f695001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22b439b041c8f57 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f69567fc640 1 -- 172.21.15.78:0/3595932698 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500a5870 con 0x7f69580c4400 2023-10-14T09:17:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f69567fc640 1 -- 172.21.15.78:0/3595932698 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69500a59d0 con 0x7f69580c4400 2023-10-14T09:17:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f69567fc640 1 -- 172.21.15.78:0/3595932698 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500a5d60 con 0x7f69580c4400 2023-10-14T09:17:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f695d491640 1 -- 172.21.15.78:0/3595932698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69580c4400 msgr2=0x7f69580c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f695d491640 1 --2- 172.21.15.78:0/3595932698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69580c4400 0x7f69580c5410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6950009dc0 tx=0x7f695001c8a0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f695d491640 1 -- 172.21.15.78:0/3595932698 shutdown_connections 2023-10-14T09:17:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f695d491640 1 --2- 172.21.15.78:0/3595932698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69580c4400 0x7f69580c5410 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f695d491640 1 --2- 172.21.15.78:0/3595932698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69580c4fa0 0x7f6958157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f695d491640 1 -- 172.21.15.78:0/3595932698 >> 172.21.15.78:0/3595932698 conn(0x7f69580c6060 msgr2=0x7f69580c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:47.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f695d491640 1 -- 172.21.15.78:0/3595932698 shutdown_connections 2023-10-14T09:17:47.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.296+0000 7f695d491640 1 -- 172.21.15.78:0/3595932698 wait complete. 2023-10-14T09:17:47.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f695d491640 1 Processor -- start 2023-10-14T09:17:47.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f695d491640 1 -- start start 2023-10-14T09:17:47.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f695d491640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69580c4400 0x7f69580be330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f695d491640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69580c4fa0 0x7f695814ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f695d491640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6958151240 0x7f695814cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f695d491640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69580c9030 con 0x7f69580c4400 2023-10-14T09:17:47.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f695d491640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69580bfbd0 con 0x7f6958151240 2023-10-14T09:17:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f695d491640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69580bf8f0 con 0x7f69580c4fa0 2023-10-14T09:17:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f6956ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69580c4400 0x7f69580be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f6956ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69580c4400 0x7f69580be330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51196/0 (socket says 172.21.15.78:51196) 2023-10-14T09:17:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f6956ffd640 1 -- 172.21.15.78:0/3858343612 learned_addr learned my addr 172.21.15.78:0/3858343612 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:47.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f69577fe640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6958151240 0x7f695814cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f694ffff640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69580c4fa0 0x7f695814ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f6956ffd640 1 -- 172.21.15.78:0/3858343612 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69580c4fa0 msgr2=0x7f695814ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f6956ffd640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69580c4fa0 0x7f695814ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f6956ffd640 1 -- 172.21.15.78:0/3858343612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6958151240 msgr2=0x7f695814cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f6956ffd640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6958151240 0x7f695814cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f6956ffd640 1 -- 172.21.15.78:0/3858343612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950009a70 con 0x7f69580c4400 2023-10-14T09:17:47.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f6956ffd640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69580c4400 0x7f69580be330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f694800c420 tx=0x7f694800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:47.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f694f7fe640 1 -- 172.21.15.78:0/3858343612 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948005cf0 con 0x7f69580c4400 2023-10-14T09:17:47.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f694f7fe640 1 -- 172.21.15.78:0/3858343612 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6948005e50 con 0x7f69580c4400 2023-10-14T09:17:47.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f694f7fe640 1 -- 172.21.15.78:0/3858343612 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69480072d0 con 0x7f69580c4400 2023-10-14T09:17:47.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f695d491640 1 -- 172.21.15.78:0/3858343612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69580beb80 con 0x7f69580c4400 2023-10-14T09:17:47.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.300+0000 7f695d491640 1 -- 172.21.15.78:0/3858343612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69580be870 con 0x7f69580c4400 2023-10-14T09:17:47.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.304+0000 7f695d491640 1 -- 172.21.15.78:0/3858343612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6958074180 con 0x7f69580c4400 2023-10-14T09:17:47.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.304+0000 7f694f7fe640 1 -- 172.21.15.78:0/3858343612 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6948007430 con 0x7f69580c4400 2023-10-14T09:17:47.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.304+0000 7f694f7fe640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f69380664a0 0x7f6938068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.304+0000 7f694f7fe640 1 -- 172.21.15.78:0/3858343612 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6948083330 con 0x7f69580c4400 2023-10-14T09:17:47.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.304+0000 7f694ffff640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f69380664a0 0x7f6938068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.304+0000 7f694ffff640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f69380664a0 0x7f6938068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f69581ed110 tx=0x7f6940009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:47.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.308+0000 7f694f7fe640 1 -- 172.21.15.78:0/3858343612 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6948050850 con 0x7f69580c4400 2023-10-14T09:17:47.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.460+0000 7f695d491640 1 -- 172.21.15.78:0/3858343612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f695808a2e0 con 0x7f69580c4400 2023-10-14T09:17:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.460+0000 7f694f7fe640 1 -- 172.21.15.78:0/3858343612 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f6948053e70 con 0x7f69580c4400 2023-10-14T09:17:47.465 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:47.466 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 -- 172.21.15.78:0/3858343612 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f69380664a0 msgr2=0x7f6938068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f69380664a0 0x7f6938068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f69581ed110 tx=0x7f6940009190 comp rx=0 tx=0).stop 2023-10-14T09:17:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 -- 172.21.15.78:0/3858343612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69580c4400 msgr2=0x7f69580be330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69580c4400 0x7f69580be330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f694800c420 tx=0x7f694800c8e0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 -- 172.21.15.78:0/3858343612 shutdown_connections 2023-10-14T09:17:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6958151240 0x7f695814cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f69380664a0 0x7f6938068960 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69580c4fa0 0x7f695814ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 --2- 172.21.15.78:0/3858343612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69580c4400 0x7f69580be330 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 -- 172.21.15.78:0/3858343612 >> 172.21.15.78:0/3858343612 conn(0x7f69580c6060 msgr2=0x7f6958072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 -- 172.21.15.78:0/3858343612 shutdown_connections 2023-10-14T09:17:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.464+0000 7f695d491640 1 -- 172.21.15.78:0/3858343612 wait complete. 2023-10-14T09:17:47.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:47.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.624+0000 7f6cd069c640 1 Processor -- start 2023-10-14T09:17:47.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.624+0000 7f6cd069c640 1 -- start start 2023-10-14T09:17:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.624+0000 7f6cd069c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc8151310 0x7f6cc80c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.624+0000 7f6cd069c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6cc80700d0 0x7f6cc80c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.624+0000 7f6cd069c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6cc80c1e20 0x7f6cc80c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.624+0000 7f6cd069c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc8157d50 con 0x7f6cc80c1e20 2023-10-14T09:17:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.624+0000 7f6cd069c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc80c3b80 con 0x7f6cc80700d0 2023-10-14T09:17:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.624+0000 7f6cd069c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc8158280 con 0x7f6cc8151310 2023-10-14T09:17:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.624+0000 7f6ccec39640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6cc80c1e20 0x7f6cc80c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.624+0000 7f6ccec39640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6cc80c1e20 0x7f6cc80c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51212/0 (socket says 172.21.15.78:51212) 2023-10-14T09:17:47.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6ccec39640 1 -- 172.21.15.78:0/1128289824 learned_addr learned my addr 172.21.15.78:0/1128289824 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:47.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6ccdc37640 1 --2- 172.21.15.78:0/1128289824 >> v2:172.21.15.157:3300/0 conn(0x7f6cc80700d0 0x7f6cc80c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6cce438640 1 --2- 172.21.15.78:0/1128289824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc8151310 0x7f6cc80c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6ccec39640 1 -- 172.21.15.78:0/1128289824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc8151310 msgr2=0x7f6cc80c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:47.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6ccec39640 1 --2- 172.21.15.78:0/1128289824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc8151310 0x7f6cc80c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6ccec39640 1 -- 172.21.15.78:0/1128289824 >> v2:172.21.15.157:3300/0 conn(0x7f6cc80700d0 msgr2=0x7f6cc80c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:47.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6ccec39640 1 --2- 172.21.15.78:0/1128289824 >> v2:172.21.15.157:3300/0 conn(0x7f6cc80700d0 0x7f6cc80c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6ccec39640 1 -- 172.21.15.78:0/1128289824 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8157fa0 con 0x7f6cc80c1e20 2023-10-14T09:17:47.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6ccec39640 1 --2- 172.21.15.78:0/1128289824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc80c1e20 0x7f6cc80c4550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80c8470 tx=0x7f6cc001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475c62f8e75b56c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6ccd436640 1 -- 172.21.15.78:0/1128289824 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00a56f0 con 0x7f6cc80c1e20 2023-10-14T09:17:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6ccd436640 1 -- 172.21.15.78:0/1128289824 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc00a5850 con 0x7f6cc80c1e20 2023-10-14T09:17:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.628+0000 7f6ccd436640 1 -- 172.21.15.78:0/1128289824 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00a5be0 con 0x7f6cc80c1e20 2023-10-14T09:17:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 -- 172.21.15.78:0/1128289824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc80c1e20 msgr2=0x7f6cc80c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 --2- 172.21.15.78:0/1128289824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc80c1e20 0x7f6cc80c4550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80c8470 tx=0x7f6cc001c940 comp rx=0 tx=0).stop 2023-10-14T09:17:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 -- 172.21.15.78:0/1128289824 shutdown_connections 2023-10-14T09:17:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 --2- 172.21.15.78:0/1128289824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc80c1e20 0x7f6cc80c4550 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 --2- 172.21.15.78:0/1128289824 >> v2:172.21.15.157:3300/0 conn(0x7f6cc80700d0 0x7f6cc80c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 --2- 172.21.15.78:0/1128289824 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc8151310 0x7f6cc80c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 -- 172.21.15.78:0/1128289824 >> 172.21.15.78:0/1128289824 conn(0x7f6cc806a2c0 msgr2=0x7f6cc806a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 -- 172.21.15.78:0/1128289824 shutdown_connections 2023-10-14T09:17:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 -- 172.21.15.78:0/1128289824 wait complete. 2023-10-14T09:17:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 Processor -- start 2023-10-14T09:17:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 -- start start 2023-10-14T09:17:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc80c1e20 0x7f6cc81f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc8151310 0x7f6cc81558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc81f0640 0x7f6cc8155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80bc2a0 con 0x7f6cc8151310 2023-10-14T09:17:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80bd710 con 0x7f6cc80c1e20 2023-10-14T09:17:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cd069c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc8156360 con 0x7f6cc81f0640 2023-10-14T09:17:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6ccdc37640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc8151310 0x7f6cc81558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6ccdc37640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc8151310 0x7f6cc81558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51228/0 (socket says 172.21.15.78:51228) 2023-10-14T09:17:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6ccdc37640 1 -- 172.21.15.78:0/1003321869 learned_addr learned my addr 172.21.15.78:0/1003321869 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:47.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6cce438640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc80c1e20 0x7f6cc81f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6ccec39640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc81f0640 0x7f6cc8155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6ccdc37640 1 -- 172.21.15.78:0/1003321869 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc81f0640 msgr2=0x7f6cc8155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6ccdc37640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc81f0640 0x7f6cc8155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6ccdc37640 1 -- 172.21.15.78:0/1003321869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc80c1e20 msgr2=0x7f6cc81f0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6ccdc37640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc80c1e20 0x7f6cc81f0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6ccdc37640 1 -- 172.21.15.78:0/1003321869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc0009b30 con 0x7f6cc8151310 2023-10-14T09:17:47.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6ccec39640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc81f0640 0x7f6cc8155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:47.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.632+0000 7f6ccdc37640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc8151310 0x7f6cc81558e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800e960 tx=0x7f6cb800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:47.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.636+0000 7f6cbeffd640 1 -- 172.21.15.78:0/1003321869 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8009690 con 0x7f6cc8151310 2023-10-14T09:17:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.636+0000 7f6cbeffd640 1 -- 172.21.15.78:0/1003321869 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb800ca00 con 0x7f6cc8151310 2023-10-14T09:17:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.636+0000 7f6cd069c640 1 -- 172.21.15.78:0/1003321869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc80bbce0 con 0x7f6cc8151310 2023-10-14T09:17:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.636+0000 7f6cbeffd640 1 -- 172.21.15.78:0/1003321869 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb800cd70 con 0x7f6cc8151310 2023-10-14T09:17:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.636+0000 7f6cd069c640 1 -- 172.21.15.78:0/1003321869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc80bd940 con 0x7f6cc8151310 2023-10-14T09:17:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.636+0000 7f6cd069c640 1 -- 172.21.15.78:0/1003321869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc8074110 con 0x7f6cc8151310 2023-10-14T09:17:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.636+0000 7f6cbeffd640 1 -- 172.21.15.78:0/1003321869 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6cb8013470 con 0x7f6cc8151310 2023-10-14T09:17:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.636+0000 7f6cbeffd640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cac0664a0 0x7f6cac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.636+0000 7f6cbeffd640 1 -- 172.21.15.78:0/1003321869 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cb8084120 con 0x7f6cc8151310 2023-10-14T09:17:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.636+0000 7f6cce438640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cac0664a0 0x7f6cac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.636+0000 7f6cce438640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cac0664a0 0x7f6cac068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6cc81579b0 tx=0x7f6cc4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:47.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.640+0000 7f6cbeffd640 1 -- 172.21.15.78:0/1003321869 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6cb80515a0 con 0x7f6cc8151310 2023-10-14T09:17:47.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.788+0000 7f6cd069c640 1 -- 172.21.15.78:0/1003321869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6cc80ad420 con 0x7f6cc8151310 2023-10-14T09:17:47.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cbeffd640 1 -- 172.21.15.78:0/1003321869 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6cb8054bc0 con 0x7f6cc8151310 2023-10-14T09:17:47.794 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:47.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 -- 172.21.15.78:0/1003321869 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cac0664a0 msgr2=0x7f6cac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cac0664a0 0x7f6cac068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6cc81579b0 tx=0x7f6cc4008040 comp rx=0 tx=0).stop 2023-10-14T09:17:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 -- 172.21.15.78:0/1003321869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc8151310 msgr2=0x7f6cc81558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc8151310 0x7f6cc81558e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800e960 tx=0x7f6cb800ee20 comp rx=0 tx=0).stop 2023-10-14T09:17:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 -- 172.21.15.78:0/1003321869 shutdown_connections 2023-10-14T09:17:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cac0664a0 0x7f6cac068960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc81f0640 0x7f6cc8155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc8151310 0x7f6cc81558e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 --2- 172.21.15.78:0/1003321869 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc80c1e20 0x7f6cc81f0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 -- 172.21.15.78:0/1003321869 >> 172.21.15.78:0/1003321869 conn(0x7f6cc806a2c0 msgr2=0x7f6cc815dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:47.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 -- 172.21.15.78:0/1003321869 shutdown_connections 2023-10-14T09:17:47.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.792+0000 7f6cd069c640 1 -- 172.21.15.78:0/1003321869 wait complete. 2023-10-14T09:17:47.814 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:17:47.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f9569fc4640 1 Processor -- start 2023-10-14T09:17:47.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f9569fc4640 1 -- start start 2023-10-14T09:17:47.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f9569fc4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f956406cc50 0x7f95640c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f9569fc4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95640c7af0 con 0x7f95640c4030 2023-10-14T09:17:47.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f9569fc4640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9564157360 con 0x7f9564153d90 2023-10-14T09:17:47.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f9569fc4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95640c5300 con 0x7f956406cc50 2023-10-14T09:17:47.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f955bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f956406cc50 0x7f95640c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f95637fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f95640c4030 0x7f95640c4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35990/0 (socket says 172.21.15.78:35990) 2023-10-14T09:17:47.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f95637fe640 1 -- 172.21.15.78:0/1944476384 learned_addr learned my addr 172.21.15.78:0/1944476384 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:47.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f955bfff640 1 -- 172.21.15.78:0/1944476384 >> v1:172.21.15.157:6789/0 conn(0x7f9564153d90 legacy=0x7f95641541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:47.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f955bfff640 1 -- 172.21.15.78:0/1944476384 >> v1:172.21.15.78:6789/0 conn(0x7f95640c4030 legacy=0x7f95640c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f9562ffd640 1 -- 172.21.15.78:0/1944476384 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642516713 0 0) 0x7f95640c7af0 con 0x7f95640c4030 2023-10-14T09:17:47.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.952+0000 7f955bfff640 1 -- 172.21.15.78:0/1944476384 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9564157ee0 con 0x7f956406cc50 2023-10-14T09:17:47.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.956+0000 7f955bfff640 1 --2- 172.21.15.78:0/1944476384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f956406cc50 0x7f95640c75b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f954c0097c0 tx=0x7f954c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ad1a99cea737d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:47.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.956+0000 7f9562ffd640 1 -- 172.21.15.78:0/1944476384 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c0ac410 con 0x7f956406cc50 2023-10-14T09:17:47.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.956+0000 7f9562ffd640 1 -- 172.21.15.78:0/1944476384 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c0ac570 con 0x7f956406cc50 2023-10-14T09:17:47.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.956+0000 7f9562ffd640 1 -- 172.21.15.78:0/1944476384 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c0ac900 con 0x7f956406cc50 2023-10-14T09:17:47.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.956+0000 7f9569fc4640 1 -- 172.21.15.78:0/1944476384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f956406cc50 msgr2=0x7f95640c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.956+0000 7f9569fc4640 1 --2- 172.21.15.78:0/1944476384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f956406cc50 0x7f95640c75b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f954c0097c0 tx=0x7f954c01c3b0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.956+0000 7f9569fc4640 1 -- 172.21.15.78:0/1944476384 shutdown_connections 2023-10-14T09:17:47.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.956+0000 7f9569fc4640 1 --2- 172.21.15.78:0/1944476384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f956406cc50 0x7f95640c75b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.956+0000 7f9569fc4640 1 -- 172.21.15.78:0/1944476384 >> 172.21.15.78:0/1944476384 conn(0x7f95640ab240 msgr2=0x7f95640ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:47.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.956+0000 7f9569fc4640 1 -- 172.21.15.78:0/1944476384 shutdown_connections 2023-10-14T09:17:47.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.956+0000 7f9569fc4640 1 -- 172.21.15.78:0/1944476384 wait complete. 2023-10-14T09:17:47.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9569fc4640 1 Processor -- start 2023-10-14T09:17:47.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9569fc4640 1 -- start start 2023-10-14T09:17:47.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9569fc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f956406cc50 0x7f956414acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9569fc4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95640c4030 0x7f95640a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9569fc4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9564153d90 0x7f9564150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9569fc4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95641506a0 con 0x7f956406cc50 2023-10-14T09:17:47.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9569fc4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95640acd40 con 0x7f95640c4030 2023-10-14T09:17:47.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9569fc4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956414ee30 con 0x7f9564153d90 2023-10-14T09:17:47.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f95637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f956406cc50 0x7f956414acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f95637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f956406cc50 0x7f956414acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51244/0 (socket says 172.21.15.78:51244) 2023-10-14T09:17:47.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f95637fe640 1 -- 172.21.15.78:0/689974919 learned_addr learned my addr 172.21.15.78:0/689974919 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:47.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f955bfff640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95640c4030 0x7f95640a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9563fff640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9564153d90 0x7f9564150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f95637fe640 1 -- 172.21.15.78:0/689974919 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9564153d90 msgr2=0x7f9564150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f95637fe640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9564153d90 0x7f9564150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f95637fe640 1 -- 172.21.15.78:0/689974919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95640c4030 msgr2=0x7f95640a90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:47.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f95637fe640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95640c4030 0x7f95640a90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:47.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f95637fe640 1 -- 172.21.15.78:0/689974919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c009420 con 0x7f956406cc50 2023-10-14T09:17:47.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f955bfff640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95640c4030 0x7f95640a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:47.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9563fff640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9564153d90 0x7f9564150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:47.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f95637fe640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f956406cc50 0x7f956414acd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f955400c550 tx=0x7f955400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:47.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9560ff9640 1 -- 172.21.15.78:0/689974919 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554005cf0 con 0x7f956406cc50 2023-10-14T09:17:47.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9560ff9640 1 -- 172.21.15.78:0/689974919 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9554005e70 con 0x7f956406cc50 2023-10-14T09:17:47.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9560ff9640 1 -- 172.21.15.78:0/689974919 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554007310 con 0x7f956406cc50 2023-10-14T09:17:47.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9569fc4640 1 -- 172.21.15.78:0/689974919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95640ae590 con 0x7f956406cc50 2023-10-14T09:17:47.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9569fc4640 1 -- 172.21.15.78:0/689974919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956414f3d0 con 0x7f956406cc50 2023-10-14T09:17:47.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.960+0000 7f9569fc4640 1 -- 172.21.15.78:0/689974919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956414f5c0 con 0x7f956406cc50 2023-10-14T09:17:47.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.964+0000 7f9560ff9640 1 -- 172.21.15.78:0/689974919 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9554007470 con 0x7f956406cc50 2023-10-14T09:17:47.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.964+0000 7f9560ff9640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95440664a0 0x7f9544068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:47.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.964+0000 7f9560ff9640 1 -- 172.21.15.78:0/689974919 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9554083520 con 0x7f956406cc50 2023-10-14T09:17:47.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.964+0000 7f955bfff640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95440664a0 0x7f9544068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:47.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.964+0000 7f955bfff640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95440664a0 0x7f9544068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f954c0ae000 tx=0x7f954c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:47.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:47.968+0000 7f9560ff9640 1 -- 172.21.15.78:0/689974919 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9554050990 con 0x7f956406cc50 2023-10-14T09:17:48.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.116+0000 7f9569fc4640 1 -- 172.21.15.78:0/689974919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9564074110 con 0x7f956406cc50 2023-10-14T09:17:48.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9560ff9640 1 -- 172.21.15.78:0/689974919 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9554053fb0 con 0x7f956406cc50 2023-10-14T09:17:48.121 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:17:48.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 -- 172.21.15.78:0/689974919 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95440664a0 msgr2=0x7f9544068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95440664a0 0x7f9544068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f954c0ae000 tx=0x7f954c008040 comp rx=0 tx=0).stop 2023-10-14T09:17:48.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 -- 172.21.15.78:0/689974919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f956406cc50 msgr2=0x7f956414acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f956406cc50 0x7f956414acd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f955400c550 tx=0x7f955400ca10 comp rx=0 tx=0).stop 2023-10-14T09:17:48.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 -- 172.21.15.78:0/689974919 shutdown_connections 2023-10-14T09:17:48.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95440664a0 0x7f9544068960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9564153d90 0x7f9564150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95640c4030 0x7f95640a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 --2- 172.21.15.78:0/689974919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f956406cc50 0x7f956414acd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 -- 172.21.15.78:0/689974919 >> 172.21.15.78:0/689974919 conn(0x7f95640ab240 msgr2=0x7f95640c4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:48.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 -- 172.21.15.78:0/689974919 shutdown_connections 2023-10-14T09:17:48.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.120+0000 7f9569fc4640 1 -- 172.21.15.78:0/689974919 wait complete. 2023-10-14T09:17:48.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:17:48.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.280+0000 7f3eaa491640 1 Processor -- start 2023-10-14T09:17:48.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.280+0000 7f3eaa491640 1 -- start start 2023-10-14T09:17:48.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3eaa491640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3ea4150ac0 0x7f3ea4150f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3eaa491640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ea41532c0 0x7f3ea4153750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3eaa491640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea4151fd0 con 0x7f3ea4139dc0 2023-10-14T09:17:48.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3eaa491640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea40702c0 con 0x7f3ea4150ac0 2023-10-14T09:17:48.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3eaa491640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4152ea0 con 0x7f3ea41532c0 2023-10-14T09:17:48.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea3fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3ea4139dc0 0x7f3ea40718a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36000/0 (socket says 172.21.15.78:36000) 2023-10-14T09:17:48.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea3fff640 1 -- 172.21.15.78:0/1177896341 learned_addr learned my addr 172.21.15.78:0/1177896341 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:48.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea8a2e640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ea41532c0 0x7f3ea4153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea37fe640 1 --2- 172.21.15.78:0/1177896341 >> v2:172.21.15.157:3300/0 conn(0x7f3ea4150ac0 0x7f3ea4150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803469684 0 0) 0x7f3ea4151fd0 con 0x7f3ea4139dc0 2023-10-14T09:17:48.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e8c003530 con 0x7f3ea4139dc0 2023-10-14T09:17:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 928195425 0 0) 0x7f3e8c003530 con 0x7f3ea4139dc0 2023-10-14T09:17:48.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ea41532c0 msgr2=0x7f3ea4153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ea41532c0 0x7f3ea4153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 >> v2:172.21.15.157:3300/0 conn(0x7f3ea4150ac0 msgr2=0x7f3ea4150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:48.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 --2- 172.21.15.78:0/1177896341 >> v2:172.21.15.157:3300/0 conn(0x7f3ea4150ac0 0x7f3ea4150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4152220 con 0x7f3ea4139dc0 2023-10-14T09:17:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f3e94001680 con 0x7f3ea4139dc0 2023-10-14T09:17:48.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 >> v1:172.21.15.78:6789/0 conn(0x7f3ea4139dc0 legacy=0x7f3ea40718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ea41532c0 0x7f3e8c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e8c003f00 0x7f3e8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e8c004d10 0x7f3e8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea40702c0 con 0x7f3e8c004d10 2023-10-14T09:17:48.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4152ea0 con 0x7f3e8c003f00 2023-10-14T09:17:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c00b9e0 con 0x7f3ea41532c0 2023-10-14T09:17:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea8a2e640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e8c004d10 0x7f3e8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ea41532c0 0x7f3e8c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea37fe640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e8c003f00 0x7f3e8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea8a2e640 1 -- 172.21.15.78:0/1177896341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ea41532c0 msgr2=0x7f3e8c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:48.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea8a2e640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3ea41532c0 0x7f3e8c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea8a2e640 1 -- 172.21.15.78:0/1177896341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e8c003f00 msgr2=0x7f3e8c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:48.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea8a2e640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e8c003f00 0x7f3e8c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.284+0000 7f3ea8a2e640 1 -- 172.21.15.78:0/1177896341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c003530 con 0x7f3e8c004d10 2023-10-14T09:17:48.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3ea8a2e640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e8c004d10 0x7f3e8c005190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00e170 tx=0x7f3e9c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bb21cd9466b687 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:48.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c0a5c50 con 0x7f3e8c004d10 2023-10-14T09:17:48.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c00f040 con 0x7f3e8c004d10 2023-10-14T09:17:48.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3ea2ffd640 1 -- 172.21.15.78:0/1177896341 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c0ad440 con 0x7f3e8c004d10 2023-10-14T09:17:48.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3eaa491640 1 -- 172.21.15.78:0/1177896341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e8c004d10 msgr2=0x7f3e8c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3eaa491640 1 --2- 172.21.15.78:0/1177896341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e8c004d10 0x7f3e8c005190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00e170 tx=0x7f3e9c01cc40 comp rx=0 tx=0).stop 2023-10-14T09:17:48.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3ea8a2e640 1 -- 172.21.15.78:0/1177896341 reap_dead start 2023-10-14T09:17:48.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3eaa491640 1 -- 172.21.15.78:0/1177896341 shutdown_connections 2023-10-14T09:17:48.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3eaa491640 1 -- 172.21.15.78:0/1177896341 >> 172.21.15.78:0/1177896341 conn(0x7f3ea40c1d00 msgr2=0x7f3ea40c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:48.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3eaa491640 1 -- 172.21.15.78:0/1177896341 shutdown_connections 2023-10-14T09:17:48.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3eaa491640 1 -- 172.21.15.78:0/1177896341 wait complete. 2023-10-14T09:17:48.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.288+0000 7f3eaa491640 1 Processor -- start 2023-10-14T09:17:48.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3eaa491640 1 -- start start 2023-10-14T09:17:48.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3eaa491640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e8c004d10 0x7f3ea40c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3eaa491640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea406cb90 0x7f3ea40c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3eaa491640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ea40c3b00 0x7f3ea41ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3eaa491640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea40a87b0 con 0x7f3ea406cb90 2023-10-14T09:17:48.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3eaa491640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea40c30e0 con 0x7f3ea40c3b00 2023-10-14T09:17:48.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3eaa491640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea406d150 con 0x7f3e8c004d10 2023-10-14T09:17:48.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea406cb90 0x7f3ea40c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea406cb90 0x7f3ea40c35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51268/0 (socket says 172.21.15.78:51268) 2023-10-14T09:17:48.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea37fe640 1 -- 172.21.15.78:0/2911706528 learned_addr learned my addr 172.21.15.78:0/2911706528 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:48.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea8a2e640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ea40c3b00 0x7f3ea41ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e8c004d10 0x7f3ea40c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea37fe640 1 -- 172.21.15.78:0/2911706528 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e8c004d10 msgr2=0x7f3ea40c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea37fe640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e8c004d10 0x7f3ea40c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea37fe640 1 -- 172.21.15.78:0/2911706528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ea40c3b00 msgr2=0x7f3ea41ec1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea37fe640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ea40c3b00 0x7f3ea41ec1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea37fe640 1 -- 172.21.15.78:0/2911706528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea406d430 con 0x7f3ea406cb90 2023-10-14T09:17:48.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea37fe640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea406cb90 0x7f3ea40c35c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3e98011aa0 tx=0x7f3e98011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:48.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea0ff9640 1 -- 172.21.15.78:0/2911706528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9800fac0 con 0x7f3ea406cb90 2023-10-14T09:17:48.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea0ff9640 1 -- 172.21.15.78:0/2911706528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9800fc20 con 0x7f3ea406cb90 2023-10-14T09:17:48.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3ea0ff9640 1 -- 172.21.15.78:0/2911706528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98014440 con 0x7f3ea406cb90 2023-10-14T09:17:48.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3eaa491640 1 -- 172.21.15.78:0/2911706528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea406d710 con 0x7f3ea406cb90 2023-10-14T09:17:48.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3eaa491640 1 -- 172.21.15.78:0/2911706528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea40c4bb0 con 0x7f3ea406cb90 2023-10-14T09:17:48.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.292+0000 7f3eaa491640 1 -- 172.21.15.78:0/2911706528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea40c32e0 con 0x7f3ea406cb90 2023-10-14T09:17:48.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.296+0000 7f3ea0ff9640 1 -- 172.21.15.78:0/2911706528 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3e980145a0 con 0x7f3ea406cb90 2023-10-14T09:17:48.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.296+0000 7f3ea0ff9640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3e900664d0 0x7f3e90068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.296+0000 7f3ea0ff9640 1 -- 172.21.15.78:0/2911706528 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e98084770 con 0x7f3ea406cb90 2023-10-14T09:17:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.296+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3e900664d0 0x7f3e90068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.296+0000 7f3ea3fff640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3e900664d0 0x7f3e90068990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e94000fc0 tx=0x7f3e94007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:48.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.300+0000 7f3ea0ff9640 1 -- 172.21.15.78:0/2911706528 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3ea40c32e0 con 0x7f3ea406cb90 2023-10-14T09:17:48.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.448+0000 7f3eaa491640 1 -- 172.21.15.78:0/2911706528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ea40c32e0 con 0x7f3ea406cb90 2023-10-14T09:17:48.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.448+0000 7f3ea0ff9640 1 -- 172.21.15.78:0/2911706528 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ea40c32e0 con 0x7f3ea406cb90 2023-10-14T09:17:48.452 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:17:48.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 -- 172.21.15.78:0/2911706528 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3e900664d0 msgr2=0x7f3e90068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3e900664d0 0x7f3e90068990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e94000fc0 tx=0x7f3e94007900 comp rx=0 tx=0).stop 2023-10-14T09:17:48.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 -- 172.21.15.78:0/2911706528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea406cb90 msgr2=0x7f3ea40c35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea406cb90 0x7f3ea40c35c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3e98011aa0 tx=0x7f3e98011ea0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 -- 172.21.15.78:0/2911706528 shutdown_connections 2023-10-14T09:17:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3ea40c3b00 0x7f3ea41ec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea406cb90 0x7f3ea40c35c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3e900664d0 0x7f3e90068990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 --2- 172.21.15.78:0/2911706528 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e8c004d10 0x7f3ea40c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 -- 172.21.15.78:0/2911706528 >> 172.21.15.78:0/2911706528 conn(0x7f3ea40c1d00 msgr2=0x7f3ea40c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:48.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 -- 172.21.15.78:0/2911706528 shutdown_connections 2023-10-14T09:17:48.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.452+0000 7f3eaa491640 1 -- 172.21.15.78:0/2911706528 wait complete. 2023-10-14T09:17:48.472 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:48.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb2b868640 1 Processor -- start 2023-10-14T09:17:48.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb2b868640 1 -- start start 2023-10-14T09:17:48.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb2b868640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffb2414ddb0 0x7ffb240c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb2b868640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffb24153e80 0x7ffb2406bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb2b868640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb240c6910 0x7ffb240c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb2b868640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb240c64f0 con 0x7ffb2414ddb0 2023-10-14T09:17:48.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb2b868640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb240c5300 con 0x7ffb24153e80 2023-10-14T09:17:48.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb2b868640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2406c470 con 0x7ffb240c6910 2023-10-14T09:17:48.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb28e03640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffb24153e80 0x7ffb2406bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb29e05640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb240c6910 0x7ffb240c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb29604640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffb2414ddb0 0x7ffb240c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb29e05640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb240c6910 0x7ffb240c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:53788/0 (socket says 172.21.15.78:53788) 2023-10-14T09:17:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.608+0000 7ffb29e05640 1 -- 172.21.15.78:0/814479940 learned_addr learned my addr 172.21.15.78:0/814479940 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.612+0000 7ffb29e05640 1 -- 172.21.15.78:0/814479940 >> v2:172.21.15.157:3300/0 conn(0x7ffb24153e80 msgr2=0x7ffb2406bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.612+0000 7ffb29e05640 1 --2- 172.21.15.78:0/814479940 >> v2:172.21.15.157:3300/0 conn(0x7ffb24153e80 0x7ffb2406bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.612+0000 7ffb29e05640 1 -- 172.21.15.78:0/814479940 >> v2:172.21.15.78:3300/0 conn(0x7ffb2414ddb0 msgr2=0x7ffb240c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:48.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.612+0000 7ffb29e05640 1 --2- 172.21.15.78:0/814479940 >> v2:172.21.15.78:3300/0 conn(0x7ffb2414ddb0 0x7ffb240c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.612+0000 7ffb29e05640 1 -- 172.21.15.78:0/814479940 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2406c750 con 0x7ffb240c6910 2023-10-14T09:17:48.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.612+0000 7ffb29604640 1 --2- 172.21.15.78:0/814479940 >> v2:172.21.15.78:3300/0 conn(0x7ffb2414ddb0 0x7ffb240c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:48.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.612+0000 7ffb29e05640 1 --2- 172.21.15.78:0/814479940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb240c6910 0x7ffb240c3fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb2406b8c0 tx=0x7ffb1c01c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=757a4edf0bb8aa35 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:48.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.612+0000 7ffb1bfff640 1 -- 172.21.15.78:0/814479940 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0a5700 con 0x7ffb240c6910 2023-10-14T09:17:48.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.612+0000 7ffb1bfff640 1 -- 172.21.15.78:0/814479940 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c0a5860 con 0x7ffb240c6910 2023-10-14T09:17:48.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.612+0000 7ffb1bfff640 1 -- 172.21.15.78:0/814479940 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0a5bf0 con 0x7ffb240c6910 2023-10-14T09:17:48.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 -- 172.21.15.78:0/814479940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb240c6910 msgr2=0x7ffb240c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 --2- 172.21.15.78:0/814479940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb240c6910 0x7ffb240c3fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb2406b8c0 tx=0x7ffb1c01c880 comp rx=0 tx=0).stop 2023-10-14T09:17:48.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 -- 172.21.15.78:0/814479940 shutdown_connections 2023-10-14T09:17:48.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 --2- 172.21.15.78:0/814479940 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb240c6910 0x7ffb240c3fe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 --2- 172.21.15.78:0/814479940 >> v2:172.21.15.157:3300/0 conn(0x7ffb24153e80 0x7ffb2406bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 --2- 172.21.15.78:0/814479940 >> v2:172.21.15.78:3300/0 conn(0x7ffb2414ddb0 0x7ffb240c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 -- 172.21.15.78:0/814479940 >> 172.21.15.78:0/814479940 conn(0x7ffb240ab1f0 msgr2=0x7ffb240ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:48.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 -- 172.21.15.78:0/814479940 shutdown_connections 2023-10-14T09:17:48.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 -- 172.21.15.78:0/814479940 wait complete. 2023-10-14T09:17:48.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 Processor -- start 2023-10-14T09:17:48.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 -- start start 2023-10-14T09:17:48.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb240c6910 0x7ffb241f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb2414ddb0 0x7ffb2414ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb24153e80 0x7ffb2414cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2415e580 con 0x7ffb240c6910 2023-10-14T09:17:48.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb241efbd0 con 0x7ffb24153e80 2023-10-14T09:17:48.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb2b868640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb241f05a0 con 0x7ffb2414ddb0 2023-10-14T09:17:48.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb29604640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb240c6910 0x7ffb241f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb29604640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb240c6910 0x7ffb241f0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51284/0 (socket says 172.21.15.78:51284) 2023-10-14T09:17:48.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb29604640 1 -- 172.21.15.78:0/4190727148 learned_addr learned my addr 172.21.15.78:0/4190727148 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:48.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.616+0000 7ffb28e03640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb2414ddb0 0x7ffb2414ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb29e05640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb24153e80 0x7ffb2414cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb29604640 1 -- 172.21.15.78:0/4190727148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb2414ddb0 msgr2=0x7ffb2414ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb29604640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb2414ddb0 0x7ffb2414ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb29604640 1 -- 172.21.15.78:0/4190727148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb24153e80 msgr2=0x7ffb2414cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb29604640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb24153e80 0x7ffb2414cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb29604640 1 -- 172.21.15.78:0/4190727148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb20009420 con 0x7ffb240c6910 2023-10-14T09:17:48.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb29e05640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb24153e80 0x7ffb2414cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:48.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb29604640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb240c6910 0x7ffb241f0060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000e9b0 tx=0x7ffb2000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:48.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb19ffb640 1 -- 172.21.15.78:0/4190727148 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20009700 con 0x7ffb240c6910 2023-10-14T09:17:48.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb19ffb640 1 -- 172.21.15.78:0/4190727148 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2000ca00 con 0x7ffb240c6910 2023-10-14T09:17:48.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb19ffb640 1 -- 172.21.15.78:0/4190727148 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000cd90 con 0x7ffb240c6910 2023-10-14T09:17:48.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb2b868640 1 -- 172.21.15.78:0/4190727148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c009b30 con 0x7ffb240c6910 2023-10-14T09:17:48.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb2b868640 1 -- 172.21.15.78:0/4190727148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2415dfc0 con 0x7ffb240c6910 2023-10-14T09:17:48.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb2b868640 1 -- 172.21.15.78:0/4190727148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb24074180 con 0x7ffb240c6910 2023-10-14T09:17:48.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.620+0000 7ffb19ffb640 1 -- 172.21.15.78:0/4190727148 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffb20013470 con 0x7ffb240c6910 2023-10-14T09:17:48.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.624+0000 7ffb19ffb640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb080664a0 0x7ffb08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.624+0000 7ffb19ffb640 1 -- 172.21.15.78:0/4190727148 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb20084030 con 0x7ffb240c6910 2023-10-14T09:17:48.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.624+0000 7ffb28e03640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb080664a0 0x7ffb08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.624+0000 7ffb28e03640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb080664a0 0x7ffb08068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb24155de0 tx=0x7ffb14008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:48.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.628+0000 7ffb19ffb640 1 -- 172.21.15.78:0/4190727148 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffb20051540 con 0x7ffb240c6910 2023-10-14T09:17:48.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 -- 172.21.15.78:0/4190727148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb240c7560 con 0x7ffb240c6910 2023-10-14T09:17:48.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb19ffb640 1 -- 172.21.15.78:0/4190727148 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7ffb20054b60 con 0x7ffb240c6910 2023-10-14T09:17:48.787 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:48.787 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:48.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 -- 172.21.15.78:0/4190727148 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb080664a0 msgr2=0x7ffb08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb080664a0 0x7ffb08068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffb24155de0 tx=0x7ffb14008040 comp rx=0 tx=0).stop 2023-10-14T09:17:48.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 -- 172.21.15.78:0/4190727148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb240c6910 msgr2=0x7ffb241f0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb240c6910 0x7ffb241f0060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000e9b0 tx=0x7ffb2000ee70 comp rx=0 tx=0).stop 2023-10-14T09:17:48.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 -- 172.21.15.78:0/4190727148 shutdown_connections 2023-10-14T09:17:48.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb24153e80 0x7ffb2414cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb080664a0 0x7ffb08068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb2414ddb0 0x7ffb2414ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 --2- 172.21.15.78:0/4190727148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb240c6910 0x7ffb241f0060 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 -- 172.21.15.78:0/4190727148 >> 172.21.15.78:0/4190727148 conn(0x7ffb240ab1f0 msgr2=0x7ffb24156050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:48.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 -- 172.21.15.78:0/4190727148 shutdown_connections 2023-10-14T09:17:48.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.784+0000 7ffb2b868640 1 -- 172.21.15.78:0/4190727148 wait complete. 2023-10-14T09:17:48.808 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:48.809 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:48.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15b5c09640 1 Processor -- start 2023-10-14T09:17:48.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15b5c09640 1 -- start start 2023-10-14T09:17:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15b5c09640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f15b0139dc0 0x7f15b00718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15b5c09640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15b0150ac0 0x7f15b0150f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15b5c09640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 0x7f15b0153750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15b5c09640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b00702c0 con 0x7f15b0150ac0 2023-10-14T09:17:48.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15b5c09640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b0152ea0 con 0x7f15b0139dc0 2023-10-14T09:17:48.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15b5c09640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b0151fd0 con 0x7f15b01532c0 2023-10-14T09:17:48.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15aeffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15b0150ac0 0x7f15b0150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15aeffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15b0150ac0 0x7f15b0150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51294/0 (socket says 172.21.15.78:51294) 2023-10-14T09:17:48.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15aeffd640 1 -- 172.21.15.78:0/1522548280 learned_addr learned my addr 172.21.15.78:0/1522548280 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:48.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15af7fe640 1 --2- 172.21.15.78:0/1522548280 >> v2:172.21.15.157:3300/0 conn(0x7f15b0139dc0 0x7f15b00718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15aeffd640 1 -- 172.21.15.78:0/1522548280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 msgr2=0x7f15b0153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:48.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15affff640 1 --2- 172.21.15.78:0/1522548280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 0x7f15b0153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15aeffd640 1 --2- 172.21.15.78:0/1522548280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 0x7f15b0153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15aeffd640 1 -- 172.21.15.78:0/1522548280 >> v2:172.21.15.157:3300/0 conn(0x7f15b0139dc0 msgr2=0x7f15b00718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:48.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15aeffd640 1 --2- 172.21.15.78:0/1522548280 >> v2:172.21.15.157:3300/0 conn(0x7f15b0139dc0 0x7f15b00718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15aeffd640 1 -- 172.21.15.78:0/1522548280 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b0152220 con 0x7f15b0150ac0 2023-10-14T09:17:48.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15af7fe640 1 --2- 172.21.15.78:0/1522548280 >> v2:172.21.15.157:3300/0 conn(0x7f15b0139dc0 0x7f15b00718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:48.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.948+0000 7f15affff640 1 --2- 172.21.15.78:0/1522548280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 0x7f15b0153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:48.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15aeffd640 1 --2- 172.21.15.78:0/1522548280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15b0150ac0 0x7f15b0150f40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f15b00c1730 tx=0x7f15a401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a77ceccd5ade8a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:48.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15ae7fc640 1 -- 172.21.15.78:0/1522548280 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a40ab600 con 0x7f15b0150ac0 2023-10-14T09:17:48.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15ae7fc640 1 -- 172.21.15.78:0/1522548280 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a40ab760 con 0x7f15b0150ac0 2023-10-14T09:17:48.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15ae7fc640 1 -- 172.21.15.78:0/1522548280 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a40abaf0 con 0x7f15b0150ac0 2023-10-14T09:17:48.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15b5c09640 1 -- 172.21.15.78:0/1522548280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15b0150ac0 msgr2=0x7f15b0150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15b5c09640 1 --2- 172.21.15.78:0/1522548280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15b0150ac0 0x7f15b0150f40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f15b00c1730 tx=0x7f15a401c440 comp rx=0 tx=0).stop 2023-10-14T09:17:48.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15b5c09640 1 -- 172.21.15.78:0/1522548280 shutdown_connections 2023-10-14T09:17:48.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15b5c09640 1 --2- 172.21.15.78:0/1522548280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15b0150ac0 0x7f15b0150f40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15b5c09640 1 --2- 172.21.15.78:0/1522548280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 0x7f15b0153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15b5c09640 1 --2- 172.21.15.78:0/1522548280 >> v2:172.21.15.157:3300/0 conn(0x7f15b0139dc0 0x7f15b00718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15b5c09640 1 -- 172.21.15.78:0/1522548280 >> 172.21.15.78:0/1522548280 conn(0x7f15b00c1d00 msgr2=0x7f15b00c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:48.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15b5c09640 1 -- 172.21.15.78:0/1522548280 shutdown_connections 2023-10-14T09:17:48.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15b5c09640 1 -- 172.21.15.78:0/1522548280 wait complete. 2023-10-14T09:17:48.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.952+0000 7f15b5c09640 1 Processor -- start 2023-10-14T09:17:48.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15b5c09640 1 -- start start 2023-10-14T09:17:48.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15b5c09640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15b0139dc0 0x7f15b015c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15b5c09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15b0150ac0 0x7f15b006a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15b5c09640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 0x7f15b00bb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15b5c09640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b01379d0 con 0x7f15b0150ac0 2023-10-14T09:17:48.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15b5c09640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b01ec330 con 0x7f15b0139dc0 2023-10-14T09:17:48.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15b5c09640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b01ec5d0 con 0x7f15b01532c0 2023-10-14T09:17:48.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15aeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15b0150ac0 0x7f15b006a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15aeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15b0150ac0 0x7f15b006a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51296/0 (socket says 172.21.15.78:51296) 2023-10-14T09:17:48.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15aeffd640 1 -- 172.21.15.78:0/2481810391 learned_addr learned my addr 172.21.15.78:0/2481810391 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:48.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15af7fe640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15b0139dc0 0x7f15b015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15affff640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 0x7f15b00bb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15aeffd640 1 -- 172.21.15.78:0/2481810391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 msgr2=0x7f15b00bb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15aeffd640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 0x7f15b00bb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15aeffd640 1 -- 172.21.15.78:0/2481810391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15b0139dc0 msgr2=0x7f15b015c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:48.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15aeffd640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15b0139dc0 0x7f15b015c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:48.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15aeffd640 1 -- 172.21.15.78:0/2481810391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a40094d0 con 0x7f15b0150ac0 2023-10-14T09:17:48.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15affff640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 0x7f15b00bb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:48.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15aeffd640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15b0150ac0 0x7f15b006a0f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f15a401aaf0 tx=0x7f15a401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:48.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f1597fff640 1 -- 172.21.15.78:0/2481810391 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a40b4800 con 0x7f15b0150ac0 2023-10-14T09:17:48.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f1597fff640 1 -- 172.21.15.78:0/2481810391 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a40b4980 con 0x7f15b0150ac0 2023-10-14T09:17:48.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f1597fff640 1 -- 172.21.15.78:0/2481810391 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a40b4d30 con 0x7f15b0150ac0 2023-10-14T09:17:48.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15b5c09640 1 -- 172.21.15.78:0/2481810391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b00c2e30 con 0x7f15b0150ac0 2023-10-14T09:17:48.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15b5c09640 1 -- 172.21.15.78:0/2481810391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b00c33f0 con 0x7f15b0150ac0 2023-10-14T09:17:48.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.956+0000 7f15b5c09640 1 -- 172.21.15.78:0/2481810391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b0074110 con 0x7f15b0150ac0 2023-10-14T09:17:48.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.960+0000 7f1597fff640 1 -- 172.21.15.78:0/2481810391 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f15a40c7440 con 0x7f15b0150ac0 2023-10-14T09:17:48.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.960+0000 7f1597fff640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f159c0664d0 0x7f159c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:48.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.960+0000 7f1597fff640 1 -- 172.21.15.78:0/2481810391 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15a411e900 con 0x7f15b0150ac0 2023-10-14T09:17:48.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.960+0000 7f15af7fe640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f159c0664d0 0x7f159c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:48.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.960+0000 7f15af7fe640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f159c0664d0 0x7f159c068990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f15a000aaf0 tx=0x7f15a0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:48.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:48.964+0000 7f1597fff640 1 -- 172.21.15.78:0/2481810391 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f15a40ebe20 con 0x7f15b0150ac0 2023-10-14T09:17:49.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f15b5c09640 1 -- 172.21.15.78:0/2481810391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15b00c0030 con 0x7f15b0150ac0 2023-10-14T09:17:49.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f1597fff640 1 -- 172.21.15.78:0/2481810391 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15a40ef440 con 0x7f15b0150ac0 2023-10-14T09:17:49.119 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:49.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f15b5c09640 1 -- 172.21.15.78:0/2481810391 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f159c0664d0 msgr2=0x7f159c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f15b5c09640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f159c0664d0 0x7f159c068990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f15a000aaf0 tx=0x7f15a0008040 comp rx=0 tx=0).stop 2023-10-14T09:17:49.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f15b5c09640 1 -- 172.21.15.78:0/2481810391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15b0150ac0 msgr2=0x7f15b006a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f15b5c09640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15b0150ac0 0x7f15b006a0f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f15a401aaf0 tx=0x7f15a401ac80 comp rx=0 tx=0).stop 2023-10-14T09:17:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f15b5c09640 1 -- 172.21.15.78:0/2481810391 shutdown_connections 2023-10-14T09:17:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f15b5c09640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f159c0664d0 0x7f159c068990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f15b5c09640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f15b01532c0 0x7f15b00bb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f15b5c09640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15b0150ac0 0x7f15b006a0f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f15b5c09640 1 --2- 172.21.15.78:0/2481810391 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f15b0139dc0 0x7f15b015c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.116+0000 7f15b5c09640 1 -- 172.21.15.78:0/2481810391 >> 172.21.15.78:0/2481810391 conn(0x7f15b00c1d00 msgr2=0x7f15b014fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.120+0000 7f15b5c09640 1 -- 172.21.15.78:0/2481810391 shutdown_connections 2023-10-14T09:17:49.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.120+0000 7f15b5c09640 1 -- 172.21.15.78:0/2481810391 wait complete. 2023-10-14T09:17:49.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:17:49.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.280+0000 7f0e1e594640 1 Processor -- start 2023-10-14T09:17:49.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.280+0000 7f0e1e594640 1 -- start start 2023-10-14T09:17:49.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.280+0000 7f0e1e594640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0e1806cc50 0x7f0e180c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.280+0000 7f0e1e594640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e180c7af0 con 0x7f0e180c4030 2023-10-14T09:17:49.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.280+0000 7f0e1e594640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e18157360 con 0x7f0e18153d90 2023-10-14T09:17:49.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.280+0000 7f0e1e594640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180c5300 con 0x7f0e1806cc50 2023-10-14T09:17:49.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.280+0000 7f0e17fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0e180c4030 0x7f0e180c4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36008/0 (socket says 172.21.15.78:36008) 2023-10-14T09:17:49.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.280+0000 7f0e17fff640 1 -- 172.21.15.78:0/113522723 learned_addr learned my addr 172.21.15.78:0/113522723 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:49.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.280+0000 7f0e177fe640 1 --2- 172.21.15.78:0/113522723 >> v2:172.21.15.157:3300/0 conn(0x7f0e1806cc50 0x7f0e180c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.280+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140441641 0 0) 0x7f0e180c7af0 con 0x7f0e180c4030 2023-10-14T09:17:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.280+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e00003530 con 0x7f0e180c4030 2023-10-14T09:17:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1214180010 0 0) 0x7f0e00003530 con 0x7f0e180c4030 2023-10-14T09:17:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 >> v2:172.21.15.157:3300/0 conn(0x7f0e1806cc50 msgr2=0x7f0e180c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 --2- 172.21.15.78:0/113522723 >> v2:172.21.15.157:3300/0 conn(0x7f0e1806cc50 0x7f0e180c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 >> v1:172.21.15.157:6789/0 conn(0x7f0e18153d90 legacy=0x7f0e181541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18157ee0 con 0x7f0e180c4030 2023-10-14T09:17:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f0e080016a0 con 0x7f0e180c4030 2023-10-14T09:17:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 >> v1:172.21.15.78:6789/0 conn(0x7f0e180c4030 legacy=0x7f0e180c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 --2- 172.21.15.78:0/113522723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e00003980 0x7f0e00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 --2- 172.21.15.78:0/113522723 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e000047d0 0x7f0e00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 --2- 172.21.15.78:0/113522723 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e00005190 0x7f0e0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0000c100 con 0x7f0e00003980 2023-10-14T09:17:49.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0000c270 con 0x7f0e000047d0 2023-10-14T09:17:49.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0000c430 con 0x7f0e00005190 2023-10-14T09:17:49.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e17fff640 1 --2- 172.21.15.78:0/113522723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e00003980 0x7f0e00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e177fe640 1 --2- 172.21.15.78:0/113522723 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e000047d0 0x7f0e00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e1cb31640 1 --2- 172.21.15.78:0/113522723 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e00005190 0x7f0e0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e17fff640 1 -- 172.21.15.78:0/113522723 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e00005190 msgr2=0x7f0e0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e17fff640 1 --2- 172.21.15.78:0/113522723 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e00005190 0x7f0e0000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e17fff640 1 -- 172.21.15.78:0/113522723 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e000047d0 msgr2=0x7f0e00004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:49.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e17fff640 1 --2- 172.21.15.78:0/113522723 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e000047d0 0x7f0e00004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e17fff640 1 -- 172.21.15.78:0/113522723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e00003530 con 0x7f0e00003980 2023-10-14T09:17:49.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e1cb31640 1 -- 172.21.15.78:0/113522723 reap_dead start 2023-10-14T09:17:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.284+0000 7f0e17fff640 1 --2- 172.21.15.78:0/113522723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e00003980 0x7f0e00003da0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0e1806c510 tx=0x7f0e0801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e48a44bed2b1f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08005ae0 con 0x7f0e00003980 2023-10-14T09:17:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e08005c40 con 0x7f0e00003980 2023-10-14T09:17:49.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e16ffd640 1 -- 172.21.15.78:0/113522723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e080a5a10 con 0x7f0e00003980 2023-10-14T09:17:49.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 -- 172.21.15.78:0/113522723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e00003980 msgr2=0x7f0e00003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 --2- 172.21.15.78:0/113522723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e00003980 0x7f0e00003da0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0e1806c510 tx=0x7f0e0801cc00 comp rx=0 tx=0).stop 2023-10-14T09:17:49.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 -- 172.21.15.78:0/113522723 shutdown_connections 2023-10-14T09:17:49.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 --2- 172.21.15.78:0/113522723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e00003980 0x7f0e00003da0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 -- 172.21.15.78:0/113522723 >> 172.21.15.78:0/113522723 conn(0x7f0e180ab240 msgr2=0x7f0e180ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:49.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 -- 172.21.15.78:0/113522723 shutdown_connections 2023-10-14T09:17:49.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 -- 172.21.15.78:0/113522723 wait complete. 2023-10-14T09:17:49.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 Processor -- start 2023-10-14T09:17:49.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 -- start start 2023-10-14T09:17:49.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e00003980 0x7f0e180ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e180c0290 0x7f0e180adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e181ec9d0 0x7f0e181ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180bda60 con 0x7f0e181ec9d0 2023-10-14T09:17:49.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180bd280 con 0x7f0e180c0290 2023-10-14T09:17:49.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.288+0000 7f0e1e594640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180bd520 con 0x7f0e00003980 2023-10-14T09:17:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1cb31640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e181ec9d0 0x7f0e181ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1cb31640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e181ec9d0 0x7f0e181ece60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51328/0 (socket says 172.21.15.78:51328) 2023-10-14T09:17:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1cb31640 1 -- 172.21.15.78:0/237077910 learned_addr learned my addr 172.21.15.78:0/237077910 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e17fff640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e00003980 0x7f0e180ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e177fe640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e180c0290 0x7f0e180adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1cb31640 1 -- 172.21.15.78:0/237077910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e00003980 msgr2=0x7f0e180ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1cb31640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e00003980 0x7f0e180ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1cb31640 1 -- 172.21.15.78:0/237077910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e180c0290 msgr2=0x7f0e180adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1cb31640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e180c0290 0x7f0e180adbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1cb31640 1 -- 172.21.15.78:0/237077910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180bdcb0 con 0x7f0e181ec9d0 2023-10-14T09:17:49.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e177fe640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e180c0290 0x7f0e180adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:49.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1cb31640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e181ec9d0 0x7f0e181ece60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0e1806c4e0 tx=0x7f0e1000e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:49.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e14ff9640 1 -- 172.21.15.78:0/237077910 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10003b90 con 0x7f0e181ec9d0 2023-10-14T09:17:49.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e14ff9640 1 -- 172.21.15.78:0/237077910 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e10003d10 con 0x7f0e181ec9d0 2023-10-14T09:17:49.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e14ff9640 1 -- 172.21.15.78:0/237077910 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10005310 con 0x7f0e181ec9d0 2023-10-14T09:17:49.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1e594640 1 -- 172.21.15.78:0/237077910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e180bdf90 con 0x7f0e181ec9d0 2023-10-14T09:17:49.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1e594640 1 -- 172.21.15.78:0/237077910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e181ed570 con 0x7f0e181ec9d0 2023-10-14T09:17:49.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e1e594640 1 -- 172.21.15.78:0/237077910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e180be180 con 0x7f0e181ec9d0 2023-10-14T09:17:49.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.292+0000 7f0e14ff9640 1 -- 172.21.15.78:0/237077910 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0e10005470 con 0x7f0e181ec9d0 2023-10-14T09:17:49.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.296+0000 7f0e14ff9640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e040664a0 0x7f0e04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.296+0000 7f0e14ff9640 1 -- 172.21.15.78:0/237077910 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e10083a50 con 0x7f0e181ec9d0 2023-10-14T09:17:49.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.296+0000 7f0e17fff640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e040664a0 0x7f0e04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.296+0000 7f0e17fff640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e040664a0 0x7f0e04068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0e080ab000 tx=0x7f0e080b1040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:49.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.300+0000 7f0e14ff9640 1 -- 172.21.15.78:0/237077910 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e10050ec0 con 0x7f0e181ec9d0 2023-10-14T09:17:49.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.448+0000 7f0e1e594640 1 -- 172.21.15.78:0/237077910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e180bd6e0 con 0x7f0e181ec9d0 2023-10-14T09:17:49.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.448+0000 7f0e14ff9640 1 -- 172.21.15.78:0/237077910 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e100544e0 con 0x7f0e181ec9d0 2023-10-14T09:17:49.453 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:17:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 -- 172.21.15.78:0/237077910 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e040664a0 msgr2=0x7f0e04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e040664a0 0x7f0e04068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0e080ab000 tx=0x7f0e080b1040 comp rx=0 tx=0).stop 2023-10-14T09:17:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 -- 172.21.15.78:0/237077910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e181ec9d0 msgr2=0x7f0e181ece60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e181ec9d0 0x7f0e181ece60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0e1806c4e0 tx=0x7f0e1000e960 comp rx=0 tx=0).stop 2023-10-14T09:17:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 -- 172.21.15.78:0/237077910 shutdown_connections 2023-10-14T09:17:49.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e181ec9d0 0x7f0e181ece60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0e180c0290 0x7f0e180adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0e040664a0 0x7f0e04068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 --2- 172.21.15.78:0/237077910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0e00003980 0x7f0e180ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 -- 172.21.15.78:0/237077910 >> 172.21.15.78:0/237077910 conn(0x7f0e180ab240 msgr2=0x7f0e180c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:49.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 -- 172.21.15.78:0/237077910 shutdown_connections 2023-10-14T09:17:49.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.452+0000 7f0e1e594640 1 -- 172.21.15.78:0/237077910 wait complete. 2023-10-14T09:17:49.473 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:17:49.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.608+0000 7ffbea565640 1 Processor -- start 2023-10-14T09:17:49.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.608+0000 7ffbea565640 1 -- start start 2023-10-14T09:17:49.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbea565640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe4151420 0x7ffbe40c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbea565640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffbe40c5390 0x7ffbe40c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbea565640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe406f6f0 con 0x7ffbe40c1e10 2023-10-14T09:17:49.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbea565640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe406ff00 con 0x7ffbe40c5390 2023-10-14T09:17:49.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbea565640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40c2aa0 con 0x7ffbe4151420 2023-10-14T09:17:49.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe37fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ffbe40c1e10 0x7ffbe40c3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36012/0 (socket says 172.21.15.78:36012) 2023-10-14T09:17:49.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe37fe640 1 -- 172.21.15.78:0/1491033805 learned_addr learned my addr 172.21.15.78:0/1491033805 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:49.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe8b02640 1 --2- 172.21.15.78:0/1491033805 >> v2:172.21.15.157:3300/0 conn(0x7ffbe40c5390 0x7ffbe40c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe3fff640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe4151420 0x7ffbe40c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555641378 0 0) 0x7ffbe406f6f0 con 0x7ffbe40c1e10 2023-10-14T09:17:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbcc003530 con 0x7ffbe40c1e10 2023-10-14T09:17:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1626065421 0 0) 0x7ffbcc003530 con 0x7ffbe40c1e10 2023-10-14T09:17:49.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe4151420 msgr2=0x7ffbe40c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe4151420 0x7ffbe40c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 >> v2:172.21.15.157:3300/0 conn(0x7ffbe40c5390 msgr2=0x7ffbe40c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 --2- 172.21.15.78:0/1491033805 >> v2:172.21.15.157:3300/0 conn(0x7ffbe40c5390 0x7ffbe40c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe4151800 con 0x7ffbe40c1e10 2023-10-14T09:17:49.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7ffbd8001680 con 0x7ffbe40c1e10 2023-10-14T09:17:49.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 >> v1:172.21.15.78:6789/0 conn(0x7ffbe40c1e10 legacy=0x7ffbe40c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbcc0039f0 0x7ffbcc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbcc0047d0 0x7ffbcc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe4151420 0x7ffbcc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe406ff00 con 0x7ffbcc0047d0 2023-10-14T09:17:49.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc00b990 con 0x7ffbcc0039f0 2023-10-14T09:17:49.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc00bb50 con 0x7ffbe4151420 2023-10-14T09:17:49.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe37fe640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbcc0047d0 0x7ffbcc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe3fff640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbcc0039f0 0x7ffbcc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe8b02640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe4151420 0x7ffbcc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe37fe640 1 -- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe4151420 msgr2=0x7ffbcc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:49.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe37fe640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe4151420 0x7ffbcc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe37fe640 1 -- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbcc0039f0 msgr2=0x7ffbcc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:49.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe37fe640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbcc0039f0 0x7ffbcc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe37fe640 1 -- 172.21.15.78:0/1491033805 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc003530 con 0x7ffbcc0047d0 2023-10-14T09:17:49.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.612+0000 7ffbe8b02640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe4151420 0x7ffbcc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:49.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.616+0000 7ffbe37fe640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbcc0047d0 0x7ffbcc004c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c290 tx=0x7ffbd801cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d265fbb7015f46f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:49.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.616+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80058e0 con 0x7ffbcc0047d0 2023-10-14T09:17:49.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.616+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd8005a40 con 0x7ffbcc0047d0 2023-10-14T09:17:49.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.616+0000 7ffbe2ffd640 1 -- 172.21.15.78:0/1491033805 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8005df0 con 0x7ffbcc0047d0 2023-10-14T09:17:49.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.616+0000 7ffbea565640 1 -- 172.21.15.78:0/1491033805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbcc0047d0 msgr2=0x7ffbcc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.616+0000 7ffbea565640 1 --2- 172.21.15.78:0/1491033805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbcc0047d0 0x7ffbcc004c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c290 tx=0x7ffbd801cce0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.616+0000 7ffbe8b02640 1 -- 172.21.15.78:0/1491033805 reap_dead start 2023-10-14T09:17:49.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.616+0000 7ffbea565640 1 -- 172.21.15.78:0/1491033805 shutdown_connections 2023-10-14T09:17:49.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.616+0000 7ffbea565640 1 -- 172.21.15.78:0/1491033805 >> 172.21.15.78:0/1491033805 conn(0x7ffbe4069e90 msgr2=0x7ffbe406a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:49.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.616+0000 7ffbea565640 1 -- 172.21.15.78:0/1491033805 shutdown_connections 2023-10-14T09:17:49.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.616+0000 7ffbea565640 1 -- 172.21.15.78:0/1491033805 wait complete. 2023-10-14T09:17:49.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbea565640 1 Processor -- start 2023-10-14T09:17:49.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbea565640 1 -- start start 2023-10-14T09:17:49.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbea565640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbcc0047d0 0x7ffbe41f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbea565640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbe41537d0 0x7ffbe4153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbea565640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe415cac0 0x7ffbe415cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbea565640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40ad190 con 0x7ffbe41537d0 2023-10-14T09:17:49.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbea565640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4152db0 con 0x7ffbcc0047d0 2023-10-14T09:17:49.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbea565640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4153340 con 0x7ffbe415cac0 2023-10-14T09:17:49.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbe41537d0 0x7ffbe4153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbe41537d0 0x7ffbe4153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51332/0 (socket says 172.21.15.78:51332) 2023-10-14T09:17:49.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe37fe640 1 -- 172.21.15.78:0/3533121251 learned_addr learned my addr 172.21.15.78:0/3533121251 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:49.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe8b02640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe415cac0 0x7ffbe415cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe3fff640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbcc0047d0 0x7ffbe41f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe37fe640 1 -- 172.21.15.78:0/3533121251 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe415cac0 msgr2=0x7ffbe415cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe37fe640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe415cac0 0x7ffbe415cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe37fe640 1 -- 172.21.15.78:0/3533121251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbcc0047d0 msgr2=0x7ffbe41f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe37fe640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbcc0047d0 0x7ffbe41f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe37fe640 1 -- 172.21.15.78:0/3533121251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe4150030 con 0x7ffbe41537d0 2023-10-14T09:17:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe37fe640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbe41537d0 0x7ffbe4153c50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c290 tx=0x7ffbcc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe0ff9640 1 -- 172.21.15.78:0/3533121251 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80047f0 con 0x7ffbe41537d0 2023-10-14T09:17:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe0ff9640 1 -- 172.21.15.78:0/3533121251 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd8004950 con 0x7ffbe41537d0 2023-10-14T09:17:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbe0ff9640 1 -- 172.21.15.78:0/3533121251 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8004d00 con 0x7ffbe41537d0 2023-10-14T09:17:49.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbea565640 1 -- 172.21.15.78:0/3533121251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe4150280 con 0x7ffbe41537d0 2023-10-14T09:17:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbea565640 1 -- 172.21.15.78:0/3533121251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe41f4710 con 0x7ffbe41537d0 2023-10-14T09:17:49.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.620+0000 7ffbea565640 1 -- 172.21.15.78:0/3533121251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe41534f0 con 0x7ffbe41537d0 2023-10-14T09:17:49.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.624+0000 7ffbe0ff9640 1 -- 172.21.15.78:0/3533121251 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffbd8007070 con 0x7ffbe41537d0 2023-10-14T09:17:49.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.624+0000 7ffbe0ff9640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffbd00664d0 0x7ffbd0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.624+0000 7ffbe0ff9640 1 -- 172.21.15.78:0/3533121251 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbd811cee0 con 0x7ffbe41537d0 2023-10-14T09:17:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.624+0000 7ffbe3fff640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffbd00664d0 0x7ffbd0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.624+0000 7ffbe3fff640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffbd00664d0 0x7ffbd0068990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009a80 tx=0x7ffbd4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:49.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.628+0000 7ffbe0ff9640 1 -- 172.21.15.78:0/3533121251 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffbe41534f0 con 0x7ffbe41537d0 2023-10-14T09:17:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.776+0000 7ffbea565640 1 -- 172.21.15.78:0/3533121251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffbe41534f0 con 0x7ffbe41537d0 2023-10-14T09:17:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.776+0000 7ffbe0ff9640 1 -- 172.21.15.78:0/3533121251 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffbe41534f0 con 0x7ffbe41537d0 2023-10-14T09:17:49.780 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:17:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 -- 172.21.15.78:0/3533121251 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffbd00664d0 msgr2=0x7ffbd0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffbd00664d0 0x7ffbd0068990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009a80 tx=0x7ffbd4009190 comp rx=0 tx=0).stop 2023-10-14T09:17:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 -- 172.21.15.78:0/3533121251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbe41537d0 msgr2=0x7ffbe4153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbe41537d0 0x7ffbe4153c50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c290 tx=0x7ffbcc005800 comp rx=0 tx=0).stop 2023-10-14T09:17:49.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 -- 172.21.15.78:0/3533121251 shutdown_connections 2023-10-14T09:17:49.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffbd00664d0 0x7ffbd0068990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffbe415cac0 0x7ffbe415cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffbe41537d0 0x7ffbe4153c50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 --2- 172.21.15.78:0/3533121251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffbcc0047d0 0x7ffbe41f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 -- 172.21.15.78:0/3533121251 >> 172.21.15.78:0/3533121251 conn(0x7ffbe4069e90 msgr2=0x7ffbe415d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:49.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 -- 172.21.15.78:0/3533121251 shutdown_connections 2023-10-14T09:17:49.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.780+0000 7ffbea565640 1 -- 172.21.15.78:0/3533121251 wait complete. 2023-10-14T09:17:49.801 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd202a9640 1 Processor -- start 2023-10-14T09:17:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd202a9640 1 -- start start 2023-10-14T09:17:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd202a9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1814e0f0 0x7fcd18152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd202a9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcd1814ed10 0x7fcd1814f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd202a9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd181531d0 con 0x7fcd1814f6d0 2023-10-14T09:17:49.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd202a9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd18153e50 con 0x7fcd1814ed10 2023-10-14T09:17:49.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd202a9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd181534b0 con 0x7fcd1814e0f0 2023-10-14T09:17:49.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd1e846640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcd1814f6d0 0x7fcd18150a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36028/0 (socket says 172.21.15.78:36028) 2023-10-14T09:17:49.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd1e846640 1 -- 172.21.15.78:0/228079055 learned_addr learned my addr 172.21.15.78:0/228079055 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd1e045640 1 --2- 172.21.15.78:0/228079055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1814e0f0 0x7fcd18152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd1d844640 1 --2- 172.21.15.78:0/228079055 >> v2:172.21.15.157:3300/0 conn(0x7fcd1814ed10 0x7fcd1814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd1d043640 1 -- 172.21.15.78:0/228079055 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504416667 0 0) 0x7fcd181531d0 con 0x7fcd1814f6d0 2023-10-14T09:17:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd1d043640 1 -- 172.21.15.78:0/228079055 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd04003530 con 0x7fcd1814f6d0 2023-10-14T09:17:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd1e045640 1 -- 172.21.15.78:0/228079055 >> v2:172.21.15.157:3300/0 conn(0x7fcd1814ed10 msgr2=0x7fcd1814f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:49.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd1e045640 1 --2- 172.21.15.78:0/228079055 >> v2:172.21.15.157:3300/0 conn(0x7fcd1814ed10 0x7fcd1814f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd1e045640 1 -- 172.21.15.78:0/228079055 >> v1:172.21.15.78:6789/0 conn(0x7fcd1814f6d0 legacy=0x7fcd18150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.936+0000 7fcd1e045640 1 -- 172.21.15.78:0/228079055 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18153790 con 0x7fcd1814e0f0 2023-10-14T09:17:49.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd1e045640 1 --2- 172.21.15.78:0/228079055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1814e0f0 0x7fcd18152960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd140097c0 tx=0x7fcd1401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cf7d879536c77a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:49.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd1d043640 1 -- 172.21.15.78:0/228079055 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd140ab600 con 0x7fcd1814e0f0 2023-10-14T09:17:49.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd1d043640 1 -- 172.21.15.78:0/228079055 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd140a7050 con 0x7fcd1814e0f0 2023-10-14T09:17:49.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd1d043640 1 -- 172.21.15.78:0/228079055 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd140ab980 con 0x7fcd1814e0f0 2023-10-14T09:17:49.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd202a9640 1 -- 172.21.15.78:0/228079055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1814e0f0 msgr2=0x7fcd18152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd202a9640 1 --2- 172.21.15.78:0/228079055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1814e0f0 0x7fcd18152960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd140097c0 tx=0x7fcd1401c3f0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd202a9640 1 -- 172.21.15.78:0/228079055 shutdown_connections 2023-10-14T09:17:49.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd202a9640 1 --2- 172.21.15.78:0/228079055 >> v2:172.21.15.157:3300/0 conn(0x7fcd1814ed10 0x7fcd1814f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd202a9640 1 --2- 172.21.15.78:0/228079055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1814e0f0 0x7fcd18152960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd202a9640 1 -- 172.21.15.78:0/228079055 >> 172.21.15.78:0/228079055 conn(0x7fcd180c1cc0 msgr2=0x7fcd180c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:49.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd202a9640 1 -- 172.21.15.78:0/228079055 shutdown_connections 2023-10-14T09:17:49.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.940+0000 7fcd202a9640 1 -- 172.21.15.78:0/228079055 wait complete. 2023-10-14T09:17:49.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd202a9640 1 Processor -- start 2023-10-14T09:17:49.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd202a9640 1 -- start start 2023-10-14T09:17:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd202a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1814e0f0 0x7fcd18146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd202a9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1814ed10 0x7fcd180c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd202a9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1814f6d0 0x7fcd1814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd202a9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1806d6b0 con 0x7fcd1814e0f0 2023-10-14T09:17:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd202a9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1806d950 con 0x7fcd1814f6d0 2023-10-14T09:17:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd202a9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd180c47c0 con 0x7fcd1814ed10 2023-10-14T09:17:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1e045640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1814e0f0 0x7fcd18146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1e045640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1814e0f0 0x7fcd18146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51336/0 (socket says 172.21.15.78:51336) 2023-10-14T09:17:49.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1e045640 1 -- 172.21.15.78:0/559933167 learned_addr learned my addr 172.21.15.78:0/559933167 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:49.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1e846640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1814f6d0 0x7fcd1814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1d844640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1814ed10 0x7fcd180c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1e045640 1 -- 172.21.15.78:0/559933167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1814ed10 msgr2=0x7fcd180c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1e045640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1814ed10 0x7fcd180c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1e045640 1 -- 172.21.15.78:0/559933167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1814f6d0 msgr2=0x7fcd1814fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:49.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1e045640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1814f6d0 0x7fcd1814fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:49.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1e045640 1 -- 172.21.15.78:0/559933167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd14009420 con 0x7fcd1814e0f0 2023-10-14T09:17:49.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1e846640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1814f6d0 0x7fcd1814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:49.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd1e045640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1814e0f0 0x7fcd18146250 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcd140ae040 tx=0x7fcd14019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:49.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd0effd640 1 -- 172.21.15.78:0/559933167 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd140b7450 con 0x7fcd1814e0f0 2023-10-14T09:17:49.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd0effd640 1 -- 172.21.15.78:0/559933167 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd140b75d0 con 0x7fcd1814e0f0 2023-10-14T09:17:49.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd202a9640 1 -- 172.21.15.78:0/559933167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd18150280 con 0x7fcd1814e0f0 2023-10-14T09:17:49.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd0effd640 1 -- 172.21.15.78:0/559933167 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd140b7980 con 0x7fcd1814e0f0 2023-10-14T09:17:49.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd202a9640 1 -- 172.21.15.78:0/559933167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1806dc30 con 0x7fcd1814e0f0 2023-10-14T09:17:49.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.944+0000 7fcd202a9640 1 -- 172.21.15.78:0/559933167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd18074180 con 0x7fcd1814e0f0 2023-10-14T09:17:49.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.948+0000 7fcd0effd640 1 -- 172.21.15.78:0/559933167 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcd140b7ae0 con 0x7fcd1814e0f0 2023-10-14T09:17:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.948+0000 7fcd0effd640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fccfc0664a0 0x7fccfc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.948+0000 7fcd0effd640 1 -- 172.21.15.78:0/559933167 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd1411e5e0 con 0x7fcd1814e0f0 2023-10-14T09:17:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.948+0000 7fcd1d844640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fccfc0664a0 0x7fccfc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.948+0000 7fcd1d844640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fccfc0664a0 0x7fccfc068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcd18146aa0 tx=0x7fcd08008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:49.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:49.952+0000 7fcd0effd640 1 -- 172.21.15.78:0/559933167 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcd140eb9c0 con 0x7fcd1814e0f0 2023-10-14T09:17:50.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.104+0000 7fcd202a9640 1 -- 172.21.15.78:0/559933167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd180c4980 con 0x7fcd1814e0f0 2023-10-14T09:17:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd0effd640 1 -- 172.21.15.78:0/559933167 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fcd140eefe0 con 0x7fcd1814e0f0 2023-10-14T09:17:50.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:50.110 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:50.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 -- 172.21.15.78:0/559933167 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fccfc0664a0 msgr2=0x7fccfc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fccfc0664a0 0x7fccfc068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcd18146aa0 tx=0x7fcd08008040 comp rx=0 tx=0).stop 2023-10-14T09:17:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 -- 172.21.15.78:0/559933167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1814e0f0 msgr2=0x7fcd18146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1814e0f0 0x7fcd18146250 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcd140ae040 tx=0x7fcd14019190 comp rx=0 tx=0).stop 2023-10-14T09:17:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 -- 172.21.15.78:0/559933167 shutdown_connections 2023-10-14T09:17:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd1814f6d0 0x7fcd1814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fccfc0664a0 0x7fccfc068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcd1814ed10 0x7fcd180c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 --2- 172.21.15.78:0/559933167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1814e0f0 0x7fcd18146250 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 -- 172.21.15.78:0/559933167 >> 172.21.15.78:0/559933167 conn(0x7fcd180c1cc0 msgr2=0x7fcd18153f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 -- 172.21.15.78:0/559933167 shutdown_connections 2023-10-14T09:17:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.108+0000 7fcd202a9640 1 -- 172.21.15.78:0/559933167 wait complete. 2023-10-14T09:17:50.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:50.132 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:50.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb78605640 1 Processor -- start 2023-10-14T09:17:50.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb78605640 1 -- start start 2023-10-14T09:17:50.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb78605640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb7006cc50 0x7ffb700c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb78605640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffb70153d90 0x7ffb701541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb78605640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb700c7af0 con 0x7ffb700c4030 2023-10-14T09:17:50.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb78605640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700c5300 con 0x7ffb70153d90 2023-10-14T09:17:50.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb78605640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70157360 con 0x7ffb7006cc50 2023-10-14T09:17:50.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb763a1640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ffb700c4030 0x7ffb700c4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36042/0 (socket says 172.21.15.78:36042) 2023-10-14T09:17:50.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb763a1640 1 -- 172.21.15.78:0/1164843483 learned_addr learned my addr 172.21.15.78:0/1164843483 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:50.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb76ba2640 1 --2- 172.21.15.78:0/1164843483 >> v2:172.21.15.78:3300/0 conn(0x7ffb70153d90 0x7ffb701541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb7539f640 1 -- 172.21.15.78:0/1164843483 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879048761 0 0) 0x7ffb700c7af0 con 0x7ffb700c4030 2023-10-14T09:17:50.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb7539f640 1 -- 172.21.15.78:0/1164843483 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c003530 con 0x7ffb700c4030 2023-10-14T09:17:50.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb75ba0640 1 --2- 172.21.15.78:0/1164843483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb7006cc50 0x7ffb700c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb76ba2640 1 -- 172.21.15.78:0/1164843483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb7006cc50 msgr2=0x7ffb700c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:50.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb76ba2640 1 --2- 172.21.15.78:0/1164843483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb7006cc50 0x7ffb700c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb76ba2640 1 -- 172.21.15.78:0/1164843483 >> v1:172.21.15.78:6789/0 conn(0x7ffb700c4030 legacy=0x7ffb700c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb76ba2640 1 -- 172.21.15.78:0/1164843483 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70157ee0 con 0x7ffb70153d90 2023-10-14T09:17:50.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.272+0000 7ffb75ba0640 1 --2- 172.21.15.78:0/1164843483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb7006cc50 0x7ffb700c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:50.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb76ba2640 1 --2- 172.21.15.78:0/1164843483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb70153d90 0x7ffb701541c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009d90 tx=0x7ffb6801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294f290472dfd679 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:50.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb7539f640 1 -- 172.21.15.78:0/1164843483 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680a5980 con 0x7ffb70153d90 2023-10-14T09:17:50.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb7539f640 1 -- 172.21.15.78:0/1164843483 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb680a5ae0 con 0x7ffb70153d90 2023-10-14T09:17:50.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb7539f640 1 -- 172.21.15.78:0/1164843483 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680a5e70 con 0x7ffb70153d90 2023-10-14T09:17:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb78605640 1 -- 172.21.15.78:0/1164843483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb70153d90 msgr2=0x7ffb701541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb78605640 1 --2- 172.21.15.78:0/1164843483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb70153d90 0x7ffb701541c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009d90 tx=0x7ffb6801c8c0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb78605640 1 -- 172.21.15.78:0/1164843483 shutdown_connections 2023-10-14T09:17:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb78605640 1 --2- 172.21.15.78:0/1164843483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb70153d90 0x7ffb701541c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb78605640 1 --2- 172.21.15.78:0/1164843483 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb7006cc50 0x7ffb700c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb78605640 1 -- 172.21.15.78:0/1164843483 >> 172.21.15.78:0/1164843483 conn(0x7ffb700ab240 msgr2=0x7ffb700ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:50.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb78605640 1 -- 172.21.15.78:0/1164843483 shutdown_connections 2023-10-14T09:17:50.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.276+0000 7ffb78605640 1 -- 172.21.15.78:0/1164843483 wait complete. 2023-10-14T09:17:50.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb78605640 1 Processor -- start 2023-10-14T09:17:50.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb78605640 1 -- start start 2023-10-14T09:17:50.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb78605640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb7006cc50 0x7ffb701ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb78605640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb700c4030 0x7ffb7014bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb78605640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb70153d90 0x7ffb700ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb78605640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7014bff0 con 0x7ffb7006cc50 2023-10-14T09:17:50.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb78605640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700aa1a0 con 0x7ffb70153d90 2023-10-14T09:17:50.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb78605640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70150b80 con 0x7ffb700c4030 2023-10-14T09:17:50.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb763a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb7006cc50 0x7ffb701ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb763a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb7006cc50 0x7ffb701ebcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51364/0 (socket says 172.21.15.78:51364) 2023-10-14T09:17:50.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb763a1640 1 -- 172.21.15.78:0/4176683646 learned_addr learned my addr 172.21.15.78:0/4176683646 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:50.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb76ba2640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb70153d90 0x7ffb700ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb75ba0640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb700c4030 0x7ffb7014bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb763a1640 1 -- 172.21.15.78:0/4176683646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb700c4030 msgr2=0x7ffb7014bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb763a1640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb700c4030 0x7ffb7014bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb763a1640 1 -- 172.21.15.78:0/4176683646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb70153d90 msgr2=0x7ffb700ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb763a1640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb70153d90 0x7ffb700ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb763a1640 1 -- 172.21.15.78:0/4176683646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68009a70 con 0x7ffb7006cc50 2023-10-14T09:17:50.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb75ba0640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb700c4030 0x7ffb7014bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:50.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb763a1640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb7006cc50 0x7ffb701ebcf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00c500 tx=0x7ffb6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:50.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb66ffd640 1 -- 172.21.15.78:0/4176683646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c005cf0 con 0x7ffb7006cc50 2023-10-14T09:17:50.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb66ffd640 1 -- 172.21.15.78:0/4176683646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c005e50 con 0x7ffb7006cc50 2023-10-14T09:17:50.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb78605640 1 -- 172.21.15.78:0/4176683646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb70151140 con 0x7ffb7006cc50 2023-10-14T09:17:50.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb66ffd640 1 -- 172.21.15.78:0/4176683646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c0072f0 con 0x7ffb7006cc50 2023-10-14T09:17:50.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.280+0000 7ffb78605640 1 -- 172.21.15.78:0/4176683646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb700aa3f0 con 0x7ffb7006cc50 2023-10-14T09:17:50.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.284+0000 7ffb78605640 1 -- 172.21.15.78:0/4176683646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb70074110 con 0x7ffb7006cc50 2023-10-14T09:17:50.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.284+0000 7ffb66ffd640 1 -- 172.21.15.78:0/4176683646 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffb6c007450 con 0x7ffb7006cc50 2023-10-14T09:17:50.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.284+0000 7ffb66ffd640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb540664a0 0x7ffb54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.284+0000 7ffb66ffd640 1 -- 172.21.15.78:0/4176683646 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb6c0833e0 con 0x7ffb7006cc50 2023-10-14T09:17:50.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.284+0000 7ffb75ba0640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb540664a0 0x7ffb54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.284+0000 7ffb75ba0640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb540664a0 0x7ffb54068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb60006fd0 tx=0x7ffb60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:50.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.288+0000 7ffb66ffd640 1 -- 172.21.15.78:0/4176683646 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffb6c050900 con 0x7ffb7006cc50 2023-10-14T09:17:50.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.436+0000 7ffb78605640 1 -- 172.21.15.78:0/4176683646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb700c7040 con 0x7ffb7006cc50 2023-10-14T09:17:50.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.436+0000 7ffb66ffd640 1 -- 172.21.15.78:0/4176683646 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb6c053f20 con 0x7ffb7006cc50 2023-10-14T09:17:50.441 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 -- 172.21.15.78:0/4176683646 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb540664a0 msgr2=0x7ffb54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb540664a0 0x7ffb54068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb60006fd0 tx=0x7ffb60008040 comp rx=0 tx=0).stop 2023-10-14T09:17:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 -- 172.21.15.78:0/4176683646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb7006cc50 msgr2=0x7ffb701ebcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb7006cc50 0x7ffb701ebcf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00c500 tx=0x7ffb6c00c9c0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 -- 172.21.15.78:0/4176683646 shutdown_connections 2023-10-14T09:17:50.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb70153d90 0x7ffb700ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffb540664a0 0x7ffb54068960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb700c4030 0x7ffb7014bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 --2- 172.21.15.78:0/4176683646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb7006cc50 0x7ffb701ebcf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 -- 172.21.15.78:0/4176683646 >> 172.21.15.78:0/4176683646 conn(0x7ffb700ab240 msgr2=0x7ffb700ab620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 -- 172.21.15.78:0/4176683646 shutdown_connections 2023-10-14T09:17:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.440+0000 7ffb78605640 1 -- 172.21.15.78:0/4176683646 wait complete. 2023-10-14T09:17:50.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:17:50.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f710cfc5640 1 Processor -- start 2023-10-14T09:17:50.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f710cfc5640 1 -- start start 2023-10-14T09:17:50.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f710cfc5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f71080bbd90 0x7f710806bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f710cfc5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f710806c180 0x7f710815c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f710cfc5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71080c0310 con 0x7f710813af90 2023-10-14T09:17:50.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f710cfc5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71080bc1f0 con 0x7f710806c180 2023-10-14T09:17:50.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f710cfc5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71080bada0 con 0x7f71080bbd90 2023-10-14T09:17:50.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f710659c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f710813af90 0x7f71080bfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36044/0 (socket says 172.21.15.78:36044) 2023-10-14T09:17:50.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f710659c640 1 -- 172.21.15.78:0/945479055 learned_addr learned my addr 172.21.15.78:0/945479055 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:50.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f7106d9d640 1 --2- 172.21.15.78:0/945479055 >> v2:172.21.15.78:3300/0 conn(0x7f710806c180 0x7f710815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f70fffff640 1 --2- 172.21.15.78:0/945479055 >> v2:172.21.15.157:3300/0 conn(0x7f71080bbd90 0x7f710806bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f7106d9d640 1 -- 172.21.15.78:0/945479055 >> v2:172.21.15.157:3300/0 conn(0x7f71080bbd90 msgr2=0x7f710806bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:50.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f7106d9d640 1 --2- 172.21.15.78:0/945479055 >> v2:172.21.15.157:3300/0 conn(0x7f71080bbd90 0x7f710806bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f7106d9d640 1 -- 172.21.15.78:0/945479055 >> v1:172.21.15.78:6789/0 conn(0x7f710813af90 legacy=0x7f71080bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f7106d9d640 1 -- 172.21.15.78:0/945479055 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108151c90 con 0x7f710806c180 2023-10-14T09:17:50.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.604+0000 7f7105d9b640 1 -- 172.21.15.78:0/945479055 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981741658 0 0) 0x7f71080c0310 con 0x7f710813af90 2023-10-14T09:17:50.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f7106d9d640 1 --2- 172.21.15.78:0/945479055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f710806c180 0x7f710815c530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f710806f640 tx=0x7f710001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbd897e562849e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:50.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f7105d9b640 1 -- 172.21.15.78:0/945479055 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71000a5910 con 0x7f710806c180 2023-10-14T09:17:50.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f7105d9b640 1 -- 172.21.15.78:0/945479055 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71000a5a70 con 0x7f710806c180 2023-10-14T09:17:50.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f7105d9b640 1 -- 172.21.15.78:0/945479055 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71000a5e00 con 0x7f710806c180 2023-10-14T09:17:50.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f710cfc5640 1 -- 172.21.15.78:0/945479055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f710806c180 msgr2=0x7f710815c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f710cfc5640 1 --2- 172.21.15.78:0/945479055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f710806c180 0x7f710815c530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f710806f640 tx=0x7f710001c850 comp rx=0 tx=0).stop 2023-10-14T09:17:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f710cfc5640 1 -- 172.21.15.78:0/945479055 shutdown_connections 2023-10-14T09:17:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f710cfc5640 1 --2- 172.21.15.78:0/945479055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f710806c180 0x7f710815c530 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f710cfc5640 1 --2- 172.21.15.78:0/945479055 >> v2:172.21.15.157:3300/0 conn(0x7f71080bbd90 0x7f710806bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f710cfc5640 1 -- 172.21.15.78:0/945479055 >> 172.21.15.78:0/945479055 conn(0x7f71080c1d00 msgr2=0x7f71080c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:50.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f710cfc5640 1 -- 172.21.15.78:0/945479055 shutdown_connections 2023-10-14T09:17:50.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.608+0000 7f710cfc5640 1 -- 172.21.15.78:0/945479055 wait complete. 2023-10-14T09:17:50.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710cfc5640 1 Processor -- start 2023-10-14T09:17:50.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710cfc5640 1 -- start start 2023-10-14T09:17:50.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710cfc5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f710806c180 0x7f7108071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710cfc5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080bbd90 0x7f71081eee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710cfc5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f710813af90 0x7f710814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710cfc5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71080c5040 con 0x7f71080bbd90 2023-10-14T09:17:50.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710cfc5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7108070f30 con 0x7f710813af90 2023-10-14T09:17:50.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710cfc5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71081eba70 con 0x7f710806c180 2023-10-14T09:17:50.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70fffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080bbd90 0x7f71081eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70fffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080bbd90 0x7f71081eee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51386/0 (socket says 172.21.15.78:51386) 2023-10-14T09:17:50.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70fffff640 1 -- 172.21.15.78:0/3683180518 learned_addr learned my addr 172.21.15.78:0/3683180518 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:50.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f7106d9d640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f710813af90 0x7f710814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710659c640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f710806c180 0x7f7108071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70fffff640 1 -- 172.21.15.78:0/3683180518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f710806c180 msgr2=0x7f7108071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70fffff640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f710806c180 0x7f7108071590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70fffff640 1 -- 172.21.15.78:0/3683180518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f710813af90 msgr2=0x7f710814fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70fffff640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f710813af90 0x7f710814fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70fffff640 1 -- 172.21.15.78:0/3683180518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7100009a70 con 0x7f71080bbd90 2023-10-14T09:17:50.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710659c640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f710806c180 0x7f7108071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:50.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70fffff640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080bbd90 0x7f71081eee60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f70f000e870 tx=0x7f70f000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:50.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70feffd640 1 -- 172.21.15.78:0/3683180518 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0009510 con 0x7f71080bbd90 2023-10-14T09:17:50.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70feffd640 1 -- 172.21.15.78:0/3683180518 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f000eec0 con 0x7f71080bbd90 2023-10-14T09:17:50.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710cfc5640 1 -- 172.21.15.78:0/3683180518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7108070c50 con 0x7f71080bbd90 2023-10-14T09:17:50.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f70feffd640 1 -- 172.21.15.78:0/3683180518 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f000cb40 con 0x7f71080bbd90 2023-10-14T09:17:50.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710cfc5640 1 -- 172.21.15.78:0/3683180518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71081ebff0 con 0x7f71080bbd90 2023-10-14T09:17:50.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.612+0000 7f710cfc5640 1 -- 172.21.15.78:0/3683180518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71081eb8d0 con 0x7f71080bbd90 2023-10-14T09:17:50.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.616+0000 7f70feffd640 1 -- 172.21.15.78:0/3683180518 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f70f000ccc0 con 0x7f71080bbd90 2023-10-14T09:17:50.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.616+0000 7f70feffd640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f70e80664a0 0x7f70e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.616+0000 7f70feffd640 1 -- 172.21.15.78:0/3683180518 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70f0083f20 con 0x7f71080bbd90 2023-10-14T09:17:50.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.616+0000 7f710659c640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f70e80664a0 0x7f70e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.616+0000 7f710659c640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f70e80664a0 0x7f70e8068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000f70 tx=0x7f70f8007cb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:50.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.620+0000 7f70feffd640 1 -- 172.21.15.78:0/3683180518 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f71081eb8d0 con 0x7f71080bbd90 2023-10-14T09:17:50.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.768+0000 7f710cfc5640 1 -- 172.21.15.78:0/3683180518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71081eb8d0 con 0x7f71080bbd90 2023-10-14T09:17:50.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.768+0000 7f70feffd640 1 -- 172.21.15.78:0/3683180518 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71081eb8d0 con 0x7f71080bbd90 2023-10-14T09:17:50.772 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:17:50.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 -- 172.21.15.78:0/3683180518 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f70e80664a0 msgr2=0x7f70e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f70e80664a0 0x7f70e8068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70f8000f70 tx=0x7f70f8007cb0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 -- 172.21.15.78:0/3683180518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080bbd90 msgr2=0x7f71081eee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080bbd90 0x7f71081eee60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f70f000e870 tx=0x7f70f000ec70 comp rx=0 tx=0).stop 2023-10-14T09:17:50.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 -- 172.21.15.78:0/3683180518 shutdown_connections 2023-10-14T09:17:50.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f710813af90 0x7f710814fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080bbd90 0x7f71081eee60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f70e80664a0 0x7f70e8068960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 --2- 172.21.15.78:0/3683180518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f710806c180 0x7f7108071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 -- 172.21.15.78:0/3683180518 >> 172.21.15.78:0/3683180518 conn(0x7f71080c1d00 msgr2=0x7f71081383c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:50.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 -- 172.21.15.78:0/3683180518 shutdown_connections 2023-10-14T09:17:50.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.772+0000 7f710cfc5640 1 -- 172.21.15.78:0/3683180518 wait complete. 2023-10-14T09:17:50.792 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:17:50.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.928+0000 7f0868479640 1 Processor -- start 2023-10-14T09:17:50.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.928+0000 7f0868479640 1 -- start start 2023-10-14T09:17:50.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0868479640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0860151310 0x7f08600c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0868479640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08600700d0 0x7f08600c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0868479640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0860157d50 con 0x7f08600c1e20 2023-10-14T09:17:50.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0868479640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08600c3b80 con 0x7f08600700d0 2023-10-14T09:17:50.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0868479640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0860158280 con 0x7f0860151310 2023-10-14T09:17:50.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0865a14640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08600700d0 0x7f08600c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0865a14640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08600700d0 0x7f08600c4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51392/0 (socket says 172.21.15.78:51392) 2023-10-14T09:17:50.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0865a14640 1 -- 172.21.15.78:0/2050175242 learned_addr learned my addr 172.21.15.78:0/2050175242 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:50.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0866a16640 1 --1- 172.21.15.78:0/2050175242 >> v1:172.21.15.78:6789/0 conn(0x7f08600c1e20 0x7f08600c4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36054/0 (socket says 172.21.15.78:36054) 2023-10-14T09:17:50.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0866215640 1 --2- 172.21.15.78:0/2050175242 >> v2:172.21.15.157:3300/0 conn(0x7f0860151310 0x7f08600c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0865a14640 1 -- 172.21.15.78:0/2050175242 >> v2:172.21.15.157:3300/0 conn(0x7f0860151310 msgr2=0x7f08600c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:50.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0865a14640 1 --2- 172.21.15.78:0/2050175242 >> v2:172.21.15.157:3300/0 conn(0x7f0860151310 0x7f08600c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0865a14640 1 -- 172.21.15.78:0/2050175242 >> v1:172.21.15.78:6789/0 conn(0x7f08600c1e20 legacy=0x7f08600c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0865a14640 1 -- 172.21.15.78:0/2050175242 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0860157fa0 con 0x7f08600700d0 2023-10-14T09:17:50.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.932+0000 7f0865213640 1 -- 172.21.15.78:0/2050175242 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374687739 0 0) 0x7f0860157d50 con 0x7f08600c1e20 2023-10-14T09:17:50.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0865a14640 1 --2- 172.21.15.78:0/2050175242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08600700d0 0x7f08600c4010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f08600c8560 tx=0x7f085001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb20633d8a4c4f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:50.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0865213640 1 -- 172.21.15.78:0/2050175242 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08500aa5f0 con 0x7f08600700d0 2023-10-14T09:17:50.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0865213640 1 -- 172.21.15.78:0/2050175242 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08500aa750 con 0x7f08600700d0 2023-10-14T09:17:50.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0865213640 1 -- 172.21.15.78:0/2050175242 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08500aaae0 con 0x7f08600700d0 2023-10-14T09:17:50.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 -- 172.21.15.78:0/2050175242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08600700d0 msgr2=0x7f08600c4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 --2- 172.21.15.78:0/2050175242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08600700d0 0x7f08600c4010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f08600c8560 tx=0x7f085001c470 comp rx=0 tx=0).stop 2023-10-14T09:17:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 -- 172.21.15.78:0/2050175242 shutdown_connections 2023-10-14T09:17:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 --2- 172.21.15.78:0/2050175242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08600700d0 0x7f08600c4010 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 --2- 172.21.15.78:0/2050175242 >> v2:172.21.15.157:3300/0 conn(0x7f0860151310 0x7f08600c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 -- 172.21.15.78:0/2050175242 >> 172.21.15.78:0/2050175242 conn(0x7f086006a2c0 msgr2=0x7f086006a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 -- 172.21.15.78:0/2050175242 shutdown_connections 2023-10-14T09:17:50.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 -- 172.21.15.78:0/2050175242 wait complete. 2023-10-14T09:17:50.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 Processor -- start 2023-10-14T09:17:50.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 -- start start 2023-10-14T09:17:50.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08600c1e20 0x7f08600a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0860151310 0x7f08600a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f086006bc30 0x7f08600a7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08600a4110 con 0x7f0860151310 2023-10-14T09:17:50.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08600a43b0 con 0x7f08600c1e20 2023-10-14T09:17:50.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0868479640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08600a4690 con 0x7f086006bc30 2023-10-14T09:17:50.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0865a14640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0860151310 0x7f08600a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0865a14640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0860151310 0x7f08600a78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51400/0 (socket says 172.21.15.78:51400) 2023-10-14T09:17:50.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.936+0000 7f0865a14640 1 -- 172.21.15.78:0/928623821 learned_addr learned my addr 172.21.15.78:0/928623821 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:50.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0866215640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08600c1e20 0x7f08600a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0866a16640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f086006bc30 0x7f08600a7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0865a14640 1 -- 172.21.15.78:0/928623821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f086006bc30 msgr2=0x7f08600a7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0865a14640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f086006bc30 0x7f08600a7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0865a14640 1 -- 172.21.15.78:0/928623821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08600c1e20 msgr2=0x7f08600a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:50.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0865a14640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08600c1e20 0x7f08600a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:50.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0865a14640 1 -- 172.21.15.78:0/928623821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08500094d0 con 0x7f0860151310 2023-10-14T09:17:50.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0866a16640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f086006bc30 0x7f08600a7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:50.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0865a14640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0860151310 0x7f08600a78b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0850019080 tx=0x7f085001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:50.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0856ffd640 1 -- 172.21.15.78:0/928623821 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08500bd5f0 con 0x7f0860151310 2023-10-14T09:17:50.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0856ffd640 1 -- 172.21.15.78:0/928623821 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08500bd770 con 0x7f0860151310 2023-10-14T09:17:50.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0868479640 1 -- 172.21.15.78:0/928623821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08600a4970 con 0x7f0860151310 2023-10-14T09:17:50.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0856ffd640 1 -- 172.21.15.78:0/928623821 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08500bdb20 con 0x7f0860151310 2023-10-14T09:17:50.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0868479640 1 -- 172.21.15.78:0/928623821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08600a5ea0 con 0x7f0860151310 2023-10-14T09:17:50.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0868479640 1 -- 172.21.15.78:0/928623821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0860074110 con 0x7f0860151310 2023-10-14T09:17:50.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.940+0000 7f0856ffd640 1 -- 172.21.15.78:0/928623821 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f08500b33f0 con 0x7f0860151310 2023-10-14T09:17:50.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.944+0000 7f0856ffd640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f08440664d0 0x7f0844068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:50.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.944+0000 7f0856ffd640 1 -- 172.21.15.78:0/928623821 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08500a7070 con 0x7f0860151310 2023-10-14T09:17:50.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.944+0000 7f0866215640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f08440664d0 0x7f0844068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:50.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.944+0000 7f0866215640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f08440664d0 0x7f0844068990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f08600c5e00 tx=0x7f085c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:50.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:50.944+0000 7f0856ffd640 1 -- 172.21.15.78:0/928623821 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f08500ec510 con 0x7f0860151310 2023-10-14T09:17:51.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.092+0000 7f0868479640 1 -- 172.21.15.78:0/928623821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08600a47d0 con 0x7f0860151310 2023-10-14T09:17:51.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.092+0000 7f0856ffd640 1 -- 172.21.15.78:0/928623821 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08600a47d0 con 0x7f0860151310 2023-10-14T09:17:51.097 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:17:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 -- 172.21.15.78:0/928623821 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f08440664d0 msgr2=0x7f0844068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f08440664d0 0x7f0844068990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f08600c5e00 tx=0x7f085c008040 comp rx=0 tx=0).stop 2023-10-14T09:17:51.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 -- 172.21.15.78:0/928623821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0860151310 msgr2=0x7f08600a78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0860151310 0x7f08600a78b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0850019080 tx=0x7f085001acb0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 -- 172.21.15.78:0/928623821 shutdown_connections 2023-10-14T09:17:51.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f08440664d0 0x7f0844068990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f086006bc30 0x7f08600a7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0860151310 0x7f08600a78b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 --2- 172.21.15.78:0/928623821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08600c1e20 0x7f08600a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 -- 172.21.15.78:0/928623821 >> 172.21.15.78:0/928623821 conn(0x7f086006a2c0 msgr2=0x7f086014b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:51.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 -- 172.21.15.78:0/928623821 shutdown_connections 2023-10-14T09:17:51.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.096+0000 7f0868479640 1 -- 172.21.15.78:0/928623821 wait complete. 2023-10-14T09:17:51.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:51.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f98222d6640 1 Processor -- start 2023-10-14T09:17:51.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f98222d6640 1 -- start start 2023-10-14T09:17:51.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f98222d6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f981c14ddb0 0x7f981c0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f98222d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f981c153e80 0x7f981c06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f98222d6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981c06c470 con 0x7f981c0c6910 2023-10-14T09:17:51.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f98222d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c0c64f0 con 0x7f981c153e80 2023-10-14T09:17:51.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f98222d6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981c0c5300 con 0x7f981c14ddb0 2023-10-14T09:17:51.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f981b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f981c153e80 0x7f981c06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f9820873640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f981c0c6910 0x7f981c0c3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36060/0 (socket says 172.21.15.78:36060) 2023-10-14T09:17:51.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f9820873640 1 -- 172.21.15.78:0/3125485064 learned_addr learned my addr 172.21.15.78:0/3125485064 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:51.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f981bfff640 1 --2- 172.21.15.78:0/3125485064 >> v2:172.21.15.157:3300/0 conn(0x7f981c14ddb0 0x7f981c0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f981b7fe640 1 -- 172.21.15.78:0/3125485064 >> v2:172.21.15.157:3300/0 conn(0x7f981c14ddb0 msgr2=0x7f981c0c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:51.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f981b7fe640 1 --2- 172.21.15.78:0/3125485064 >> v2:172.21.15.157:3300/0 conn(0x7f981c14ddb0 0x7f981c0c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f981affd640 1 -- 172.21.15.78:0/3125485064 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417628095 0 0) 0x7f981c06c470 con 0x7f981c0c6910 2023-10-14T09:17:51.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f981b7fe640 1 -- 172.21.15.78:0/3125485064 >> v1:172.21.15.78:6789/0 conn(0x7f981c0c6910 legacy=0x7f981c0c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f981b7fe640 1 -- 172.21.15.78:0/3125485064 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c06c750 con 0x7f981c153e80 2023-10-14T09:17:51.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.256+0000 7f981bfff640 1 --2- 172.21.15.78:0/3125485064 >> v2:172.21.15.157:3300/0 conn(0x7f981c14ddb0 0x7f981c0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:51.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f981b7fe640 1 --2- 172.21.15.78:0/3125485064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f981c153e80 0x7f981c06bb70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f981c0a8d80 tx=0x7f981001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8021562219a9ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:51.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f981affd640 1 -- 172.21.15.78:0/3125485064 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100ac640 con 0x7f981c153e80 2023-10-14T09:17:51.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f981affd640 1 -- 172.21.15.78:0/3125485064 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98100ac7a0 con 0x7f981c153e80 2023-10-14T09:17:51.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f981affd640 1 -- 172.21.15.78:0/3125485064 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100acb30 con 0x7f981c153e80 2023-10-14T09:17:51.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f98222d6640 1 -- 172.21.15.78:0/3125485064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f981c153e80 msgr2=0x7f981c06bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f98222d6640 1 --2- 172.21.15.78:0/3125485064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f981c153e80 0x7f981c06bb70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f981c0a8d80 tx=0x7f981001c310 comp rx=0 tx=0).stop 2023-10-14T09:17:51.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f98222d6640 1 -- 172.21.15.78:0/3125485064 shutdown_connections 2023-10-14T09:17:51.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f98222d6640 1 --2- 172.21.15.78:0/3125485064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f981c153e80 0x7f981c06bb70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f98222d6640 1 --2- 172.21.15.78:0/3125485064 >> v2:172.21.15.157:3300/0 conn(0x7f981c14ddb0 0x7f981c0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f98222d6640 1 -- 172.21.15.78:0/3125485064 >> 172.21.15.78:0/3125485064 conn(0x7f981c0ab1f0 msgr2=0x7f981c0ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:51.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f98222d6640 1 -- 172.21.15.78:0/3125485064 shutdown_connections 2023-10-14T09:17:51.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.260+0000 7f98222d6640 1 -- 172.21.15.78:0/3125485064 wait complete. 2023-10-14T09:17:51.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f98222d6640 1 Processor -- start 2023-10-14T09:17:51.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f98222d6640 1 -- start start 2023-10-14T09:17:51.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f98222d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f981c0c6910 0x7f981c0bdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f98222d6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c14ddb0 0x7f981c144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f98222d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f981c153e80 0x7f981c1ef220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f98222d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c0bee40 con 0x7f981c0c6910 2023-10-14T09:17:51.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f98222d6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c0c2f50 con 0x7f981c14ddb0 2023-10-14T09:17:51.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f98222d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981c0c3230 con 0x7f981c153e80 2023-10-14T09:17:51.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f981bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f981c0c6910 0x7f981c0bdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f981bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f981c0c6910 0x7f981c0bdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51428/0 (socket says 172.21.15.78:51428) 2023-10-14T09:17:51.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f981bfff640 1 -- 172.21.15.78:0/3719914514 learned_addr learned my addr 172.21.15.78:0/3719914514 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:51.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f981b7fe640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c14ddb0 0x7f981c144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f9820873640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f981c153e80 0x7f981c1ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f981bfff640 1 -- 172.21.15.78:0/3719914514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f981c153e80 msgr2=0x7f981c1ef220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f981bfff640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f981c153e80 0x7f981c1ef220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f981bfff640 1 -- 172.21.15.78:0/3719914514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c14ddb0 msgr2=0x7f981c144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f981bfff640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c14ddb0 0x7f981c144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f981bfff640 1 -- 172.21.15.78:0/3719914514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009420 con 0x7f981c0c6910 2023-10-14T09:17:51.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f981b7fe640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c14ddb0 0x7f981c144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:51.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f981bfff640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f981c0c6910 0x7f981c0bdb50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f980c00c7c0 tx=0x7f980c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:51.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f9818ff9640 1 -- 172.21.15.78:0/3719914514 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c007a30 con 0x7f981c0c6910 2023-10-14T09:17:51.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f9818ff9640 1 -- 172.21.15.78:0/3719914514 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c007b90 con 0x7f981c0c6910 2023-10-14T09:17:51.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f98222d6640 1 -- 172.21.15.78:0/3719914514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c0c3510 con 0x7f981c0c6910 2023-10-14T09:17:51.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f9818ff9640 1 -- 172.21.15.78:0/3719914514 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c00ce70 con 0x7f981c0c6910 2023-10-14T09:17:51.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f98222d6640 1 -- 172.21.15.78:0/3719914514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c0bfa20 con 0x7f981c0c6910 2023-10-14T09:17:51.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.264+0000 7f98222d6640 1 -- 172.21.15.78:0/3719914514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981c074180 con 0x7f981c0c6910 2023-10-14T09:17:51.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.268+0000 7f9818ff9640 1 -- 172.21.15.78:0/3719914514 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f980c0113f0 con 0x7f981c0c6910 2023-10-14T09:17:51.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.268+0000 7f9818ff9640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98080664a0 0x7f9808068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.268+0000 7f9818ff9640 1 -- 172.21.15.78:0/3719914514 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f980c084390 con 0x7f981c0c6910 2023-10-14T09:17:51.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.268+0000 7f981b7fe640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98080664a0 0x7f9808068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.268+0000 7f981b7fe640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98080664a0 0x7f9808068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f98100ae000 tx=0x7f9810008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:51.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.272+0000 7f9818ff9640 1 -- 172.21.15.78:0/3719914514 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f980c051800 con 0x7f981c0c6910 2023-10-14T09:17:51.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f98222d6640 1 -- 172.21.15.78:0/3719914514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f981c0bfc10 con 0x7f981c0c6910 2023-10-14T09:17:51.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f9818ff9640 1 -- 172.21.15.78:0/3719914514 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f980c054e20 con 0x7f981c0c6910 2023-10-14T09:17:51.427 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:51.427 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:51.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f98222d6640 1 -- 172.21.15.78:0/3719914514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98080664a0 msgr2=0x7f9808068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f98222d6640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98080664a0 0x7f9808068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f98100ae000 tx=0x7f9810008040 comp rx=0 tx=0).stop 2023-10-14T09:17:51.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f98222d6640 1 -- 172.21.15.78:0/3719914514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f981c0c6910 msgr2=0x7f981c0bdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f98222d6640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f981c0c6910 0x7f981c0bdb50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f980c00c7c0 tx=0x7f980c00cc80 comp rx=0 tx=0).stop 2023-10-14T09:17:51.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f98222d6640 1 -- 172.21.15.78:0/3719914514 shutdown_connections 2023-10-14T09:17:51.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f98222d6640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f98080664a0 0x7f9808068960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f98222d6640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f981c153e80 0x7f981c1ef220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f98222d6640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f981c14ddb0 0x7f981c144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f98222d6640 1 --2- 172.21.15.78:0/3719914514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f981c0c6910 0x7f981c0bdb50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.424+0000 7f98222d6640 1 -- 172.21.15.78:0/3719914514 >> 172.21.15.78:0/3719914514 conn(0x7f981c0ab1f0 msgr2=0x7f981c0bc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:51.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.428+0000 7f98222d6640 1 -- 172.21.15.78:0/3719914514 shutdown_connections 2023-10-14T09:17:51.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.428+0000 7f98222d6640 1 -- 172.21.15.78:0/3719914514 wait complete. 2023-10-14T09:17:51.448 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:51.449 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:51.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.584+0000 7f280aa91640 1 Processor -- start 2023-10-14T09:17:51.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280aa91640 1 -- start start 2023-10-14T09:17:51.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280aa91640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2804139dc0 0x7f28040718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280aa91640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2804150f40 0x7f28041539d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280aa91640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2804151fd0 con 0x7f2804150ac0 2023-10-14T09:17:51.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280aa91640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28040702c0 con 0x7f2804139dc0 2023-10-14T09:17:51.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280aa91640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2804152ea0 con 0x7f2804150f40 2023-10-14T09:17:51.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280882d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2804139dc0 0x7f28040718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280882d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2804139dc0 0x7f28040718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51438/0 (socket says 172.21.15.78:51438) 2023-10-14T09:17:51.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280882d640 1 -- 172.21.15.78:0/1626453363 learned_addr learned my addr 172.21.15.78:0/1626453363 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:51.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280902e640 1 --2- 172.21.15.78:0/1626453363 >> v2:172.21.15.157:3300/0 conn(0x7f2804150f40 0x7f28041539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280882d640 1 -- 172.21.15.78:0/1626453363 >> v2:172.21.15.157:3300/0 conn(0x7f2804150f40 msgr2=0x7f28041539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:51.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280882d640 1 --2- 172.21.15.78:0/1626453363 >> v2:172.21.15.157:3300/0 conn(0x7f2804150f40 0x7f28041539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280882d640 1 -- 172.21.15.78:0/1626453363 >> v1:172.21.15.157:6789/0 conn(0x7f2804150ac0 legacy=0x7f28041532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.588+0000 7f280882d640 1 -- 172.21.15.78:0/1626453363 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28041513b0 con 0x7f2804139dc0 2023-10-14T09:17:51.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f280882d640 1 --2- 172.21.15.78:0/1626453363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2804139dc0 0x7f28040718a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f280406fa80 tx=0x7f27f801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0c81a881f91fd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:51.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f28037fe640 1 -- 172.21.15.78:0/1626453363 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f80ad660 con 0x7f2804139dc0 2023-10-14T09:17:51.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f28037fe640 1 -- 172.21.15.78:0/1626453363 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f80ad7c0 con 0x7f2804139dc0 2023-10-14T09:17:51.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f28037fe640 1 -- 172.21.15.78:0/1626453363 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f80adb50 con 0x7f2804139dc0 2023-10-14T09:17:51.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f280aa91640 1 -- 172.21.15.78:0/1626453363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2804139dc0 msgr2=0x7f28040718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f280aa91640 1 --2- 172.21.15.78:0/1626453363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2804139dc0 0x7f28040718a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f280406fa80 tx=0x7f27f801c470 comp rx=0 tx=0).stop 2023-10-14T09:17:51.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f280aa91640 1 -- 172.21.15.78:0/1626453363 shutdown_connections 2023-10-14T09:17:51.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f280aa91640 1 --2- 172.21.15.78:0/1626453363 >> v2:172.21.15.157:3300/0 conn(0x7f2804150f40 0x7f28041539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f280aa91640 1 --2- 172.21.15.78:0/1626453363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2804139dc0 0x7f28040718a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f280aa91640 1 -- 172.21.15.78:0/1626453363 >> 172.21.15.78:0/1626453363 conn(0x7f28040c1d00 msgr2=0x7f28040c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:51.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f280aa91640 1 -- 172.21.15.78:0/1626453363 shutdown_connections 2023-10-14T09:17:51.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f280aa91640 1 -- 172.21.15.78:0/1626453363 wait complete. 2023-10-14T09:17:51.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f280aa91640 1 Processor -- start 2023-10-14T09:17:51.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.592+0000 7f280aa91640 1 -- start start 2023-10-14T09:17:51.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280aa91640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2804139dc0 0x7f28040a8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280aa91640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2804150ac0 0x7f28041345c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280aa91640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2804150f40 0x7f28041ef170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280aa91640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2804137230 con 0x7f2804150f40 2023-10-14T09:17:51.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280aa91640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28041efc50 con 0x7f2804150ac0 2023-10-14T09:17:51.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280aa91640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28041eff30 con 0x7f2804139dc0 2023-10-14T09:17:51.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280902e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2804150f40 0x7f28041ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280902e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2804150f40 0x7f28041ef170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51454/0 (socket says 172.21.15.78:51454) 2023-10-14T09:17:51.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280902e640 1 -- 172.21.15.78:0/1130651698 learned_addr learned my addr 172.21.15.78:0/1130651698 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:51.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280882d640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2804139dc0 0x7f28040a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f2803fff640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2804150ac0 0x7f28041345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280902e640 1 -- 172.21.15.78:0/1130651698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2804139dc0 msgr2=0x7f28040a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280902e640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2804139dc0 0x7f28040a8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280902e640 1 -- 172.21.15.78:0/1130651698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2804150ac0 msgr2=0x7f28041345c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280902e640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2804150ac0 0x7f28041345c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280902e640 1 -- 172.21.15.78:0/1130651698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f80094d0 con 0x7f2804150f40 2023-10-14T09:17:51.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280902e640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2804150f40 0x7f28041ef170 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00efc0 tx=0x7f27fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:51.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f28017fa640 1 -- 172.21.15.78:0/1130651698 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc009ba0 con 0x7f2804150f40 2023-10-14T09:17:51.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f28017fa640 1 -- 172.21.15.78:0/1130651698 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00f040 con 0x7f2804150f40 2023-10-14T09:17:51.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280aa91640 1 -- 172.21.15.78:0/1130651698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2804136ec0 con 0x7f2804150f40 2023-10-14T09:17:51.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f28017fa640 1 -- 172.21.15.78:0/1130651698 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc0146c0 con 0x7f2804150f40 2023-10-14T09:17:51.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280aa91640 1 -- 172.21.15.78:0/1130651698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2804134b00 con 0x7f2804150f40 2023-10-14T09:17:51.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.596+0000 7f280aa91640 1 -- 172.21.15.78:0/1130651698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2804074110 con 0x7f2804150f40 2023-10-14T09:17:51.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.600+0000 7f28017fa640 1 -- 172.21.15.78:0/1130651698 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f27fc014820 con 0x7f2804150f40 2023-10-14T09:17:51.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.600+0000 7f28017fa640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f27e80664a0 0x7f27e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.600+0000 7f28017fa640 1 -- 172.21.15.78:0/1130651698 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27fc0847c0 con 0x7f2804150f40 2023-10-14T09:17:51.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.600+0000 7f280882d640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f27e80664a0 0x7f27e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.600+0000 7f280882d640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f27e80664a0 0x7f27e8068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f27f80af000 tx=0x7f27f8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:51.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.604+0000 7f28017fa640 1 -- 172.21.15.78:0/1130651698 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27fc051ce0 con 0x7f2804150f40 2023-10-14T09:17:51.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.752+0000 7f280aa91640 1 -- 172.21.15.78:0/1130651698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28041527b0 con 0x7f2804150f40 2023-10-14T09:17:51.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.752+0000 7f28017fa640 1 -- 172.21.15.78:0/1130651698 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27fc018020 con 0x7f2804150f40 2023-10-14T09:17:51.756 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:51.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 -- 172.21.15.78:0/1130651698 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f27e80664a0 msgr2=0x7f27e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f27e80664a0 0x7f27e8068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f27f80af000 tx=0x7f27f8008040 comp rx=0 tx=0).stop 2023-10-14T09:17:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 -- 172.21.15.78:0/1130651698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2804150f40 msgr2=0x7f28041ef170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2804150f40 0x7f28041ef170 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00efc0 tx=0x7f27fc00c490 comp rx=0 tx=0).stop 2023-10-14T09:17:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 -- 172.21.15.78:0/1130651698 shutdown_connections 2023-10-14T09:17:51.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2804150f40 0x7f28041ef170 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2804150ac0 0x7f28041345c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f27e80664a0 0x7f27e8068960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 --2- 172.21.15.78:0/1130651698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2804139dc0 0x7f28040a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 -- 172.21.15.78:0/1130651698 >> 172.21.15.78:0/1130651698 conn(0x7f28040c1d00 msgr2=0x7f280414f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:51.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 -- 172.21.15.78:0/1130651698 shutdown_connections 2023-10-14T09:17:51.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.756+0000 7f280aa91640 1 -- 172.21.15.78:0/1130651698 wait complete. 2023-10-14T09:17:51.778 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:17:51.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f2515a46640 1 Processor -- start 2023-10-14T09:17:51.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f2515a46640 1 -- start start 2023-10-14T09:17:51.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f2515a46640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f25100c52f0 0x7f2510154930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f2515a46640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f251006ad40 0x7f2510157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f2515a46640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251006b240 con 0x7f25100c7500 2023-10-14T09:17:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f2515a46640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251006c050 con 0x7f25100c52f0 2023-10-14T09:17:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f2515a46640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25101544a0 con 0x7f251006ad40 2023-10-14T09:17:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f250effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f25100c52f0 0x7f2510154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f250f7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f25100c7500 0x7f2510151070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36070/0 (socket says 172.21.15.78:36070) 2023-10-14T09:17:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f250f7fe640 1 -- 172.21.15.78:0/3027302796 learned_addr learned my addr 172.21.15.78:0/3027302796 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f25067fc640 1 --2- 172.21.15.78:0/3027302796 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f251006ad40 0x7f2510157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f250effd640 1 -- 172.21.15.78:0/3027302796 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f251006ad40 msgr2=0x7f2510157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f250effd640 1 --2- 172.21.15.78:0/3027302796 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f251006ad40 0x7f2510157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f250effd640 1 -- 172.21.15.78:0/3027302796 >> v1:172.21.15.78:6789/0 conn(0x7f25100c7500 legacy=0x7f2510151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f250effd640 1 -- 172.21.15.78:0/3027302796 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25101582e0 con 0x7f25100c52f0 2023-10-14T09:17:51.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f25067fc640 1 --2- 172.21.15.78:0/3027302796 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f251006ad40 0x7f2510157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:51.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.916+0000 7f250e7fc640 1 -- 172.21.15.78:0/3027302796 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300639334 0 0) 0x7f251006b240 con 0x7f25100c7500 2023-10-14T09:17:51.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f250effd640 1 --2- 172.21.15.78:0/3027302796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25100c52f0 0x7f2510154930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f25000097c0 tx=0x7f250001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1074db0a0dddc16c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:51.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f250e7fc640 1 -- 172.21.15.78:0/3027302796 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000ab600 con 0x7f25100c52f0 2023-10-14T09:17:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f250e7fc640 1 -- 172.21.15.78:0/3027302796 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25000a7050 con 0x7f25100c52f0 2023-10-14T09:17:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f250e7fc640 1 -- 172.21.15.78:0/3027302796 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000ab980 con 0x7f25100c52f0 2023-10-14T09:17:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f2515a46640 1 -- 172.21.15.78:0/3027302796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25100c52f0 msgr2=0x7f2510154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f2515a46640 1 --2- 172.21.15.78:0/3027302796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25100c52f0 0x7f2510154930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f25000097c0 tx=0x7f250001c3f0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f2515a46640 1 -- 172.21.15.78:0/3027302796 shutdown_connections 2023-10-14T09:17:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f2515a46640 1 --2- 172.21.15.78:0/3027302796 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f251006ad40 0x7f2510157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f2515a46640 1 --2- 172.21.15.78:0/3027302796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25100c52f0 0x7f2510154930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f2515a46640 1 -- 172.21.15.78:0/3027302796 >> 172.21.15.78:0/3027302796 conn(0x7f25100ab0f0 msgr2=0x7f25100ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f2515a46640 1 -- 172.21.15.78:0/3027302796 shutdown_connections 2023-10-14T09:17:51.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.920+0000 7f2515a46640 1 -- 172.21.15.78:0/3027302796 wait complete. 2023-10-14T09:17:51.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f2515a46640 1 Processor -- start 2023-10-14T09:17:51.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f2515a46640 1 -- start start 2023-10-14T09:17:51.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f2515a46640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f251006ad40 0x7f2510145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f2515a46640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25100c52f0 0x7f2510155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f2515a46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25100c7500 0x7f2510156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f2515a46640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25100aa650 con 0x7f25100c7500 2023-10-14T09:17:51.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f2515a46640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25100aa930 con 0x7f251006ad40 2023-10-14T09:17:51.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f2515a46640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25100aac10 con 0x7f25100c52f0 2023-10-14T09:17:51.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25100c7500 0x7f2510156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25100c7500 0x7f2510156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51474/0 (socket says 172.21.15.78:51474) 2023-10-14T09:17:51.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250f7fe640 1 -- 172.21.15.78:0/4241345574 learned_addr learned my addr 172.21.15.78:0/4241345574 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:51.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250f7fe640 1 -- 172.21.15.78:0/4241345574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25100c52f0 msgr2=0x7f2510155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250effd640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f251006ad40 0x7f2510145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f25067fc640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25100c52f0 0x7f2510155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250f7fe640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25100c52f0 0x7f2510155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250f7fe640 1 -- 172.21.15.78:0/4241345574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f251006ad40 msgr2=0x7f2510145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250f7fe640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f251006ad40 0x7f2510145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:51.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250f7fe640 1 -- 172.21.15.78:0/4241345574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2500009420 con 0x7f25100c7500 2023-10-14T09:17:51.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250effd640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f251006ad40 0x7f2510145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:51.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f25067fc640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25100c52f0 0x7f2510155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:51.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250f7fe640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25100c7500 0x7f2510156130 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f250800c480 tx=0x7f250800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:51.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250cff9640 1 -- 172.21.15.78:0/4241345574 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25080074e0 con 0x7f25100c7500 2023-10-14T09:17:51.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250cff9640 1 -- 172.21.15.78:0/4241345574 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508007640 con 0x7f25100c7500 2023-10-14T09:17:51.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f2515a46640 1 -- 172.21.15.78:0/4241345574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25100a9850 con 0x7f25100c7500 2023-10-14T09:17:51.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f250cff9640 1 -- 172.21.15.78:0/4241345574 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508004a10 con 0x7f25100c7500 2023-10-14T09:17:51.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.924+0000 7f2515a46640 1 -- 172.21.15.78:0/4241345574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251014e630 con 0x7f25100c7500 2023-10-14T09:17:51.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.928+0000 7f2515a46640 1 -- 172.21.15.78:0/4241345574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25100aae30 con 0x7f25100c7500 2023-10-14T09:17:51.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.928+0000 7f250cff9640 1 -- 172.21.15.78:0/4241345574 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2508004b70 con 0x7f25100c7500 2023-10-14T09:17:51.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.928+0000 7f250cff9640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24f00664a0 0x7f24f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:51.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.928+0000 7f250cff9640 1 -- 172.21.15.78:0/4241345574 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25080832e0 con 0x7f25100c7500 2023-10-14T09:17:51.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.928+0000 7f250effd640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24f00664a0 0x7f24f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:51.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.928+0000 7f250effd640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24f00664a0 0x7f24f0068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25000ad000 tx=0x7f25000a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:51.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:51.932+0000 7f250cff9640 1 -- 172.21.15.78:0/4241345574 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25080507f0 con 0x7f25100c7500 2023-10-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.080+0000 7f2515a46640 1 -- 172.21.15.78:0/4241345574 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25100a9a40 con 0x7f25100c7500 2023-10-14T09:17:52.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.080+0000 7f250cff9640 1 -- 172.21.15.78:0/4241345574 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2508053e10 con 0x7f25100c7500 2023-10-14T09:17:52.085 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:17:52.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 -- 172.21.15.78:0/4241345574 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24f00664a0 msgr2=0x7f24f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24f00664a0 0x7f24f0068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25000ad000 tx=0x7f25000a6000 comp rx=0 tx=0).stop 2023-10-14T09:17:52.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 -- 172.21.15.78:0/4241345574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25100c7500 msgr2=0x7f2510156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25100c7500 0x7f2510156130 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f250800c480 tx=0x7f250800c940 comp rx=0 tx=0).stop 2023-10-14T09:17:52.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 -- 172.21.15.78:0/4241345574 shutdown_connections 2023-10-14T09:17:52.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25100c7500 0x7f2510156130 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24f00664a0 0x7f24f0068960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25100c52f0 0x7f2510155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 --2- 172.21.15.78:0/4241345574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f251006ad40 0x7f2510145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 -- 172.21.15.78:0/4241345574 >> 172.21.15.78:0/4241345574 conn(0x7f25100ab0f0 msgr2=0x7f251014d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:52.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 -- 172.21.15.78:0/4241345574 shutdown_connections 2023-10-14T09:17:52.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.084+0000 7f2515a46640 1 -- 172.21.15.78:0/4241345574 wait complete. 2023-10-14T09:17:52.105 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:17:52.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf4646640 1 Processor -- start 2023-10-14T09:17:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf4646640 1 -- start start 2023-10-14T09:17:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf4646640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5bec0c4030 0x7f5bec0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf4646640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5bec06cc50 0x7f5bec0c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf4646640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bec153d90 0x7f5bec1541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf4646640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0c5300 con 0x7f5bec0c4030 2023-10-14T09:17:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf4646640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0c7af0 con 0x7f5bec06cc50 2023-10-14T09:17:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf4646640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec157360 con 0x7f5bec153d90 2023-10-14T09:17:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf23e2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5bec0c4030 0x7f5bec0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf23e2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5bec0c4030 0x7f5bec0c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51478/0 (socket says 172.21.15.78:51478) 2023-10-14T09:17:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf23e2640 1 -- 172.21.15.78:0/195771344 learned_addr learned my addr 172.21.15.78:0/195771344 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf2be3640 1 --2- 172.21.15.78:0/195771344 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bec153d90 0x7f5bec1541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf1be1640 1 --2- 172.21.15.78:0/195771344 >> v2:172.21.15.157:3300/0 conn(0x7f5bec06cc50 0x7f5bec0c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf23e2640 1 -- 172.21.15.78:0/195771344 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bec153d90 msgr2=0x7f5bec1541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf23e2640 1 --2- 172.21.15.78:0/195771344 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bec153d90 0x7f5bec1541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf23e2640 1 -- 172.21.15.78:0/195771344 >> v2:172.21.15.157:3300/0 conn(0x7f5bec06cc50 msgr2=0x7f5bec0c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf23e2640 1 --2- 172.21.15.78:0/195771344 >> v2:172.21.15.157:3300/0 conn(0x7f5bec06cc50 0x7f5bec0c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf23e2640 1 -- 172.21.15.78:0/195771344 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec157ee0 con 0x7f5bec0c4030 2023-10-14T09:17:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.244+0000 7f5bf1be1640 1 --2- 172.21.15.78:0/195771344 >> v2:172.21.15.157:3300/0 conn(0x7f5bec06cc50 0x7f5bec0c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf23e2640 1 --2- 172.21.15.78:0/195771344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bec0c4030 0x7f5bec0c75b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0c6d50 tx=0x7f5be801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6c8d4d8fb1573 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf13e0640 1 -- 172.21.15.78:0/195771344 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be80ab600 con 0x7f5bec0c4030 2023-10-14T09:17:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf13e0640 1 -- 172.21.15.78:0/195771344 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be80a7050 con 0x7f5bec0c4030 2023-10-14T09:17:52.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf13e0640 1 -- 172.21.15.78:0/195771344 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be80ab980 con 0x7f5bec0c4030 2023-10-14T09:17:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf4646640 1 -- 172.21.15.78:0/195771344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bec0c4030 msgr2=0x7f5bec0c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf4646640 1 --2- 172.21.15.78:0/195771344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bec0c4030 0x7f5bec0c75b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0c6d50 tx=0x7f5be801c470 comp rx=0 tx=0).stop 2023-10-14T09:17:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf4646640 1 -- 172.21.15.78:0/195771344 shutdown_connections 2023-10-14T09:17:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf4646640 1 --2- 172.21.15.78:0/195771344 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bec153d90 0x7f5bec1541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf4646640 1 --2- 172.21.15.78:0/195771344 >> v2:172.21.15.157:3300/0 conn(0x7f5bec06cc50 0x7f5bec0c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf4646640 1 --2- 172.21.15.78:0/195771344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bec0c4030 0x7f5bec0c75b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf4646640 1 -- 172.21.15.78:0/195771344 >> 172.21.15.78:0/195771344 conn(0x7f5bec0ab240 msgr2=0x7f5bec0ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:52.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf4646640 1 -- 172.21.15.78:0/195771344 shutdown_connections 2023-10-14T09:17:52.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.248+0000 7f5bf4646640 1 -- 172.21.15.78:0/195771344 wait complete. 2023-10-14T09:17:52.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf4646640 1 Processor -- start 2023-10-14T09:17:52.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf4646640 1 -- start start 2023-10-14T09:17:52.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf4646640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bec06cc50 0x7f5bec152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf4646640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bec0c4030 0x7f5bec0be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf4646640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bec153d90 0x7f5bec0bf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf4646640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec14fc10 con 0x7f5bec0c4030 2023-10-14T09:17:52.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf4646640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0c3170 con 0x7f5bec06cc50 2023-10-14T09:17:52.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf4646640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec156530 con 0x7f5bec153d90 2023-10-14T09:17:52.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf1be1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bec0c4030 0x7f5bec0be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf1be1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bec0c4030 0x7f5bec0be2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51494/0 (socket says 172.21.15.78:51494) 2023-10-14T09:17:52.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf1be1640 1 -- 172.21.15.78:0/89792694 learned_addr learned my addr 172.21.15.78:0/89792694 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:52.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf23e2640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bec06cc50 0x7f5bec152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf2be3640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bec153d90 0x7f5bec0bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf1be1640 1 -- 172.21.15.78:0/89792694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bec153d90 msgr2=0x7f5bec0bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf1be1640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bec153d90 0x7f5bec0bf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf1be1640 1 -- 172.21.15.78:0/89792694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bec06cc50 msgr2=0x7f5bec152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf1be1640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bec06cc50 0x7f5bec152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf1be1640 1 -- 172.21.15.78:0/89792694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be80094d0 con 0x7f5bec0c4030 2023-10-14T09:17:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf2be3640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bec153d90 0x7f5bec0bf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf1be1640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bec0c4030 0x7f5bec0be2e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c7c0 tx=0x7f5bdc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5be2ffd640 1 -- 172.21.15.78:0/89792694 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc007a30 con 0x7f5bec0c4030 2023-10-14T09:17:52.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5be2ffd640 1 -- 172.21.15.78:0/89792694 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc007b90 con 0x7f5bec0c4030 2023-10-14T09:17:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf4646640 1 -- 172.21.15.78:0/89792694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec14f930 con 0x7f5bec0c4030 2023-10-14T09:17:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5be2ffd640 1 -- 172.21.15.78:0/89792694 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00ce70 con 0x7f5bec0c4030 2023-10-14T09:17:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.252+0000 7f5bf4646640 1 -- 172.21.15.78:0/89792694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec0c3600 con 0x7f5bec0c4030 2023-10-14T09:17:52.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.256+0000 7f5bf4646640 1 -- 172.21.15.78:0/89792694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec0c3320 con 0x7f5bec0c4030 2023-10-14T09:17:52.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.256+0000 7f5be2ffd640 1 -- 172.21.15.78:0/89792694 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5bdc0113f0 con 0x7f5bec0c4030 2023-10-14T09:17:52.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.256+0000 7f5be2ffd640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd00664a0 0x7f5bd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.256+0000 7f5be2ffd640 1 -- 172.21.15.78:0/89792694 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bdc083e70 con 0x7f5bec0c4030 2023-10-14T09:17:52.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.256+0000 7f5bf23e2640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd00664a0 0x7f5bd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.256+0000 7f5bf23e2640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd00664a0 0x7f5bd0068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0c6da0 tx=0x7f5be8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:52.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.260+0000 7f5be2ffd640 1 -- 172.21.15.78:0/89792694 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5bec0c3320 con 0x7f5bec0c4030 2023-10-14T09:17:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.408+0000 7f5bf4646640 1 -- 172.21.15.78:0/89792694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5bec0c32e0 con 0x7f5bec0c4030 2023-10-14T09:17:52.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.408+0000 7f5be2ffd640 1 -- 172.21.15.78:0/89792694 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5bdc051430 con 0x7f5bec0c4030 2023-10-14T09:17:52.413 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:17:52.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 -- 172.21.15.78:0/89792694 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd00664a0 msgr2=0x7f5bd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd00664a0 0x7f5bd0068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0c6da0 tx=0x7f5be8008040 comp rx=0 tx=0).stop 2023-10-14T09:17:52.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 -- 172.21.15.78:0/89792694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bec0c4030 msgr2=0x7f5bec0be2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bec0c4030 0x7f5bec0be2e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c7c0 tx=0x7f5bdc00cc80 comp rx=0 tx=0).stop 2023-10-14T09:17:52.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 -- 172.21.15.78:0/89792694 shutdown_connections 2023-10-14T09:17:52.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd00664a0 0x7f5bd0068960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bec153d90 0x7f5bec0bf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bec0c4030 0x7f5bec0be2e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 --2- 172.21.15.78:0/89792694 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bec06cc50 0x7f5bec152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 -- 172.21.15.78:0/89792694 >> 172.21.15.78:0/89792694 conn(0x7f5bec0ab240 msgr2=0x7f5bec1506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:52.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 -- 172.21.15.78:0/89792694 shutdown_connections 2023-10-14T09:17:52.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.412+0000 7f5bf4646640 1 -- 172.21.15.78:0/89792694 wait complete. 2023-10-14T09:17:52.463 INFO:tasks.cephfs_test_runner:Starting test: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) That unsetting mds_join_fs will not cause failover if no high-affinity standby exists. 2023-10-14T09:17:52.464 INFO:tasks.cephfs_test_runner:test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2023-10-14T09:17:52.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:52.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f954cc46640 1 Processor -- start 2023-10-14T09:17:52.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f954cc46640 1 -- start start 2023-10-14T09:17:52.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f954cc46640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f95480a8b00 0x7f9548157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f954cc46640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9548069e90 0x7f954806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f954cc46640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95481582e0 con 0x7f954813cfb0 2023-10-14T09:17:52.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f954cc46640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95480a82b0 con 0x7f95480a8b00 2023-10-14T09:17:52.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f954cc46640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9548157320 con 0x7f9548069e90 2023-10-14T09:17:52.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f954659c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f954813cfb0 0x7f954806dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36084/0 (socket says 172.21.15.78:36084) 2023-10-14T09:17:52.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f954659c640 1 -- 172.21.15.78:0/3931539194 learned_addr learned my addr 172.21.15.78:0/3931539194 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:52.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f9546d9d640 1 --2- 172.21.15.78:0/3931539194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9548069e90 0x7f954806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f953ffff640 1 --2- 172.21.15.78:0/3931539194 >> v2:172.21.15.157:3300/0 conn(0x7f95480a8b00 0x7f9548157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f9545d9b640 1 -- 172.21.15.78:0/3931539194 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031079739 0 0) 0x7f95481582e0 con 0x7f954813cfb0 2023-10-14T09:17:52.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.600+0000 7f9545d9b640 1 -- 172.21.15.78:0/3931539194 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9534003530 con 0x7f954813cfb0 2023-10-14T09:17:52.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.604+0000 7f9546d9d640 1 -- 172.21.15.78:0/3931539194 >> v2:172.21.15.157:3300/0 conn(0x7f95480a8b00 msgr2=0x7f9548157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:52.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.604+0000 7f9546d9d640 1 --2- 172.21.15.78:0/3931539194 >> v2:172.21.15.157:3300/0 conn(0x7f95480a8b00 0x7f9548157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.604+0000 7f9546d9d640 1 -- 172.21.15.78:0/3931539194 >> v1:172.21.15.78:6789/0 conn(0x7f954813cfb0 legacy=0x7f954806dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.604+0000 7f9546d9d640 1 -- 172.21.15.78:0/3931539194 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95481548a0 con 0x7f9548069e90 2023-10-14T09:17:52.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.604+0000 7f9546d9d640 1 --2- 172.21.15.78:0/3931539194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9548069e90 0x7f954806a320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9540009dc0 tx=0x7f954001c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8f9049f455b6d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:52.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.604+0000 7f9545d9b640 1 -- 172.21.15.78:0/3931539194 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400a5840 con 0x7f9548069e90 2023-10-14T09:17:52.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.604+0000 7f9545d9b640 1 -- 172.21.15.78:0/3931539194 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95400a59a0 con 0x7f9548069e90 2023-10-14T09:17:52.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.604+0000 7f9545d9b640 1 -- 172.21.15.78:0/3931539194 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95400a5d30 con 0x7f9548069e90 2023-10-14T09:17:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 -- 172.21.15.78:0/3931539194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9548069e90 msgr2=0x7f954806a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 --2- 172.21.15.78:0/3931539194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9548069e90 0x7f954806a320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9540009dc0 tx=0x7f954001c870 comp rx=0 tx=0).stop 2023-10-14T09:17:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 -- 172.21.15.78:0/3931539194 shutdown_connections 2023-10-14T09:17:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 --2- 172.21.15.78:0/3931539194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9548069e90 0x7f954806a320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 --2- 172.21.15.78:0/3931539194 >> v2:172.21.15.157:3300/0 conn(0x7f95480a8b00 0x7f9548157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 -- 172.21.15.78:0/3931539194 >> 172.21.15.78:0/3931539194 conn(0x7f954806c9c0 msgr2=0x7f954806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:52.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 -- 172.21.15.78:0/3931539194 shutdown_connections 2023-10-14T09:17:52.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 -- 172.21.15.78:0/3931539194 wait complete. 2023-10-14T09:17:52.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 Processor -- start 2023-10-14T09:17:52.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 -- start start 2023-10-14T09:17:52.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9548069e90 0x7f9548156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95480a8b00 0x7f95480aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f954813cfb0 0x7f95480ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95481efaa0 con 0x7f95480a8b00 2023-10-14T09:17:52.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95480ac1c0 con 0x7f9548069e90 2023-10-14T09:17:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954cc46640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95480c19c0 con 0x7f954813cfb0 2023-10-14T09:17:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f953ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95480a8b00 0x7f95480aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f953ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95480a8b00 0x7f95480aad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51506/0 (socket says 172.21.15.78:51506) 2023-10-14T09:17:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f953ffff640 1 -- 172.21.15.78:0/2824125882 learned_addr learned my addr 172.21.15.78:0/2824125882 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:52.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f954659c640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9548069e90 0x7f9548156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f9546d9d640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f954813cfb0 0x7f95480ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f953ffff640 1 -- 172.21.15.78:0/2824125882 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f954813cfb0 msgr2=0x7f95480ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f953ffff640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f954813cfb0 0x7f95480ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f953ffff640 1 -- 172.21.15.78:0/2824125882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9548069e90 msgr2=0x7f9548156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f953ffff640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9548069e90 0x7f9548156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f953ffff640 1 -- 172.21.15.78:0/2824125882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9540009a70 con 0x7f95480a8b00 2023-10-14T09:17:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.608+0000 7f953ffff640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95480a8b00 0x7f95480aad30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f953000e870 tx=0x7f953000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.612+0000 7f953effd640 1 -- 172.21.15.78:0/2824125882 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530009510 con 0x7f95480a8b00 2023-10-14T09:17:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.612+0000 7f953effd640 1 -- 172.21.15.78:0/2824125882 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953000eec0 con 0x7f95480a8b00 2023-10-14T09:17:52.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.612+0000 7f954cc46640 1 -- 172.21.15.78:0/2824125882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95480c0000 con 0x7f95480a8b00 2023-10-14T09:17:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.612+0000 7f953effd640 1 -- 172.21.15.78:0/2824125882 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953000cb40 con 0x7f95480a8b00 2023-10-14T09:17:52.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.612+0000 7f954cc46640 1 -- 172.21.15.78:0/2824125882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95481efcb0 con 0x7f95480a8b00 2023-10-14T09:17:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.612+0000 7f954cc46640 1 -- 172.21.15.78:0/2824125882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9548074180 con 0x7f95480a8b00 2023-10-14T09:17:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.612+0000 7f953effd640 1 -- 172.21.15.78:0/2824125882 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f953000ccc0 con 0x7f95480a8b00 2023-10-14T09:17:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.612+0000 7f953effd640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95280664a0 0x7f9528068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.612+0000 7f953effd640 1 -- 172.21.15.78:0/2824125882 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9530084380 con 0x7f95480a8b00 2023-10-14T09:17:52.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.612+0000 7f954659c640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95280664a0 0x7f9528068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.612+0000 7f954659c640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95280664a0 0x7f9528068960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f95380011f0 tx=0x7f9538009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:52.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.616+0000 7f953effd640 1 -- 172.21.15.78:0/2824125882 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9530051770 con 0x7f95480a8b00 2023-10-14T09:17:52.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.768+0000 7f954cc46640 1 -- 172.21.15.78:0/2824125882 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9548157850 con 0x7f95480a8b00 2023-10-14T09:17:52.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.768+0000 7f953effd640 1 -- 172.21.15.78:0/2824125882 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f9530054d90 con 0x7f95480a8b00 2023-10-14T09:17:52.773 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:52.773 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:52.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 -- 172.21.15.78:0/2824125882 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95280664a0 msgr2=0x7f9528068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95280664a0 0x7f9528068960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f95380011f0 tx=0x7f9538009040 comp rx=0 tx=0).stop 2023-10-14T09:17:52.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 -- 172.21.15.78:0/2824125882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95480a8b00 msgr2=0x7f95480aad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95480a8b00 0x7f95480aad30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f953000e870 tx=0x7f953000ec70 comp rx=0 tx=0).stop 2023-10-14T09:17:52.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 -- 172.21.15.78:0/2824125882 shutdown_connections 2023-10-14T09:17:52.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f95280664a0 0x7f9528068960 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f954813cfb0 0x7f95480ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95480a8b00 0x7f95480aad30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 --2- 172.21.15.78:0/2824125882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9548069e90 0x7f9548156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 -- 172.21.15.78:0/2824125882 >> 172.21.15.78:0/2824125882 conn(0x7f954806c9c0 msgr2=0x7f95481396b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:52.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 -- 172.21.15.78:0/2824125882 shutdown_connections 2023-10-14T09:17:52.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.772+0000 7f954cc46640 1 -- 172.21.15.78:0/2824125882 wait complete. 2023-10-14T09:17:52.794 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:52.795 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:52.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.932+0000 7fa0e4f0f640 1 Processor -- start 2023-10-14T09:17:52.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.932+0000 7fa0e4f0f640 1 -- start start 2023-10-14T09:17:52.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.932+0000 7fa0e4f0f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0e0139dc0 0x7fa0e00718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.932+0000 7fa0e4f0f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0e0150ac0 0x7fa0e0150f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.932+0000 7fa0e4f0f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e0151fd0 con 0x7fa0e01532c0 2023-10-14T09:17:52.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.932+0000 7fa0e4f0f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e00702c0 con 0x7fa0e0139dc0 2023-10-14T09:17:52.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.932+0000 7fa0e4f0f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0152ea0 con 0x7fa0e0150ac0 2023-10-14T09:17:52.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.932+0000 7fa0de59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0e0139dc0 0x7fa0e00718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.932+0000 7fa0de59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0e0139dc0 0x7fa0e00718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51520/0 (socket says 172.21.15.78:51520) 2023-10-14T09:17:52.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.932+0000 7fa0de59c640 1 -- 172.21.15.78:0/589683589 learned_addr learned my addr 172.21.15.78:0/589683589 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:52.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.932+0000 7fa0ddd9b640 1 --2- 172.21.15.78:0/589683589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0e0150ac0 0x7fa0e0150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0dd59a640 1 -- 172.21.15.78:0/589683589 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372966877 0 0) 0x7fa0e0151fd0 con 0x7fa0e01532c0 2023-10-14T09:17:52.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0de59c640 1 -- 172.21.15.78:0/589683589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0e0150ac0 msgr2=0x7fa0e0150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:52.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0de59c640 1 --2- 172.21.15.78:0/589683589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0e0150ac0 0x7fa0e0150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0de59c640 1 -- 172.21.15.78:0/589683589 >> v1:172.21.15.78:6789/0 conn(0x7fa0e01532c0 legacy=0x7fa0e0153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0de59c640 1 -- 172.21.15.78:0/589683589 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e0153e60 con 0x7fa0e0139dc0 2023-10-14T09:17:52.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0de59c640 1 --2- 172.21.15.78:0/589683589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0139dc0 0x7fa0e00718a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009870 tx=0x7fa0d001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e781fe27f0a5af2b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:52.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0dd59a640 1 -- 172.21.15.78:0/589683589 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00ab680 con 0x7fa0e0139dc0 2023-10-14T09:17:52.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0dd59a640 1 -- 172.21.15.78:0/589683589 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d00ab7e0 con 0x7fa0e0139dc0 2023-10-14T09:17:52.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0dd59a640 1 -- 172.21.15.78:0/589683589 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00abb70 con 0x7fa0e0139dc0 2023-10-14T09:17:52.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/589683589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0139dc0 msgr2=0x7fa0e00718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0e4f0f640 1 --2- 172.21.15.78:0/589683589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0139dc0 0x7fa0e00718a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009870 tx=0x7fa0d001c480 comp rx=0 tx=0).stop 2023-10-14T09:17:52.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/589683589 shutdown_connections 2023-10-14T09:17:52.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0e4f0f640 1 --2- 172.21.15.78:0/589683589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0e0150ac0 0x7fa0e0150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0e4f0f640 1 --2- 172.21.15.78:0/589683589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0139dc0 0x7fa0e00718a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/589683589 >> 172.21.15.78:0/589683589 conn(0x7fa0e00c1d00 msgr2=0x7fa0e00c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:52.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/589683589 shutdown_connections 2023-10-14T09:17:52.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.936+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/589683589 wait complete. 2023-10-14T09:17:52.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0e4f0f640 1 Processor -- start 2023-10-14T09:17:52.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0e4f0f640 1 -- start start 2023-10-14T09:17:52.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0e4f0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0139dc0 0x7fa0e01e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0e4f0f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0e0150ac0 0x7fa0e014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0e4f0f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0e01532c0 0x7fa0e01ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0e4f0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e01ecb30 con 0x7fa0e0139dc0 2023-10-14T09:17:52.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0e4f0f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0130670 con 0x7fa0e01532c0 2023-10-14T09:17:52.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0e4f0f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e01300b0 con 0x7fa0e0150ac0 2023-10-14T09:17:52.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0de59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0139dc0 0x7fa0e01e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0de59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0139dc0 0x7fa0e01e9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51532/0 (socket says 172.21.15.78:51532) 2023-10-14T09:17:52.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0de59c640 1 -- 172.21.15.78:0/1558722282 learned_addr learned my addr 172.21.15.78:0/1558722282 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:52.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0ded9d640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0e01532c0 0x7fa0e01ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0ddd9b640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0e0150ac0 0x7fa0e014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0de59c640 1 -- 172.21.15.78:0/1558722282 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0e0150ac0 msgr2=0x7fa0e014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0de59c640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0e0150ac0 0x7fa0e014f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0de59c640 1 -- 172.21.15.78:0/1558722282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0e01532c0 msgr2=0x7fa0e01ecf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:52.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0de59c640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0e01532c0 0x7fa0e01ecf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:52.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0de59c640 1 -- 172.21.15.78:0/1558722282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d00094d0 con 0x7fa0e0139dc0 2023-10-14T09:17:52.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0de59c640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0139dc0 0x7fa0e01e9b80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa0d001a0b0 tx=0x7fa0d001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:52.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0ceffd640 1 -- 172.21.15.78:0/1558722282 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00b4800 con 0x7fa0e0139dc0 2023-10-14T09:17:52.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0ceffd640 1 -- 172.21.15.78:0/1558722282 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d00b4960 con 0x7fa0e0139dc0 2023-10-14T09:17:52.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0ceffd640 1 -- 172.21.15.78:0/1558722282 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00b4d10 con 0x7fa0e0139dc0 2023-10-14T09:17:52.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/1558722282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e0130390 con 0x7fa0e0139dc0 2023-10-14T09:17:52.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.940+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/1558722282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e01327f0 con 0x7fa0e0139dc0 2023-10-14T09:17:52.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.944+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/1558722282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e01ec900 con 0x7fa0e0139dc0 2023-10-14T09:17:52.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.944+0000 7fa0ceffd640 1 -- 172.21.15.78:0/1558722282 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa0d00c7440 con 0x7fa0e0139dc0 2023-10-14T09:17:52.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.944+0000 7fa0ceffd640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa0c00664a0 0x7fa0c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:52.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.944+0000 7fa0ceffd640 1 -- 172.21.15.78:0/1558722282 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0d011ebf0 con 0x7fa0e0139dc0 2023-10-14T09:17:52.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.944+0000 7fa0ddd9b640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa0c00664a0 0x7fa0c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:52.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.944+0000 7fa0ddd9b640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa0c00664a0 0x7fa0c0068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa0e006d590 tx=0x7fa0d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:52.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:52.948+0000 7fa0ceffd640 1 -- 172.21.15.78:0/1558722282 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0e01ec900 con 0x7fa0e0139dc0 2023-10-14T09:17:53.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.096+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/1558722282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0e01ec900 con 0x7fa0e0139dc0 2023-10-14T09:17:53.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.096+0000 7fa0ceffd640 1 -- 172.21.15.78:0/1558722282 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0e01ec900 con 0x7fa0e0139dc0 2023-10-14T09:17:53.100 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:53.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/1558722282 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa0c00664a0 msgr2=0x7fa0c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa0c00664a0 0x7fa0c0068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa0e006d590 tx=0x7fa0d4008040 comp rx=0 tx=0).stop 2023-10-14T09:17:53.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/1558722282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0139dc0 msgr2=0x7fa0e01e9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0139dc0 0x7fa0e01e9b80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa0d001a0b0 tx=0x7fa0d001acc0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/1558722282 shutdown_connections 2023-10-14T09:17:53.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0e01532c0 0x7fa0e01ecf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa0c00664a0 0x7fa0c0068960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0e0150ac0 0x7fa0e014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 --2- 172.21.15.78:0/1558722282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0e0139dc0 0x7fa0e01e9b80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/1558722282 >> 172.21.15.78:0/1558722282 conn(0x7fa0e00c1d00 msgr2=0x7fa0e00c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:53.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/1558722282 shutdown_connections 2023-10-14T09:17:53.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.100+0000 7fa0e4f0f640 1 -- 172.21.15.78:0/1558722282 wait complete. 2023-10-14T09:17:53.121 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:17:53.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff548d0e640 1 Processor -- start 2023-10-14T09:17:53.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff548d0e640 1 -- start start 2023-10-14T09:17:53.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff548d0e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5441514e0 0x7ff544154880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff548d0e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff5440c3fc0 0x7ff5440c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff548d0e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff544072420 con 0x7ff544071e90 2023-10-14T09:17:53.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff548d0e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff544071360 con 0x7ff5441514e0 2023-10-14T09:17:53.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff548d0e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5440c3b10 con 0x7ff5440c3fc0 2023-10-14T09:17:53.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff54259c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5441514e0 0x7ff544154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff54259c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5441514e0 0x7ff544154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51536/0 (socket says 172.21.15.78:51536) 2023-10-14T09:17:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff54259c640 1 -- 172.21.15.78:0/3852221480 learned_addr learned my addr 172.21.15.78:0/3852221480 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff542d9d640 1 --2- 172.21.15.78:0/3852221480 >> v2:172.21.15.157:3300/0 conn(0x7ff5440c3fc0 0x7ff5440c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff54259c640 1 -- 172.21.15.78:0/3852221480 >> v2:172.21.15.157:3300/0 conn(0x7ff5440c3fc0 msgr2=0x7ff5440c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff54259c640 1 --2- 172.21.15.78:0/3852221480 >> v2:172.21.15.157:3300/0 conn(0x7ff5440c3fc0 0x7ff5440c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff54259c640 1 -- 172.21.15.78:0/3852221480 >> v1:172.21.15.157:6789/0 conn(0x7ff544071e90 legacy=0x7ff54406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.260+0000 7ff54259c640 1 -- 172.21.15.78:0/3852221480 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440c5300 con 0x7ff5441514e0 2023-10-14T09:17:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff54259c640 1 --2- 172.21.15.78:0/3852221480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5441514e0 0x7ff544154880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff54406e7a0 tx=0x7ff53401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a90dfa8505543b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff541d9b640 1 -- 172.21.15.78:0/3852221480 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340ab600 con 0x7ff5441514e0 2023-10-14T09:17:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff541d9b640 1 -- 172.21.15.78:0/3852221480 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5340ab760 con 0x7ff5441514e0 2023-10-14T09:17:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff541d9b640 1 -- 172.21.15.78:0/3852221480 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340abaf0 con 0x7ff5441514e0 2023-10-14T09:17:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff548d0e640 1 -- 172.21.15.78:0/3852221480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5441514e0 msgr2=0x7ff544154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff548d0e640 1 --2- 172.21.15.78:0/3852221480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5441514e0 0x7ff544154880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff54406e7a0 tx=0x7ff53401c440 comp rx=0 tx=0).stop 2023-10-14T09:17:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff548d0e640 1 -- 172.21.15.78:0/3852221480 shutdown_connections 2023-10-14T09:17:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff548d0e640 1 --2- 172.21.15.78:0/3852221480 >> v2:172.21.15.157:3300/0 conn(0x7ff5440c3fc0 0x7ff5440c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff548d0e640 1 --2- 172.21.15.78:0/3852221480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5441514e0 0x7ff544154880 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff548d0e640 1 -- 172.21.15.78:0/3852221480 >> 172.21.15.78:0/3852221480 conn(0x7ff5440c25f0 msgr2=0x7ff5440c2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff548d0e640 1 -- 172.21.15.78:0/3852221480 shutdown_connections 2023-10-14T09:17:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.264+0000 7ff548d0e640 1 -- 172.21.15.78:0/3852221480 wait complete. 2023-10-14T09:17:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff548d0e640 1 Processor -- start 2023-10-14T09:17:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff548d0e640 1 -- start start 2023-10-14T09:17:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff548d0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff544071e90 0x7ff544148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff548d0e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5440c3fc0 0x7ff5440bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff548d0e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5441514e0 0x7ff5440bba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff548d0e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5441494c0 con 0x7ff544071e90 2023-10-14T09:17:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff548d0e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54406c600 con 0x7ff5440c3fc0 2023-10-14T09:17:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff548d0e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5441ec750 con 0x7ff5441514e0 2023-10-14T09:17:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff54259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff544071e90 0x7ff544148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff54259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff544071e90 0x7ff544148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51542/0 (socket says 172.21.15.78:51542) 2023-10-14T09:17:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff54259c640 1 -- 172.21.15.78:0/1014348003 learned_addr learned my addr 172.21.15.78:0/1014348003 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff539d9b640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5440c3fc0 0x7ff5440bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff542d9d640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5441514e0 0x7ff5440bba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff54259c640 1 -- 172.21.15.78:0/1014348003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5441514e0 msgr2=0x7ff5440bba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff54259c640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5441514e0 0x7ff5440bba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff54259c640 1 -- 172.21.15.78:0/1014348003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5440c3fc0 msgr2=0x7ff5440bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff54259c640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5440c3fc0 0x7ff5440bf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff54259c640 1 -- 172.21.15.78:0/1014348003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340094d0 con 0x7ff544071e90 2023-10-14T09:17:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff54259c640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff544071e90 0x7ff544148f80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff534019050 tx=0x7ff53401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff53b7fe640 1 -- 172.21.15.78:0/1014348003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340b4800 con 0x7ff544071e90 2023-10-14T09:17:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff53b7fe640 1 -- 172.21.15.78:0/1014348003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5340b4980 con 0x7ff544071e90 2023-10-14T09:17:53.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff548d0e640 1 -- 172.21.15.78:0/1014348003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5441eca30 con 0x7ff544071e90 2023-10-14T09:17:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff53b7fe640 1 -- 172.21.15.78:0/1014348003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340b4d30 con 0x7ff544071e90 2023-10-14T09:17:53.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.268+0000 7ff548d0e640 1 -- 172.21.15.78:0/1014348003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff544149700 con 0x7ff544071e90 2023-10-14T09:17:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.272+0000 7ff548d0e640 1 -- 172.21.15.78:0/1014348003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54406c7c0 con 0x7ff544071e90 2023-10-14T09:17:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.272+0000 7ff53b7fe640 1 -- 172.21.15.78:0/1014348003 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff5340b3380 con 0x7ff544071e90 2023-10-14T09:17:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.272+0000 7ff53b7fe640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff5240664a0 0x7ff524068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.272+0000 7ff53b7fe640 1 -- 172.21.15.78:0/1014348003 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff53411dd70 con 0x7ff544071e90 2023-10-14T09:17:53.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.272+0000 7ff539d9b640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff5240664a0 0x7ff524068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.272+0000 7ff539d9b640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff5240664a0 0x7ff524068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff54414edd0 tx=0x7ff52c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:53.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.276+0000 7ff53b7fe640 1 -- 172.21.15.78:0/1014348003 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff5340eb200 con 0x7ff544071e90 2023-10-14T09:17:53.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.424+0000 7ff548d0e640 1 -- 172.21.15.78:0/1014348003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5440c5890 con 0x7ff544071e90 2023-10-14T09:17:53.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.424+0000 7ff53b7fe640 1 -- 172.21.15.78:0/1014348003 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5340ee820 con 0x7ff544071e90 2023-10-14T09:17:53.428 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:17:53.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 -- 172.21.15.78:0/1014348003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff5240664a0 msgr2=0x7ff524068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff5240664a0 0x7ff524068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff54414edd0 tx=0x7ff52c009040 comp rx=0 tx=0).stop 2023-10-14T09:17:53.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 -- 172.21.15.78:0/1014348003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff544071e90 msgr2=0x7ff544148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff544071e90 0x7ff544148f80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff534019050 tx=0x7ff53401ac80 comp rx=0 tx=0).stop 2023-10-14T09:17:53.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 -- 172.21.15.78:0/1014348003 shutdown_connections 2023-10-14T09:17:53.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff5240664a0 0x7ff524068960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5441514e0 0x7ff5440bba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5440c3fc0 0x7ff5440bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 --2- 172.21.15.78:0/1014348003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff544071e90 0x7ff544148f80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 -- 172.21.15.78:0/1014348003 >> 172.21.15.78:0/1014348003 conn(0x7ff5440c25f0 msgr2=0x7ff54414fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:53.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 -- 172.21.15.78:0/1014348003 shutdown_connections 2023-10-14T09:17:53.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.428+0000 7ff548d0e640 1 -- 172.21.15.78:0/1014348003 wait complete. 2023-10-14T09:17:53.449 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:17:53.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.584+0000 7f880291d640 1 Processor -- start 2023-10-14T09:17:53.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.584+0000 7f880291d640 1 -- start start 2023-10-14T09:17:53.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f880291d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87fc15b530 0x7f87fc15d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f880291d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87fc0c0310 con 0x7f87fc13af90 2023-10-14T09:17:53.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f880291d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87fc151c90 con 0x7f87fc0bbd90 2023-10-14T09:17:53.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f880291d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0bc1f0 con 0x7f87fc15b530 2023-10-14T09:17:53.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f87fbfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f87fc13af90 0x7f87fc0bfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36116/0 (socket says 172.21.15.78:36116) 2023-10-14T09:17:53.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f87fbfff640 1 -- 172.21.15.78:0/221295509 learned_addr learned my addr 172.21.15.78:0/221295509 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:53.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f8800eba640 1 --2- 172.21.15.78:0/221295509 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87fc15b530 0x7f87fc15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f87faffd640 1 -- 172.21.15.78:0/221295509 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181342843 0 0) 0x7f87fc0c0310 con 0x7f87fc13af90 2023-10-14T09:17:53.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f87faffd640 1 -- 172.21.15.78:0/221295509 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e4003530 con 0x7f87fc13af90 2023-10-14T09:17:53.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f87faffd640 1 -- 172.21.15.78:0/221295509 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686652911 0 0) 0x7f87fc151c90 con 0x7f87fc0bbd90 2023-10-14T09:17:53.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f87faffd640 1 -- 172.21.15.78:0/221295509 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87fc0c0310 con 0x7f87fc0bbd90 2023-10-14T09:17:53.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f8800eba640 1 -- 172.21.15.78:0/221295509 >> v1:172.21.15.157:6789/0 conn(0x7f87fc0bbd90 legacy=0x7f87fc06bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f8800eba640 1 -- 172.21.15.78:0/221295509 >> v1:172.21.15.78:6789/0 conn(0x7f87fc13af90 legacy=0x7f87fc0bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.588+0000 7f8800eba640 1 -- 172.21.15.78:0/221295509 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0bafd0 con 0x7f87fc15b530 2023-10-14T09:17:53.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f8800eba640 1 --2- 172.21.15.78:0/221295509 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87fc15b530 0x7f87fc15d920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009dc0 tx=0x7f87f401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b8e53bf8c05154 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:53.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f87faffd640 1 -- 172.21.15.78:0/221295509 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40a5890 con 0x7f87fc15b530 2023-10-14T09:17:53.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f87faffd640 1 -- 172.21.15.78:0/221295509 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f40a59f0 con 0x7f87fc15b530 2023-10-14T09:17:53.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f87faffd640 1 -- 172.21.15.78:0/221295509 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40a5d80 con 0x7f87fc15b530 2023-10-14T09:17:53.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f880291d640 1 -- 172.21.15.78:0/221295509 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87fc15b530 msgr2=0x7f87fc15d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f880291d640 1 --2- 172.21.15.78:0/221295509 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87fc15b530 0x7f87fc15d920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009dc0 tx=0x7f87f401c8e0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f880291d640 1 -- 172.21.15.78:0/221295509 shutdown_connections 2023-10-14T09:17:53.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f880291d640 1 --2- 172.21.15.78:0/221295509 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87fc15b530 0x7f87fc15d920 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f880291d640 1 -- 172.21.15.78:0/221295509 >> 172.21.15.78:0/221295509 conn(0x7f87fc0c1d00 msgr2=0x7f87fc0c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:53.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f880291d640 1 -- 172.21.15.78:0/221295509 shutdown_connections 2023-10-14T09:17:53.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f880291d640 1 -- 172.21.15.78:0/221295509 wait complete. 2023-10-14T09:17:53.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f880291d640 1 Processor -- start 2023-10-14T09:17:53.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.592+0000 7f880291d640 1 -- start start 2023-10-14T09:17:53.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f880291d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87fc0bbd90 0x7f87fc15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f880291d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87fc13af90 0x7f87fc1ebc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f880291d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87fc15b530 0x7f87fc1ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f880291d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc15d670 con 0x7f87fc15b530 2023-10-14T09:17:53.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f880291d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0bf6a0 con 0x7f87fc0bbd90 2023-10-14T09:17:53.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f880291d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc071c10 con 0x7f87fc13af90 2023-10-14T09:17:53.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f8800eba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87fc15b530 0x7f87fc1ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f8800eba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87fc15b530 0x7f87fc1ec180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51548/0 (socket says 172.21.15.78:51548) 2023-10-14T09:17:53.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f8800eba640 1 -- 172.21.15.78:0/239321825 learned_addr learned my addr 172.21.15.78:0/239321825 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:53.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f87fbfff640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87fc0bbd90 0x7f87fc15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f87fb7fe640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87fc13af90 0x7f87fc1ebc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f8800eba640 1 -- 172.21.15.78:0/239321825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87fc13af90 msgr2=0x7f87fc1ebc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f8800eba640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87fc13af90 0x7f87fc1ebc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f8800eba640 1 -- 172.21.15.78:0/239321825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87fc0bbd90 msgr2=0x7f87fc15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f8800eba640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87fc0bbd90 0x7f87fc15cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f8800eba640 1 -- 172.21.15.78:0/239321825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f4009a70 con 0x7f87fc15b530 2023-10-14T09:17:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f8800eba640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87fc15b530 0x7f87fc1ec180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f87f401a510 tx=0x7f87f4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f87f8ff9640 1 -- 172.21.15.78:0/239321825 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40ad640 con 0x7f87fc15b530 2023-10-14T09:17:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f87f8ff9640 1 -- 172.21.15.78:0/239321825 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f40ad7a0 con 0x7f87fc15b530 2023-10-14T09:17:53.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f880291d640 1 -- 172.21.15.78:0/239321825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87fc0bf0e0 con 0x7f87fc15b530 2023-10-14T09:17:53.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f87f8ff9640 1 -- 172.21.15.78:0/239321825 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40adb50 con 0x7f87fc15b530 2023-10-14T09:17:53.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f880291d640 1 -- 172.21.15.78:0/239321825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87fc1ef350 con 0x7f87fc15b530 2023-10-14T09:17:53.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.596+0000 7f880291d640 1 -- 172.21.15.78:0/239321825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87fc1ef1b0 con 0x7f87fc15b530 2023-10-14T09:17:53.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.600+0000 7f87f8ff9640 1 -- 172.21.15.78:0/239321825 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f87f40b4050 con 0x7f87fc15b530 2023-10-14T09:17:53.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.600+0000 7f87f8ff9640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87e80664a0 0x7f87e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.600+0000 7f87f8ff9640 1 -- 172.21.15.78:0/239321825 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87f411eb90 con 0x7f87fc15b530 2023-10-14T09:17:53.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.600+0000 7f87fbfff640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87e80664a0 0x7f87e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.600+0000 7f87fbfff640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87e80664a0 0x7f87e8068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f87ec007fd0 tx=0x7f87ec007d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:53.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.604+0000 7f87f8ff9640 1 -- 172.21.15.78:0/239321825 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f87fc1ef1b0 con 0x7f87fc15b530 2023-10-14T09:17:53.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.752+0000 7f880291d640 1 -- 172.21.15.78:0/239321825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87fc1ef1b0 con 0x7f87fc15b530 2023-10-14T09:17:53.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.752+0000 7f87f8ff9640 1 -- 172.21.15.78:0/239321825 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87f40c7020 con 0x7f87fc15b530 2023-10-14T09:17:53.755 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:17:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.752+0000 7f880291d640 1 -- 172.21.15.78:0/239321825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87e80664a0 msgr2=0x7f87e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.752+0000 7f880291d640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87e80664a0 0x7f87e8068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f87ec007fd0 tx=0x7f87ec007d80 comp rx=0 tx=0).stop 2023-10-14T09:17:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.752+0000 7f880291d640 1 -- 172.21.15.78:0/239321825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87fc15b530 msgr2=0x7f87fc1ec180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.752+0000 7f880291d640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87fc15b530 0x7f87fc1ec180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f87f401a510 tx=0x7f87f4019680 comp rx=0 tx=0).stop 2023-10-14T09:17:53.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.756+0000 7f880291d640 1 -- 172.21.15.78:0/239321825 shutdown_connections 2023-10-14T09:17:53.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.756+0000 7f880291d640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87fc15b530 0x7f87fc1ec180 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.756+0000 7f880291d640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87e80664a0 0x7f87e8068960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.756+0000 7f880291d640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87fc13af90 0x7f87fc1ebc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.756+0000 7f880291d640 1 --2- 172.21.15.78:0/239321825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87fc0bbd90 0x7f87fc15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.756+0000 7f880291d640 1 -- 172.21.15.78:0/239321825 >> 172.21.15.78:0/239321825 conn(0x7f87fc0c1d00 msgr2=0x7f87fc139aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:53.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.756+0000 7f880291d640 1 -- 172.21.15.78:0/239321825 shutdown_connections 2023-10-14T09:17:53.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.756+0000 7f880291d640 1 -- 172.21.15.78:0/239321825 wait complete. 2023-10-14T09:17:53.776 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop' 2023-10-14T09:17:53.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db73d9640 1 Processor -- start 2023-10-14T09:17:53.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db73d9640 1 -- start start 2023-10-14T09:17:53.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db73d9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0db014e0f0 0x7f0db0152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db73d9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0db0150a90 0x7f0db0150e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db73d9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db01531d0 con 0x7f0db014ed10 2023-10-14T09:17:53.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db73d9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db0153e50 con 0x7f0db0150a90 2023-10-14T09:17:53.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db73d9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db01534b0 con 0x7f0db014e0f0 2023-10-14T09:17:53.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db5976640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0db0150a90 0x7f0db0150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db4974640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0db014ed10 0x7f0db014f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36118/0 (socket says 172.21.15.78:36118) 2023-10-14T09:17:53.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db4974640 1 -- 172.21.15.78:0/1854263467 learned_addr learned my addr 172.21.15.78:0/1854263467 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:53.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db5175640 1 --2- 172.21.15.78:0/1854263467 >> v2:172.21.15.157:3300/0 conn(0x7f0db014e0f0 0x7f0db0152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db5976640 1 -- 172.21.15.78:0/1854263467 >> v2:172.21.15.157:3300/0 conn(0x7f0db014e0f0 msgr2=0x7f0db0152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:53.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db5976640 1 --2- 172.21.15.78:0/1854263467 >> v2:172.21.15.157:3300/0 conn(0x7f0db014e0f0 0x7f0db0152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db5976640 1 -- 172.21.15.78:0/1854263467 >> v1:172.21.15.78:6789/0 conn(0x7f0db014ed10 legacy=0x7f0db014f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db5976640 1 -- 172.21.15.78:0/1854263467 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0153790 con 0x7f0db0150a90 2023-10-14T09:17:53.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0db5175640 1 --2- 172.21.15.78:0/1854263467 >> v2:172.21.15.157:3300/0 conn(0x7f0db014e0f0 0x7f0db0152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:53.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.912+0000 7f0da7fff640 1 -- 172.21.15.78:0/1854263467 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256166167 0 0) 0x7f0db01531d0 con 0x7f0db014ed10 2023-10-14T09:17:53.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0db5976640 1 --2- 172.21.15.78:0/1854263467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db0150a90 0x7f0db0150e70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0db00c16f0 tx=0x7f0da801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b151e2e22c2ff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:53.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0da7fff640 1 -- 172.21.15.78:0/1854263467 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da80a5810 con 0x7f0db0150a90 2023-10-14T09:17:53.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0da7fff640 1 -- 172.21.15.78:0/1854263467 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da80a5970 con 0x7f0db0150a90 2023-10-14T09:17:53.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0da7fff640 1 -- 172.21.15.78:0/1854263467 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da80a5d00 con 0x7f0db0150a90 2023-10-14T09:17:53.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0db73d9640 1 -- 172.21.15.78:0/1854263467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db0150a90 msgr2=0x7f0db0150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0db73d9640 1 --2- 172.21.15.78:0/1854263467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db0150a90 0x7f0db0150e70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0db00c16f0 tx=0x7f0da801c880 comp rx=0 tx=0).stop 2023-10-14T09:17:53.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0db73d9640 1 -- 172.21.15.78:0/1854263467 shutdown_connections 2023-10-14T09:17:53.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0db73d9640 1 --2- 172.21.15.78:0/1854263467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db0150a90 0x7f0db0150e70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0db73d9640 1 --2- 172.21.15.78:0/1854263467 >> v2:172.21.15.157:3300/0 conn(0x7f0db014e0f0 0x7f0db0152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0db73d9640 1 -- 172.21.15.78:0/1854263467 >> 172.21.15.78:0/1854263467 conn(0x7f0db00c1cc0 msgr2=0x7f0db00c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:53.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0db73d9640 1 -- 172.21.15.78:0/1854263467 shutdown_connections 2023-10-14T09:17:53.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.916+0000 7f0db73d9640 1 -- 172.21.15.78:0/1854263467 wait complete. 2023-10-14T09:17:53.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db73d9640 1 Processor -- start 2023-10-14T09:17:53.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db73d9640 1 -- start start 2023-10-14T09:17:53.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db73d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0db014e0f0 0x7f0db01f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db73d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db014ed10 0x7f0db014c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db73d9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db0150a90 0x7f0db0146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db73d9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0147c50 con 0x7f0db014ed10 2023-10-14T09:17:53.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db73d9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0149260 con 0x7f0db0150a90 2023-10-14T09:17:53.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db73d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db006dd30 con 0x7f0db014e0f0 2023-10-14T09:17:53.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db4974640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db014ed10 0x7f0db014c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db4974640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db014ed10 0x7f0db014c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51568/0 (socket says 172.21.15.78:51568) 2023-10-14T09:17:53.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db4974640 1 -- 172.21.15.78:0/4092682330 learned_addr learned my addr 172.21.15.78:0/4092682330 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:53.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db5976640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db0150a90 0x7f0db0146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db5175640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0db014e0f0 0x7f0db01f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db4974640 1 -- 172.21.15.78:0/4092682330 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0db014e0f0 msgr2=0x7f0db01f0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db4974640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0db014e0f0 0x7f0db01f0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db4974640 1 -- 172.21.15.78:0/4092682330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db0150a90 msgr2=0x7f0db0146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:53.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db4974640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db0150a90 0x7f0db0146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:53.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db4974640 1 -- 172.21.15.78:0/4092682330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da8009a70 con 0x7f0db014ed10 2023-10-14T09:17:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db5976640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db0150a90 0x7f0db0146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db4974640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db014ed10 0x7f0db014c330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0da000c480 tx=0x7f0da000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0da5ffb640 1 -- 172.21.15.78:0/4092682330 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da00074e0 con 0x7f0db014ed10 2023-10-14T09:17:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0da5ffb640 1 -- 172.21.15.78:0/4092682330 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da0007660 con 0x7f0db014ed10 2023-10-14T09:17:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0da5ffb640 1 -- 172.21.15.78:0/4092682330 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0004a30 con 0x7f0db014ed10 2023-10-14T09:17:53.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db73d9640 1 -- 172.21.15.78:0/4092682330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db01f0640 con 0x7f0db014ed10 2023-10-14T09:17:53.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.920+0000 7f0db73d9640 1 -- 172.21.15.78:0/4092682330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db006d770 con 0x7f0db014ed10 2023-10-14T09:17:53.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.924+0000 7f0db73d9640 1 -- 172.21.15.78:0/4092682330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db0074180 con 0x7f0db014ed10 2023-10-14T09:17:53.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.924+0000 7f0da5ffb640 1 -- 172.21.15.78:0/4092682330 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0da0004b90 con 0x7f0db014ed10 2023-10-14T09:17:53.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.924+0000 7f0da5ffb640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d940664a0 0x7f0d94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:53.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.924+0000 7f0da5ffb640 1 -- 172.21.15.78:0/4092682330 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0da0082f80 con 0x7f0db014ed10 2023-10-14T09:17:53.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.924+0000 7f0db5175640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d940664a0 0x7f0d94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:53.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.924+0000 7f0db5175640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d940664a0 0x7f0d94068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00ba10 tx=0x7f0dac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:53.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:53.928+0000 7f0da5ffb640 1 -- 172.21.15.78:0/4092682330 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0da00b4090 con 0x7f0db014ed10 2023-10-14T09:17:54.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.132+0000 7f0db73d9640 1 -- 172.21.15.78:0/4092682330 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]} v 0) v1 -- 0x7f0db00c0230 con 0x7f0db014ed10 2023-10-14T09:17:54.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0da5ffb640 1 -- 172.21.15.78:0/4092682330 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]}]=0 v50) v1 ==== 146+0+0 (secure 0 0 0) 0x7f0da0053c90 con 0x7f0db014ed10 2023-10-14T09:17:54.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 -- 172.21.15.78:0/4092682330 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d940664a0 msgr2=0x7f0d94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d940664a0 0x7f0d94068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00ba10 tx=0x7f0dac008040 comp rx=0 tx=0).stop 2023-10-14T09:17:54.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 -- 172.21.15.78:0/4092682330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db014ed10 msgr2=0x7f0db014c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db014ed10 0x7f0db014c330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0da000c480 tx=0x7f0da000c940 comp rx=0 tx=0).stop 2023-10-14T09:17:54.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 -- 172.21.15.78:0/4092682330 shutdown_connections 2023-10-14T09:17:54.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0db0150a90 0x7f0db0146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db014ed10 0x7f0db014c330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0d940664a0 0x7f0d94068960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 --2- 172.21.15.78:0/4092682330 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0db014e0f0 0x7f0db01f0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 -- 172.21.15.78:0/4092682330 >> 172.21.15.78:0/4092682330 conn(0x7f0db00c1cc0 msgr2=0x7f0db00c1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 -- 172.21.15.78:0/4092682330 shutdown_connections 2023-10-14T09:17:54.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.144+0000 7f0db73d9640 1 -- 172.21.15.78:0/4092682330 wait complete. 2023-10-14T09:17:54.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T09:17:54.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.304+0000 7f09b0ff8640 1 Processor -- start 2023-10-14T09:17:54.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.304+0000 7f09b0ff8640 1 -- start start 2023-10-14T09:17:54.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09b0ff8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac1513a0 0x7f09ac0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:54.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09b0ff8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ac070560 con 0x7f09ac153e90 2023-10-14T09:17:54.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09b0ff8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ac151780 con 0x7f09ac0c1e20 2023-10-14T09:17:54.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09b0ff8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac157dc0 con 0x7f09ac1513a0 2023-10-14T09:17:54.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09aad9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f09ac153e90 0x7f09ac1542c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36124/0 (socket says 172.21.15.78:36124) 2023-10-14T09:17:54.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09aad9d640 1 -- 172.21.15.78:0/3625233979 learned_addr learned my addr 172.21.15.78:0/3625233979 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:54.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09aa59c640 1 --2- 172.21.15.78:0/3625233979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac1513a0 0x7f09ac0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:54.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09a9d9b640 1 -- 172.21.15.78:0/3625233979 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422134095 0 0) 0x7f09ac070560 con 0x7f09ac153e90 2023-10-14T09:17:54.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09a9d9b640 1 -- 172.21.15.78:0/3625233979 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0998003530 con 0x7f09ac153e90 2023-10-14T09:17:54.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09a9d9b640 1 -- 172.21.15.78:0/3625233979 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025015650 0 0) 0x7f09ac151780 con 0x7f09ac0c1e20 2023-10-14T09:17:54.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09a9d9b640 1 -- 172.21.15.78:0/3625233979 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09ac070560 con 0x7f09ac0c1e20 2023-10-14T09:17:54.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09aa59c640 1 -- 172.21.15.78:0/3625233979 >> v1:172.21.15.157:6789/0 conn(0x7f09ac0c1e20 legacy=0x7f09ac0c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09aa59c640 1 -- 172.21.15.78:0/3625233979 >> v1:172.21.15.78:6789/0 conn(0x7f09ac153e90 legacy=0x7f09ac1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.308+0000 7f09aa59c640 1 -- 172.21.15.78:0/3625233979 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac158060 con 0x7f09ac1513a0 2023-10-14T09:17:54.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09aa59c640 1 --2- 172.21.15.78:0/3625233979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac1513a0 0x7f09ac0c3650 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f099c0097f0 tx=0x7f099c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6abf33bb32bf5acb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:54.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09a9d9b640 1 -- 172.21.15.78:0/3625233979 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c0ab600 con 0x7f09ac1513a0 2023-10-14T09:17:54.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09a9d9b640 1 -- 172.21.15.78:0/3625233979 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c0a7050 con 0x7f09ac1513a0 2023-10-14T09:17:54.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09a9d9b640 1 -- 172.21.15.78:0/3625233979 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c0ab980 con 0x7f09ac1513a0 2023-10-14T09:17:54.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3625233979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac1513a0 msgr2=0x7f09ac0c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09b0ff8640 1 --2- 172.21.15.78:0/3625233979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac1513a0 0x7f09ac0c3650 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f099c0097f0 tx=0x7f099c01c400 comp rx=0 tx=0).stop 2023-10-14T09:17:54.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3625233979 shutdown_connections 2023-10-14T09:17:54.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09b0ff8640 1 --2- 172.21.15.78:0/3625233979 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac1513a0 0x7f09ac0c3650 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3625233979 >> 172.21.15.78:0/3625233979 conn(0x7f09ac06a2c0 msgr2=0x7f09ac06a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:54.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3625233979 shutdown_connections 2023-10-14T09:17:54.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3625233979 wait complete. 2023-10-14T09:17:54.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09b0ff8640 1 Processor -- start 2023-10-14T09:17:54.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.312+0000 7f09b0ff8640 1 -- start start 2023-10-14T09:17:54.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09b0ff8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09ac0c1e20 0x7f09ac0a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:54.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09b0ff8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09ac1513a0 0x7f09ac0a2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:54.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09b0ff8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac153e90 0x7f09ac06b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:54.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09b0ff8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac0a2a80 con 0x7f09ac0c1e20 2023-10-14T09:17:54.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09b0ff8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac14e580 con 0x7f09ac1513a0 2023-10-14T09:17:54.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09b0ff8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac14df30 con 0x7f09ac153e90 2023-10-14T09:17:54.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09aa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09ac0c1e20 0x7f09ac0a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:54.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09aa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09ac0c1e20 0x7f09ac0a2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51582/0 (socket says 172.21.15.78:51582) 2023-10-14T09:17:54.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09aa59c640 1 -- 172.21.15.78:0/3580743139 learned_addr learned my addr 172.21.15.78:0/3580743139 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:54.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09a3fff640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09ac1513a0 0x7f09ac0a2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:54.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09aad9d640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac153e90 0x7f09ac06b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:54.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09aa59c640 1 -- 172.21.15.78:0/3580743139 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac153e90 msgr2=0x7f09ac06b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09aa59c640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac153e90 0x7f09ac06b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09aa59c640 1 -- 172.21.15.78:0/3580743139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09ac1513a0 msgr2=0x7f09ac0a2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09aa59c640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09ac1513a0 0x7f09ac0a2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09aa59c640 1 -- 172.21.15.78:0/3580743139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c009420 con 0x7f09ac0c1e20 2023-10-14T09:17:54.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09aad9d640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac153e90 0x7f09ac06b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:54.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09aa59c640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09ac0c1e20 0x7f09ac0a2000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f099c0ae040 tx=0x7f099c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09a2ffd640 1 -- 172.21.15.78:0/3580743139 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c0abe50 con 0x7f09ac0c1e20 2023-10-14T09:17:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09a2ffd640 1 -- 172.21.15.78:0/3580743139 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c004020 con 0x7f09ac0c1e20 2023-10-14T09:17:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3580743139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ac156150 con 0x7f09ac0c1e20 2023-10-14T09:17:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09a2ffd640 1 -- 172.21.15.78:0/3580743139 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c0043d0 con 0x7f09ac0c1e20 2023-10-14T09:17:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3580743139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ac156710 con 0x7f09ac0c1e20 2023-10-14T09:17:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3580743139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ac06afa0 con 0x7f09ac0c1e20 2023-10-14T09:17:54.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.316+0000 7f09a2ffd640 1 -- 172.21.15.78:0/3580743139 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f099c0b2040 con 0x7f09ac0c1e20 2023-10-14T09:17:54.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.320+0000 7f09a2ffd640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f098c0664a0 0x7f098c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:54.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.320+0000 7f09a2ffd640 1 -- 172.21.15.78:0/3580743139 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f099c11dcd0 con 0x7f09ac0c1e20 2023-10-14T09:17:54.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.320+0000 7f09a3fff640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f098c0664a0 0x7f098c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:54.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.320+0000 7f09a3fff640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f098c0664a0 0x7f098c068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f09ac14feb0 tx=0x7f0994009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.324+0000 7f09a2ffd640 1 -- 172.21.15.78:0/3580743139 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f09ac06afa0 con 0x7f09ac0c1e20 2023-10-14T09:17:54.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.472+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3580743139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f09ac06afa0 con 0x7f09ac0c1e20 2023-10-14T09:17:54.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.476+0000 7f09a2ffd640 1 -- 172.21.15.78:0/3580743139 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f09ac06afa0 con 0x7f09ac0c1e20 2023-10-14T09:17:54.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3580743139 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f098c0664a0 msgr2=0x7f098c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f098c0664a0 0x7f098c068960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f09ac14feb0 tx=0x7f0994009040 comp rx=0 tx=0).stop 2023-10-14T09:17:54.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3580743139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09ac0c1e20 msgr2=0x7f09ac0a2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09ac0c1e20 0x7f09ac0a2000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f099c0ae040 tx=0x7f099c0191a0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3580743139 shutdown_connections 2023-10-14T09:17:54.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f098c0664a0 0x7f098c068960 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09ac153e90 0x7f09ac06b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09ac1513a0 0x7f09ac0a2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 --2- 172.21.15.78:0/3580743139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09ac0c1e20 0x7f09ac0a2000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3580743139 >> 172.21.15.78:0/3580743139 conn(0x7f09ac06a2c0 msgr2=0x7f09ac14f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:54.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3580743139 shutdown_connections 2023-10-14T09:17:54.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.480+0000 7f09b0ff8640 1 -- 172.21.15.78:0/3580743139 wait complete. 2023-10-14T09:17:54.501 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T09:17:54.502 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T09:17:54.623 DEBUG:teuthology.orchestra.run.smithi157:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T09:17:54.705 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T09:17:54.705 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:17:54.706 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:17:54.715 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:17:54.715 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:17:54.769 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:54.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde5cf9d640 1 Processor -- start 2023-10-14T09:17:54.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde5cf9d640 1 -- start start 2023-10-14T09:17:54.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde5cf9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde58153e80 0x7fde580c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:54.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde5cf9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde580c6910 0x7fde580c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:54.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde5cf9d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5806c470 con 0x7fde5814ddb0 2023-10-14T09:17:54.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde5cf9d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580c64f0 con 0x7fde580c6910 2023-10-14T09:17:54.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde5cf9d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c5300 con 0x7fde58153e80 2023-10-14T09:17:54.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde56d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde580c6910 0x7fde580c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:54.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde56d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde580c6910 0x7fde580c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51592/0 (socket says 172.21.15.78:51592) 2023-10-14T09:17:54.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde56d9d640 1 -- 172.21.15.78:0/1711302690 learned_addr learned my addr 172.21.15.78:0/1711302690 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:54.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde4dd9b640 1 --2- 172.21.15.78:0/1711302690 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde58153e80 0x7fde580c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:54.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde56d9d640 1 -- 172.21.15.78:0/1711302690 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde58153e80 msgr2=0x7fde580c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:54.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde56d9d640 1 --2- 172.21.15.78:0/1711302690 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde58153e80 0x7fde580c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde56d9d640 1 -- 172.21.15.78:0/1711302690 >> v1:172.21.15.157:6789/0 conn(0x7fde5814ddb0 legacy=0x7fde5806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.952+0000 7fde56d9d640 1 -- 172.21.15.78:0/1711302690 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5806c750 con 0x7fde580c6910 2023-10-14T09:17:54.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde56d9d640 1 --2- 172.21.15.78:0/1711302690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde580c6910 0x7fde580c3fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fde50009870 tx=0x7fde5001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f849b52b7d0771e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:54.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde55d9b640 1 -- 172.21.15.78:0/1711302690 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500ac640 con 0x7fde580c6910 2023-10-14T09:17:54.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde55d9b640 1 -- 172.21.15.78:0/1711302690 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde500ac7a0 con 0x7fde580c6910 2023-10-14T09:17:54.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde55d9b640 1 -- 172.21.15.78:0/1711302690 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500acb30 con 0x7fde580c6910 2023-10-14T09:17:54.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1711302690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde580c6910 msgr2=0x7fde580c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde5cf9d640 1 --2- 172.21.15.78:0/1711302690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde580c6910 0x7fde580c3fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fde50009870 tx=0x7fde5001c420 comp rx=0 tx=0).stop 2023-10-14T09:17:54.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1711302690 shutdown_connections 2023-10-14T09:17:54.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde5cf9d640 1 --2- 172.21.15.78:0/1711302690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde580c6910 0x7fde580c3fe0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde5cf9d640 1 --2- 172.21.15.78:0/1711302690 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde58153e80 0x7fde580c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1711302690 >> 172.21.15.78:0/1711302690 conn(0x7fde580ab1f0 msgr2=0x7fde580ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:54.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1711302690 shutdown_connections 2023-10-14T09:17:54.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.956+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1711302690 wait complete. 2023-10-14T09:17:54.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde5cf9d640 1 Processor -- start 2023-10-14T09:17:54.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde5cf9d640 1 -- start start 2023-10-14T09:17:54.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde5cf9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde580c6910 0x7fde58151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:54.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde5cf9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde5814ddb0 0x7fde580bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:54.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde5cf9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde58153e80 0x7fde580aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:54.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde5cf9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5814b800 con 0x7fde5814ddb0 2023-10-14T09:17:54.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde5cf9d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581efc00 con 0x7fde58153e80 2023-10-14T09:17:54.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde5cf9d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580bedc0 con 0x7fde580c6910 2023-10-14T09:17:54.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde5814ddb0 0x7fde580bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:54.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde5814ddb0 0x7fde580bfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51606/0 (socket says 172.21.15.78:51606) 2023-10-14T09:17:54.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4dd9b640 1 -- 172.21.15.78:0/1228786891 learned_addr learned my addr 172.21.15.78:0/1228786891 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:54.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde5659c640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde580c6910 0x7fde58151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:54.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde56d9d640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde58153e80 0x7fde580aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:54.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4dd9b640 1 -- 172.21.15.78:0/1228786891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde580c6910 msgr2=0x7fde58151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4dd9b640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde580c6910 0x7fde58151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4dd9b640 1 -- 172.21.15.78:0/1228786891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde58153e80 msgr2=0x7fde580aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:54.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4dd9b640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde58153e80 0x7fde580aa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:54.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4dd9b640 1 -- 172.21.15.78:0/1228786891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500094d0 con 0x7fde5814ddb0 2023-10-14T09:17:54.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4dd9b640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde5814ddb0 0x7fde580bfb70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde40007e70 tx=0x7fde4000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:54.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4f7fe640 1 -- 172.21.15.78:0/1228786891 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40014620 con 0x7fde5814ddb0 2023-10-14T09:17:54.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4f7fe640 1 -- 172.21.15.78:0/1228786891 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4000ee90 con 0x7fde5814ddb0 2023-10-14T09:17:54.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1228786891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde580bf010 con 0x7fde5814ddb0 2023-10-14T09:17:54.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde4f7fe640 1 -- 172.21.15.78:0/1228786891 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400149c0 con 0x7fde5814ddb0 2023-10-14T09:17:54.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.960+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1228786891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580bf5d0 con 0x7fde5814ddb0 2023-10-14T09:17:54.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.964+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1228786891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde581efd70 con 0x7fde5814ddb0 2023-10-14T09:17:54.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.964+0000 7fde4f7fe640 1 -- 172.21.15.78:0/1228786891 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fde40014b20 con 0x7fde5814ddb0 2023-10-14T09:17:54.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.964+0000 7fde4f7fe640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fde380664a0 0x7fde38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:54.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.964+0000 7fde4f7fe640 1 -- 172.21.15.78:0/1228786891 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde40084790 con 0x7fde5814ddb0 2023-10-14T09:17:54.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.964+0000 7fde5659c640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fde380664a0 0x7fde38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:54.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.964+0000 7fde5659c640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fde380664a0 0x7fde38068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fde48007fd0 tx=0x7fde48009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:54.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:54.968+0000 7fde4f7fe640 1 -- 172.21.15.78:0/1228786891 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fde581efd70 con 0x7fde5814ddb0 2023-10-14T09:17:55.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.120+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1228786891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde581efd70 con 0x7fde5814ddb0 2023-10-14T09:17:55.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.120+0000 7fde4f7fe640 1 -- 172.21.15.78:0/1228786891 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fde581efd70 con 0x7fde5814ddb0 2023-10-14T09:17:55.124 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:55.125 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:55.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1228786891 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fde380664a0 msgr2=0x7fde38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fde380664a0 0x7fde38068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fde48007fd0 tx=0x7fde48009040 comp rx=0 tx=0).stop 2023-10-14T09:17:55.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1228786891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde5814ddb0 msgr2=0x7fde580bfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde5814ddb0 0x7fde580bfb70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde40007e70 tx=0x7fde4000e4b0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1228786891 shutdown_connections 2023-10-14T09:17:55.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde58153e80 0x7fde580aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde5814ddb0 0x7fde580bfb70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fde380664a0 0x7fde38068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 --2- 172.21.15.78:0/1228786891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fde580c6910 0x7fde58151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1228786891 >> 172.21.15.78:0/1228786891 conn(0x7fde580ab1f0 msgr2=0x7fde5814d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:55.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1228786891 shutdown_connections 2023-10-14T09:17:55.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.124+0000 7fde5cf9d640 1 -- 172.21.15.78:0/1228786891 wait complete. 2023-10-14T09:17:55.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:55.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:55.204 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:17:55.208 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:17:55.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2ab1491640 1 Processor -- start 2023-10-14T09:17:55.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2ab1491640 1 -- start start 2023-10-14T09:17:55.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2ab1491640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2aac0c75b0 0x7f2aac1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2ab1491640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac157360 con 0x7f2aac0c4030 2023-10-14T09:17:55.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2ab1491640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac157ee0 con 0x7f2aac06cc50 2023-10-14T09:17:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2ab1491640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac0c5300 con 0x7f2aac0c75b0 2023-10-14T09:17:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2aaaffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2aac0c4030 0x7f2aac0c4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36128/0 (socket says 172.21.15.78:36128) 2023-10-14T09:17:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2aaaffd640 1 -- 172.21.15.78:0/3409084742 learned_addr learned my addr 172.21.15.78:0/3409084742 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2aab7fe640 1 --2- 172.21.15.78:0/3409084742 >> v2:172.21.15.78:3300/0 conn(0x7f2aac0c75b0 0x7f2aac1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2aaa7fc640 1 -- 172.21.15.78:0/3409084742 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429553310 0 0) 0x7f2aac157360 con 0x7f2aac0c4030 2023-10-14T09:17:55.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2aaa7fc640 1 -- 172.21.15.78:0/3409084742 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a98003530 con 0x7f2aac0c4030 2023-10-14T09:17:55.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2aab7fe640 1 -- 172.21.15.78:0/3409084742 >> v1:172.21.15.157:6789/0 conn(0x7f2aac06cc50 legacy=0x7f2aac153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2aab7fe640 1 -- 172.21.15.78:0/3409084742 >> v1:172.21.15.78:6789/0 conn(0x7f2aac0c4030 legacy=0x7f2aac0c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.288+0000 7f2aab7fe640 1 -- 172.21.15.78:0/3409084742 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac1549e0 con 0x7f2aac0c75b0 2023-10-14T09:17:55.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.292+0000 7f2aab7fe640 1 --2- 172.21.15.78:0/3409084742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2aac0c75b0 0x7f2aac1544a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d7a33b12dd0b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:55.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.292+0000 7f2aaa7fc640 1 -- 172.21.15.78:0/3409084742 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40ab5f0 con 0x7f2aac0c75b0 2023-10-14T09:17:55.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.292+0000 7f2aaa7fc640 1 -- 172.21.15.78:0/3409084742 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa40ab750 con 0x7f2aac0c75b0 2023-10-14T09:17:55.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.292+0000 7f2aaa7fc640 1 -- 172.21.15.78:0/3409084742 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40abae0 con 0x7f2aac0c75b0 2023-10-14T09:17:55.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.292+0000 7f2ab1491640 1 -- 172.21.15.78:0/3409084742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2aac0c75b0 msgr2=0x7f2aac1544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.292+0000 7f2ab1491640 1 --2- 172.21.15.78:0/3409084742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2aac0c75b0 0x7f2aac1544a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401c3f0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.292+0000 7f2ab1491640 1 -- 172.21.15.78:0/3409084742 shutdown_connections 2023-10-14T09:17:55.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.292+0000 7f2ab1491640 1 --2- 172.21.15.78:0/3409084742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2aac0c75b0 0x7f2aac1544a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.292+0000 7f2ab1491640 1 -- 172.21.15.78:0/3409084742 >> 172.21.15.78:0/3409084742 conn(0x7f2aac0ab240 msgr2=0x7f2aac0ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:55.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.292+0000 7f2ab1491640 1 -- 172.21.15.78:0/3409084742 shutdown_connections 2023-10-14T09:17:55.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.292+0000 7f2ab1491640 1 -- 172.21.15.78:0/3409084742 wait complete. 2023-10-14T09:17:55.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2ab1491640 1 Processor -- start 2023-10-14T09:17:55.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2ab1491640 1 -- start start 2023-10-14T09:17:55.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2ab1491640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2aac06cc50 0x7f2aac150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2ab1491640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2aac0c4030 0x7f2aac0bd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2ab1491640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2aac0c75b0 0x7f2aac1ebd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2ab1491640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac151110 con 0x7f2aac0c75b0 2023-10-14T09:17:55.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2ab1491640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac1f0250 con 0x7f2aac06cc50 2023-10-14T09:17:55.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2ab1491640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0c1bd0 con 0x7f2aac0c4030 2023-10-14T09:17:55.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2aac0c75b0 0x7f2aac1ebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2aac0c75b0 0x7f2aac1ebd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51628/0 (socket says 172.21.15.78:51628) 2023-10-14T09:17:55.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aab7fe640 1 -- 172.21.15.78:0/768522291 learned_addr learned my addr 172.21.15.78:0/768522291 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:55.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aaaffd640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2aac06cc50 0x7f2aac150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aa27fc640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2aac0c4030 0x7f2aac0bd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aab7fe640 1 -- 172.21.15.78:0/768522291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2aac0c4030 msgr2=0x7f2aac0bd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aab7fe640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2aac0c4030 0x7f2aac0bd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aab7fe640 1 -- 172.21.15.78:0/768522291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2aac06cc50 msgr2=0x7f2aac150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aab7fe640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2aac06cc50 0x7f2aac150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aab7fe640 1 -- 172.21.15.78:0/768522291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa4009420 con 0x7f2aac0c75b0 2023-10-14T09:17:55.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aa27fc640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2aac0c4030 0x7f2aac0bd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:55.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aab7fe640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2aac0c75b0 0x7f2aac1ebd80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:55.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aa3fff640 1 -- 172.21.15.78:0/768522291 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40bf610 con 0x7f2aac0c75b0 2023-10-14T09:17:55.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aa3fff640 1 -- 172.21.15.78:0/768522291 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa40bf770 con 0x7f2aac0c75b0 2023-10-14T09:17:55.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2aa3fff640 1 -- 172.21.15.78:0/768522291 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40bfb00 con 0x7f2aac0c75b0 2023-10-14T09:17:55.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2ab1491640 1 -- 172.21.15.78:0/768522291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac1ef490 con 0x7f2aac0c75b0 2023-10-14T09:17:55.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2ab1491640 1 -- 172.21.15.78:0/768522291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac1efa50 con 0x7f2aac0c75b0 2023-10-14T09:17:55.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.296+0000 7f2ab1491640 1 -- 172.21.15.78:0/768522291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac074110 con 0x7f2aac0c75b0 2023-10-14T09:17:55.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.300+0000 7f2aa3fff640 1 -- 172.21.15.78:0/768522291 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2aa40b5400 con 0x7f2aac0c75b0 2023-10-14T09:17:55.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.300+0000 7f2aa3fff640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2a8c0664a0 0x7f2a8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.300+0000 7f2aa3fff640 1 -- 172.21.15.78:0/768522291 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2aa40a8050 con 0x7f2aac0c75b0 2023-10-14T09:17:55.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.300+0000 7f2aaaffd640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2a8c0664a0 0x7f2a8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.300+0000 7f2aaaffd640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2a8c0664a0 0x7f2a8c068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0011f0 tx=0x7f2a9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:55.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.304+0000 7f2aa3fff640 1 -- 172.21.15.78:0/768522291 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2aa40ec090 con 0x7f2aac0c75b0 2023-10-14T09:17:55.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 -- 172.21.15.78:0/768522291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2aac0c1820 con 0x7f2aac0c75b0 2023-10-14T09:17:55.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2aa3fff640 1 -- 172.21.15.78:0/768522291 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2aa40c40a0 con 0x7f2aac0c75b0 2023-10-14T09:17:55.459 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:55.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 -- 172.21.15.78:0/768522291 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2a8c0664a0 msgr2=0x7f2a8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2a8c0664a0 0x7f2a8c068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0011f0 tx=0x7f2a9c009040 comp rx=0 tx=0).stop 2023-10-14T09:17:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 -- 172.21.15.78:0/768522291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2aac0c75b0 msgr2=0x7f2aac1ebd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2aac0c75b0 0x7f2aac1ebd80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40097c0 tx=0x7f2aa401ac30 comp rx=0 tx=0).stop 2023-10-14T09:17:55.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 -- 172.21.15.78:0/768522291 shutdown_connections 2023-10-14T09:17:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2aac0c75b0 0x7f2aac1ebd80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2a8c0664a0 0x7f2a8c068960 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2aac0c4030 0x7f2aac0bd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 --2- 172.21.15.78:0/768522291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2aac06cc50 0x7f2aac150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 -- 172.21.15.78:0/768522291 >> 172.21.15.78:0/768522291 conn(0x7f2aac0ab240 msgr2=0x7f2aac0c4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:55.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 -- 172.21.15.78:0/768522291 shutdown_connections 2023-10-14T09:17:55.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.456+0000 7f2ab1491640 1 -- 172.21.15.78:0/768522291 wait complete. 2023-10-14T09:17:55.479 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:17:55.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.656+0000 7ff42e53e640 1 Processor -- start 2023-10-14T09:17:55.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.656+0000 7ff42e53e640 1 -- start start 2023-10-14T09:17:55.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42e53e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4280700d0 0x7ff4280c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42e53e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff4280c1e20 0x7ff4280c4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42e53e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff428157d50 con 0x7ff428151310 2023-10-14T09:17:55.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42e53e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4280c3b80 con 0x7ff4280c1e20 2023-10-14T09:17:55.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42e53e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff428158280 con 0x7ff4280700d0 2023-10-14T09:17:55.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42cadb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff4280c1e20 0x7ff4280c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42cadb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff4280c1e20 0x7ff4280c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51640/0 (socket says 172.21.15.78:51640) 2023-10-14T09:17:55.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42cadb640 1 -- 172.21.15.78:0/1413961144 learned_addr learned my addr 172.21.15.78:0/1413961144 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:55.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff4277fe640 1 --2- 172.21.15.78:0/1413961144 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4280700d0 0x7ff4280c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42cadb640 1 -- 172.21.15.78:0/1413961144 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4280700d0 msgr2=0x7ff4280c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42cadb640 1 --2- 172.21.15.78:0/1413961144 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4280700d0 0x7ff4280c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42cadb640 1 -- 172.21.15.78:0/1413961144 >> v1:172.21.15.157:6789/0 conn(0x7ff428151310 legacy=0x7ff4280c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.660+0000 7ff42cadb640 1 -- 172.21.15.78:0/1413961144 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff428157fa0 con 0x7ff4280c1e20 2023-10-14T09:17:55.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff42cadb640 1 --2- 172.21.15.78:0/1413961144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4280c1e20 0x7ff4280c4550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff420009e50 tx=0x7ff42001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84730785261b8ed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:55.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff426ffd640 1 -- 172.21.15.78:0/1413961144 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4200a5770 con 0x7ff4280c1e20 2023-10-14T09:17:55.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff426ffd640 1 -- 172.21.15.78:0/1413961144 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4200a58d0 con 0x7ff4280c1e20 2023-10-14T09:17:55.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff426ffd640 1 -- 172.21.15.78:0/1413961144 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4200a5c60 con 0x7ff4280c1e20 2023-10-14T09:17:55.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff42e53e640 1 -- 172.21.15.78:0/1413961144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4280c1e20 msgr2=0x7ff4280c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff42e53e640 1 --2- 172.21.15.78:0/1413961144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4280c1e20 0x7ff4280c4550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff420009e50 tx=0x7ff42001c980 comp rx=0 tx=0).stop 2023-10-14T09:17:55.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff42e53e640 1 -- 172.21.15.78:0/1413961144 shutdown_connections 2023-10-14T09:17:55.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff42e53e640 1 --2- 172.21.15.78:0/1413961144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4280c1e20 0x7ff4280c4550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff42e53e640 1 --2- 172.21.15.78:0/1413961144 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4280700d0 0x7ff4280c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff42e53e640 1 -- 172.21.15.78:0/1413961144 >> 172.21.15.78:0/1413961144 conn(0x7ff42806a2c0 msgr2=0x7ff42806a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:55.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff42e53e640 1 -- 172.21.15.78:0/1413961144 shutdown_connections 2023-10-14T09:17:55.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff42e53e640 1 -- 172.21.15.78:0/1413961144 wait complete. 2023-10-14T09:17:55.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff42e53e640 1 Processor -- start 2023-10-14T09:17:55.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.664+0000 7ff42e53e640 1 -- start start 2023-10-14T09:17:55.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff42e53e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4280c1e20 0x7ff4280c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff42e53e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff428151310 0x7ff4280abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff42e53e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4280ac450 0x7ff4280aa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff42e53e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280aba80 con 0x7ff428151310 2023-10-14T09:17:55.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff42e53e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280bbea0 con 0x7ff4280ac450 2023-10-14T09:17:55.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff42e53e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280c1790 con 0x7ff4280c1e20 2023-10-14T09:17:55.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff4277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff428151310 0x7ff4280abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff4277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff428151310 0x7ff4280abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51646/0 (socket says 172.21.15.78:51646) 2023-10-14T09:17:55.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff4277fe640 1 -- 172.21.15.78:0/584474459 learned_addr learned my addr 172.21.15.78:0/584474459 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:55.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff427fff640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4280c1e20 0x7ff4280c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff42cadb640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4280ac450 0x7ff4280aa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff4277fe640 1 -- 172.21.15.78:0/584474459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4280c1e20 msgr2=0x7ff4280c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff4277fe640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4280c1e20 0x7ff4280c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff4277fe640 1 -- 172.21.15.78:0/584474459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4280ac450 msgr2=0x7ff4280aa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff4277fe640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4280ac450 0x7ff4280aa0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff4277fe640 1 -- 172.21.15.78:0/584474459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420009b30 con 0x7ff428151310 2023-10-14T09:17:55.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff4277fe640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff428151310 0x7ff4280abf10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff41c00d620 tx=0x7ff41c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:55.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff424ff9640 1 -- 172.21.15.78:0/584474459 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c00b620 con 0x7ff428151310 2023-10-14T09:17:55.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff424ff9640 1 -- 172.21.15.78:0/584474459 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c00b780 con 0x7ff428151310 2023-10-14T09:17:55.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff424ff9640 1 -- 172.21.15.78:0/584474459 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c00bb10 con 0x7ff428151310 2023-10-14T09:17:55.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff42e53e640 1 -- 172.21.15.78:0/584474459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4280bc110 con 0x7ff428151310 2023-10-14T09:17:55.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff42e53e640 1 -- 172.21.15.78:0/584474459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4280bc6d0 con 0x7ff428151310 2023-10-14T09:17:55.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff42e53e640 1 -- 172.21.15.78:0/584474459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff428074110 con 0x7ff428151310 2023-10-14T09:17:55.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.668+0000 7ff424ff9640 1 -- 172.21.15.78:0/584474459 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff41c00bc70 con 0x7ff428151310 2023-10-14T09:17:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.672+0000 7ff424ff9640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff4140664a0 0x7ff414068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.672+0000 7ff424ff9640 1 -- 172.21.15.78:0/584474459 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff41c0841d0 con 0x7ff428151310 2023-10-14T09:17:55.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.672+0000 7ff427fff640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff4140664a0 0x7ff414068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.672+0000 7ff427fff640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff4140664a0 0x7ff414068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff4280c4550 tx=0x7ff418009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:55.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.676+0000 7ff424ff9640 1 -- 172.21.15.78:0/584474459 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff41c0516f0 con 0x7ff428151310 2023-10-14T09:17:55.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.820+0000 7ff42e53e640 1 -- 172.21.15.78:0/584474459 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4280ad420 con 0x7ff428151310 2023-10-14T09:17:55.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.820+0000 7ff424ff9640 1 -- 172.21.15.78:0/584474459 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff41c007380 con 0x7ff428151310 2023-10-14T09:17:55.825 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:17:55.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 -- 172.21.15.78:0/584474459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff4140664a0 msgr2=0x7ff414068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff4140664a0 0x7ff414068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff4280c4550 tx=0x7ff418009040 comp rx=0 tx=0).stop 2023-10-14T09:17:55.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 -- 172.21.15.78:0/584474459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff428151310 msgr2=0x7ff4280abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff428151310 0x7ff4280abf10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff41c00d620 tx=0x7ff41c00dae0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 -- 172.21.15.78:0/584474459 shutdown_connections 2023-10-14T09:17:55.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4280ac450 0x7ff4280aa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff428151310 0x7ff4280abf10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff4140664a0 0x7ff414068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 --2- 172.21.15.78:0/584474459 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff4280c1e20 0x7ff4280c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 -- 172.21.15.78:0/584474459 >> 172.21.15.78:0/584474459 conn(0x7ff42806a2c0 msgr2=0x7ff428157640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:55.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 -- 172.21.15.78:0/584474459 shutdown_connections 2023-10-14T09:17:55.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.824+0000 7ff42e53e640 1 -- 172.21.15.78:0/584474459 wait complete. 2023-10-14T09:17:55.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:17:55.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f365cc6b640 1 Processor -- start 2023-10-14T09:17:55.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f365cc6b640 1 -- start start 2023-10-14T09:17:55.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f365cc6b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f365806cc50 0x7f36580c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f365cc6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3658153d90 0x7f36581541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f365cc6b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36580c7af0 con 0x7f36580c4030 2023-10-14T09:17:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f365cc6b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36580c5300 con 0x7f365806cc50 2023-10-14T09:17:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f365cc6b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3658157360 con 0x7f3658153d90 2023-10-14T09:17:55.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f365659c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f36580c4030 0x7f36580c4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36144/0 (socket says 172.21.15.78:36144) 2023-10-14T09:17:55.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f365659c640 1 -- 172.21.15.78:0/782189981 learned_addr learned my addr 172.21.15.78:0/782189981 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:55.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3656d9d640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3658153d90 0x7f36581541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f364dd9b640 1 --2- 172.21.15.78:0/782189981 >> v2:172.21.15.157:3300/0 conn(0x7f365806cc50 0x7f36580c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005181292 0 0) 0x7f36580c7af0 con 0x7f36580c4030 2023-10-14T09:17:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3644003530 con 0x7f36580c4030 2023-10-14T09:17:55.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2860080703 0 0) 0x7f3644003530 con 0x7f36580c4030 2023-10-14T09:17:55.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3658153d90 msgr2=0x7f36581541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:55.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3658153d90 0x7f36581541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 >> v2:172.21.15.157:3300/0 conn(0x7f365806cc50 msgr2=0x7f36580c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:55.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 --2- 172.21.15.78:0/782189981 >> v2:172.21.15.157:3300/0 conn(0x7f365806cc50 0x7f36580c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658157ee0 con 0x7f36580c4030 2023-10-14T09:17:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f3648001680 con 0x7f36580c4030 2023-10-14T09:17:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 >> v1:172.21.15.78:6789/0 conn(0x7f36580c4030 legacy=0x7f36580c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3658153d90 0x7f3644003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3644003f00 0x7f36440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3644004d10 0x7f3644005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3658157360 con 0x7f3644004d10 2023-10-14T09:17:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364400b990 con 0x7f3644003f00 2023-10-14T09:17:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364400bb20 con 0x7f3658153d90 2023-10-14T09:17:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f3656d9d640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3644004d10 0x7f3644005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.984+0000 7f365659c640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3658153d90 0x7f3644003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f364dd9b640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3644003f00 0x7f36440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:55.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f3656d9d640 1 -- 172.21.15.78:0/782189981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3658153d90 msgr2=0x7f3644003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:55.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f3656d9d640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3658153d90 0x7f3644003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f3656d9d640 1 -- 172.21.15.78:0/782189981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3644003f00 msgr2=0x7f36440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:55.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f3656d9d640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3644003f00 0x7f36440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:55.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f3656d9d640 1 -- 172.21.15.78:0/782189981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644003530 con 0x7f3644004d10 2023-10-14T09:17:55.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f3656d9d640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3644004d10 0x7f3644005190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f365000e170 tx=0x7f365001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd8b6c3e62d7db3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:55.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36500a5c50 con 0x7f3644004d10 2023-10-14T09:17:55.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365000f040 con 0x7f3644004d10 2023-10-14T09:17:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f3655d9b640 1 -- 172.21.15.78:0/782189981 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36500ad440 con 0x7f3644004d10 2023-10-14T09:17:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f365cc6b640 1 -- 172.21.15.78:0/782189981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3644004d10 msgr2=0x7f3644005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f365cc6b640 1 --2- 172.21.15.78:0/782189981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3644004d10 0x7f3644005190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f365000e170 tx=0x7f365001cc40 comp rx=0 tx=0).stop 2023-10-14T09:17:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.988+0000 7f3656d9d640 1 -- 172.21.15.78:0/782189981 reap_dead start 2023-10-14T09:17:56.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 -- 172.21.15.78:0/782189981 shutdown_connections 2023-10-14T09:17:56.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 -- 172.21.15.78:0/782189981 >> 172.21.15.78:0/782189981 conn(0x7f36580ab240 msgr2=0x7f36580ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:56.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 -- 172.21.15.78:0/782189981 shutdown_connections 2023-10-14T09:17:56.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 -- 172.21.15.78:0/782189981 wait complete. 2023-10-14T09:17:56.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 Processor -- start 2023-10-14T09:17:56.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 -- start start 2023-10-14T09:17:56.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3644004d10 0x7f36581e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36580c35f0 0x7f3658156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36580c2b80 0x7f365814c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36580c0780 con 0x7f36580c35f0 2023-10-14T09:17:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36581e8f90 con 0x7f3644004d10 2023-10-14T09:17:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365cc6b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36580c26f0 con 0x7f36580c2b80 2023-10-14T09:17:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f364dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36580c35f0 0x7f3658156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f364dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36580c35f0 0x7f3658156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51672/0 (socket says 172.21.15.78:51672) 2023-10-14T09:17:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f364dd9b640 1 -- 172.21.15.78:0/214794055 learned_addr learned my addr 172.21.15.78:0/214794055 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f365659c640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3644004d10 0x7f36581e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f3656d9d640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36580c2b80 0x7f365814c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f364dd9b640 1 -- 172.21.15.78:0/214794055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36580c2b80 msgr2=0x7f365814c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f364dd9b640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36580c2b80 0x7f365814c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f364dd9b640 1 -- 172.21.15.78:0/214794055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3644004d10 msgr2=0x7f36581e8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f364dd9b640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3644004d10 0x7f36581e8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.992+0000 7f364dd9b640 1 -- 172.21.15.78:0/214794055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365814d4b0 con 0x7f36580c35f0 2023-10-14T09:17:56.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.996+0000 7f364dd9b640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36580c35f0 0x7f3658156540 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3640011aa0 tx=0x7f3640011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:56.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.996+0000 7f364f7fe640 1 -- 172.21.15.78:0/214794055 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000fb80 con 0x7f36580c35f0 2023-10-14T09:17:56.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.996+0000 7f364f7fe640 1 -- 172.21.15.78:0/214794055 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364000fce0 con 0x7f36580c35f0 2023-10-14T09:17:56.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.996+0000 7f365cc6b640 1 -- 172.21.15.78:0/214794055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36580c0990 con 0x7f36580c35f0 2023-10-14T09:17:56.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.996+0000 7f364f7fe640 1 -- 172.21.15.78:0/214794055 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640014680 con 0x7f36580c35f0 2023-10-14T09:17:56.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.996+0000 7f365cc6b640 1 -- 172.21.15.78:0/214794055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36580c2380 con 0x7f36580c35f0 2023-10-14T09:17:56.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.996+0000 7f365cc6b640 1 -- 172.21.15.78:0/214794055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3658074110 con 0x7f36580c35f0 2023-10-14T09:17:56.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.996+0000 7f364f7fe640 1 -- 172.21.15.78:0/214794055 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f36400147e0 con 0x7f36580c35f0 2023-10-14T09:17:56.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.996+0000 7f364f7fe640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36380664d0 0x7f3638068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.996+0000 7f364f7fe640 1 -- 172.21.15.78:0/214794055 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3640084790 con 0x7f36580c35f0 2023-10-14T09:17:56.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:55.996+0000 7f365659c640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36380664d0 0x7f3638068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.000+0000 7f365659c640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36380664d0 0x7f3638068990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f36580ad060 tx=0x7f3648009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:56.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.000+0000 7f364f7fe640 1 -- 172.21.15.78:0/214794055 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3640051c00 con 0x7f36580c35f0 2023-10-14T09:17:56.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.148+0000 7f365cc6b640 1 -- 172.21.15.78:0/214794055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36580c2830 con 0x7f36580c35f0 2023-10-14T09:17:56.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f364f7fe640 1 -- 172.21.15.78:0/214794055 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3640055220 con 0x7f36580c35f0 2023-10-14T09:17:56.155 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:17:56.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 -- 172.21.15.78:0/214794055 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36380664d0 msgr2=0x7f3638068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36380664d0 0x7f3638068990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f36580ad060 tx=0x7f3648009040 comp rx=0 tx=0).stop 2023-10-14T09:17:56.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 -- 172.21.15.78:0/214794055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36580c35f0 msgr2=0x7f3658156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36580c35f0 0x7f3658156540 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3640011aa0 tx=0x7f3640011f60 comp rx=0 tx=0).stop 2023-10-14T09:17:56.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 -- 172.21.15.78:0/214794055 shutdown_connections 2023-10-14T09:17:56.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f36380664d0 0x7f3638068990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f36580c2b80 0x7f365814c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36580c35f0 0x7f3658156540 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 --2- 172.21.15.78:0/214794055 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3644004d10 0x7f36581e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 -- 172.21.15.78:0/214794055 >> 172.21.15.78:0/214794055 conn(0x7f36580ab240 msgr2=0x7f36580af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:56.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 -- 172.21.15.78:0/214794055 shutdown_connections 2023-10-14T09:17:56.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.152+0000 7f365cc6b640 1 -- 172.21.15.78:0/214794055 wait complete. 2023-10-14T09:17:56.176 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T09:17:56.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.312+0000 7fa258f80640 1 Processor -- start 2023-10-14T09:17:56.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.312+0000 7fa258f80640 1 -- start start 2023-10-14T09:17:56.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.312+0000 7fa258f80640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa2540a8360 0x7fa2540a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.312+0000 7fa258f80640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa254152a60 con 0x7fa25413b050 2023-10-14T09:17:56.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.312+0000 7fa258f80640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa254151e50 con 0x7fa25406cd70 2023-10-14T09:17:56.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.312+0000 7fa258f80640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2540a9340 con 0x7fa2540a8360 2023-10-14T09:17:56.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.312+0000 7fa25259c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa25413b050 0x7fa254155a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36152/0 (socket says 172.21.15.78:36152) 2023-10-14T09:17:56.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.312+0000 7fa25259c640 1 -- 172.21.15.78:0/1243580472 learned_addr learned my addr 172.21.15.78:0/1243580472 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:56.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.316+0000 7fa24bfff640 1 --2- 172.21.15.78:0/1243580472 >> v2:172.21.15.157:3300/0 conn(0x7fa2540a8360 0x7fa2540a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.316+0000 7fa251d9b640 1 -- 172.21.15.78:0/1243580472 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274120254 0 0) 0x7fa254152a60 con 0x7fa25413b050 2023-10-14T09:17:56.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.316+0000 7fa251d9b640 1 -- 172.21.15.78:0/1243580472 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa240003530 con 0x7fa25413b050 2023-10-14T09:17:56.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.316+0000 7fa24bfff640 1 -- 172.21.15.78:0/1243580472 >> v1:172.21.15.157:6789/0 conn(0x7fa25406cd70 legacy=0x7fa25406d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.316+0000 7fa24bfff640 1 -- 172.21.15.78:0/1243580472 >> v1:172.21.15.78:6789/0 conn(0x7fa25413b050 legacy=0x7fa254155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.316+0000 7fa251d9b640 1 -- 172.21.15.78:0/1243580472 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2921195688 0 0) 0x7fa240003530 con 0x7fa25413b050 2023-10-14T09:17:56.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.316+0000 7fa24bfff640 1 -- 172.21.15.78:0/1243580472 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa254152130 con 0x7fa2540a8360 2023-10-14T09:17:56.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.316+0000 7fa24bfff640 1 --2- 172.21.15.78:0/1243580472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2540a8360 0x7fa2540a87c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0097c0 tx=0x7fa23c01c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5f9da32150a7b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:56.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.316+0000 7fa251d9b640 1 -- 172.21.15.78:0/1243580472 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244001680 con 0x7fa2540a8360 2023-10-14T09:17:56.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.316+0000 7fa251d9b640 1 -- 172.21.15.78:0/1243580472 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c0a7050 con 0x7fa2540a8360 2023-10-14T09:17:56.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa251d9b640 1 -- 172.21.15.78:0/1243580472 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0ab620 con 0x7fa2540a8360 2023-10-14T09:17:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 -- 172.21.15.78:0/1243580472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2540a8360 msgr2=0x7fa2540a87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 --2- 172.21.15.78:0/1243580472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2540a8360 0x7fa2540a87c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0097c0 tx=0x7fa23c01c2e0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 -- 172.21.15.78:0/1243580472 shutdown_connections 2023-10-14T09:17:56.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 --2- 172.21.15.78:0/1243580472 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2540a8360 0x7fa2540a87c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 -- 172.21.15.78:0/1243580472 >> 172.21.15.78:0/1243580472 conn(0x7fa2540c1cc0 msgr2=0x7fa2540c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:56.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 -- 172.21.15.78:0/1243580472 shutdown_connections 2023-10-14T09:17:56.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 -- 172.21.15.78:0/1243580472 wait complete. 2023-10-14T09:17:56.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 Processor -- start 2023-10-14T09:17:56.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 -- start start 2023-10-14T09:17:56.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa25406cd70 0x7fa2541ebe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540a8360 0x7fa2541333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa25413b050 0x7fa2540bed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540c4290 con 0x7fa2540a8360 2023-10-14T09:17:56.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540c2e10 con 0x7fa25406cd70 2023-10-14T09:17:56.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa258f80640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540c30f0 con 0x7fa25413b050 2023-10-14T09:17:56.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa24bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540a8360 0x7fa2541333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa24bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540a8360 0x7fa2541333c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51684/0 (socket says 172.21.15.78:51684) 2023-10-14T09:17:56.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa24bfff640 1 -- 172.21.15.78:0/855004102 learned_addr learned my addr 172.21.15.78:0/855004102 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:56.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.320+0000 7fa24bfff640 1 -- 172.21.15.78:0/855004102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa25413b050 msgr2=0x7fa2540bed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa252d9d640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa25413b050 0x7fa2540bed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa24bfff640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa25413b050 0x7fa2540bed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa24bfff640 1 -- 172.21.15.78:0/855004102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa25406cd70 msgr2=0x7fa2541ebe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa25259c640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa25406cd70 0x7fa2541ebe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa24bfff640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa25406cd70 0x7fa2541ebe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa24bfff640 1 -- 172.21.15.78:0/855004102 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c009420 con 0x7fa2540a8360 2023-10-14T09:17:56.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa25259c640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa25406cd70 0x7fa2541ebe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:17:56.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa24bfff640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540a8360 0x7fa2541333c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0097c0 tx=0x7fa23c01ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:56.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa24affd640 1 -- 172.21.15.78:0/855004102 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0abd80 con 0x7fa2540a8360 2023-10-14T09:17:56.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa24affd640 1 -- 172.21.15.78:0/855004102 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c004020 con 0x7fa2540a8360 2023-10-14T09:17:56.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa258f80640 1 -- 172.21.15.78:0/855004102 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25406da90 con 0x7fa2540a8360 2023-10-14T09:17:56.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa24affd640 1 -- 172.21.15.78:0/855004102 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0043d0 con 0x7fa2540a8360 2023-10-14T09:17:56.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa258f80640 1 -- 172.21.15.78:0/855004102 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa254133ba0 con 0x7fa2540a8360 2023-10-14T09:17:56.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa258f80640 1 -- 172.21.15.78:0/855004102 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25406d890 con 0x7fa2540a8360 2023-10-14T09:17:56.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa24affd640 1 -- 172.21.15.78:0/855004102 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa23c003620 con 0x7fa2540a8360 2023-10-14T09:17:56.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa24affd640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2340664a0 0x7fa234068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa24affd640 1 -- 172.21.15.78:0/855004102 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa23c11e350 con 0x7fa2540a8360 2023-10-14T09:17:56.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.324+0000 7fa25259c640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2340664a0 0x7fa234068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.328+0000 7fa25259c640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2340664a0 0x7fa234068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa244000f70 tx=0x7fa244009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:56.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.328+0000 7fa24affd640 1 -- 172.21.15.78:0/855004102 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa23c0eb850 con 0x7fa2540a8360 2023-10-14T09:17:56.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.488+0000 7fa258f80640 1 -- 172.21.15.78:0/855004102 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa254074180 con 0x7fa2540a8360 2023-10-14T09:17:56.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.488+0000 7fa24affd640 1 -- 172.21.15.78:0/855004102 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa23c0eee70 con 0x7fa2540a8360 2023-10-14T09:17:56.493 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-10-14T09:17:56.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 -- 172.21.15.78:0/855004102 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2340664a0 msgr2=0x7fa234068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2340664a0 0x7fa234068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa244000f70 tx=0x7fa244009040 comp rx=0 tx=0).stop 2023-10-14T09:17:56.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 -- 172.21.15.78:0/855004102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540a8360 msgr2=0x7fa2541333c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540a8360 0x7fa2541333c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0097c0 tx=0x7fa23c01ab20 comp rx=0 tx=0).stop 2023-10-14T09:17:56.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 -- 172.21.15.78:0/855004102 shutdown_connections 2023-10-14T09:17:56.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2340664a0 0x7fa234068960 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa25413b050 0x7fa2540bed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2540a8360 0x7fa2541333c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 --2- 172.21.15.78:0/855004102 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa25406cd70 0x7fa2541ebe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 -- 172.21.15.78:0/855004102 >> 172.21.15.78:0/855004102 conn(0x7fa2540c1cc0 msgr2=0x7fa2540aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:56.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 -- 172.21.15.78:0/855004102 shutdown_connections 2023-10-14T09:17:56.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.492+0000 7fa258f80640 1 -- 172.21.15.78:0/855004102 wait complete. 2023-10-14T09:17:56.513 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:17:56.514 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:17:56.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:56.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e454ea640 1 Processor -- start 2023-10-14T09:17:56.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e454ea640 1 -- start start 2023-10-14T09:17:56.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e454ea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e40153e80 0x7f6e400c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e454ea640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6e400c6910 0x7f6e400c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e454ea640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4006c470 con 0x7f6e4014ddb0 2023-10-14T09:17:56.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e454ea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e400c64f0 con 0x7f6e40153e80 2023-10-14T09:17:56.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e454ea640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e400c5300 con 0x7f6e400c6910 2023-10-14T09:17:56.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e37fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e40153e80 0x7f6e400c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e37fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e40153e80 0x7f6e400c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51698/0 (socket says 172.21.15.78:51698) 2023-10-14T09:17:56.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e37fff640 1 -- 172.21.15.78:0/989426711 learned_addr learned my addr 172.21.15.78:0/989426711 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:56.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e3f7fe640 1 --2- 172.21.15.78:0/989426711 >> v2:172.21.15.157:3300/0 conn(0x7f6e400c6910 0x7f6e400c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e37fff640 1 -- 172.21.15.78:0/989426711 >> v2:172.21.15.157:3300/0 conn(0x7f6e400c6910 msgr2=0x7f6e400c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:56.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e37fff640 1 --2- 172.21.15.78:0/989426711 >> v2:172.21.15.157:3300/0 conn(0x7f6e400c6910 0x7f6e400c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e37fff640 1 -- 172.21.15.78:0/989426711 >> v1:172.21.15.157:6789/0 conn(0x7f6e4014ddb0 legacy=0x7f6e4006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e37fff640 1 -- 172.21.15.78:0/989426711 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4006c750 con 0x7f6e40153e80 2023-10-14T09:17:56.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.704+0000 7f6e3f7fe640 1 --2- 172.21.15.78:0/989426711 >> v2:172.21.15.157:3300/0 conn(0x7f6e400c6910 0x7f6e400c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:56.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e37fff640 1 --2- 172.21.15.78:0/989426711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40153e80 0x7f6e400c7780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6e400abec0 tx=0x7f6e2801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2485b49cfa4a994 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:56.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e3e7fc640 1 -- 172.21.15.78:0/989426711 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280ab600 con 0x7f6e40153e80 2023-10-14T09:17:56.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e3e7fc640 1 -- 172.21.15.78:0/989426711 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e280a7050 con 0x7f6e40153e80 2023-10-14T09:17:56.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e3e7fc640 1 -- 172.21.15.78:0/989426711 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280ab980 con 0x7f6e40153e80 2023-10-14T09:17:56.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e454ea640 1 -- 172.21.15.78:0/989426711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40153e80 msgr2=0x7f6e400c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e454ea640 1 --2- 172.21.15.78:0/989426711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40153e80 0x7f6e400c7780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6e400abec0 tx=0x7f6e2801c3e0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e454ea640 1 -- 172.21.15.78:0/989426711 shutdown_connections 2023-10-14T09:17:56.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e454ea640 1 --2- 172.21.15.78:0/989426711 >> v2:172.21.15.157:3300/0 conn(0x7f6e400c6910 0x7f6e400c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e454ea640 1 --2- 172.21.15.78:0/989426711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40153e80 0x7f6e400c7780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e454ea640 1 -- 172.21.15.78:0/989426711 >> 172.21.15.78:0/989426711 conn(0x7f6e400ab1f0 msgr2=0x7f6e400ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:56.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e454ea640 1 -- 172.21.15.78:0/989426711 shutdown_connections 2023-10-14T09:17:56.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.708+0000 7f6e454ea640 1 -- 172.21.15.78:0/989426711 wait complete. 2023-10-14T09:17:56.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e454ea640 1 Processor -- start 2023-10-14T09:17:56.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e454ea640 1 -- start start 2023-10-14T09:17:56.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e454ea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e400c6910 0x7f6e400c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e454ea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e4014ddb0 0x7f6e400bf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e454ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40153e80 0x7f6e401efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e454ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400c0f40 con 0x7f6e40153e80 2023-10-14T09:17:56.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e454ea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400c0980 con 0x7f6e400c6910 2023-10-14T09:17:56.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e454ea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400c0c60 con 0x7f6e4014ddb0 2023-10-14T09:17:56.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e3f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40153e80 0x7f6e401efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e3f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40153e80 0x7f6e401efa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51714/0 (socket says 172.21.15.78:51714) 2023-10-14T09:17:56.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e3f7fe640 1 -- 172.21.15.78:0/4146056151 learned_addr learned my addr 172.21.15.78:0/4146056151 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:56.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e3effd640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e400c6910 0x7f6e400c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e37fff640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e4014ddb0 0x7f6e400bf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e3f7fe640 1 -- 172.21.15.78:0/4146056151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e4014ddb0 msgr2=0x7f6e400bf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e3f7fe640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e4014ddb0 0x7f6e400bf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e3f7fe640 1 -- 172.21.15.78:0/4146056151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e400c6910 msgr2=0x7f6e400c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e3f7fe640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e400c6910 0x7f6e400c1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e3f7fe640 1 -- 172.21.15.78:0/4146056151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e280094d0 con 0x7f6e40153e80 2023-10-14T09:17:56.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e3effd640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e400c6910 0x7f6e400c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:56.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e3f7fe640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40153e80 0x7f6e401efa70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6e38007df0 tx=0x7f6e3800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:56.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e377fe640 1 -- 172.21.15.78:0/4146056151 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e380039a0 con 0x7f6e40153e80 2023-10-14T09:17:56.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e377fe640 1 -- 172.21.15.78:0/4146056151 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3800f040 con 0x7f6e40153e80 2023-10-14T09:17:56.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e377fe640 1 -- 172.21.15.78:0/4146056151 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38003d40 con 0x7f6e40153e80 2023-10-14T09:17:56.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e454ea640 1 -- 172.21.15.78:0/4146056151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e400bec90 con 0x7f6e40153e80 2023-10-14T09:17:56.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.712+0000 7f6e454ea640 1 -- 172.21.15.78:0/4146056151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e400bf9d0 con 0x7f6e40153e80 2023-10-14T09:17:56.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.716+0000 7f6e454ea640 1 -- 172.21.15.78:0/4146056151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e40074180 con 0x7f6e40153e80 2023-10-14T09:17:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.716+0000 7f6e377fe640 1 -- 172.21.15.78:0/4146056151 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6e38004030 con 0x7f6e40153e80 2023-10-14T09:17:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.716+0000 7f6e377fe640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e200664a0 0x7f6e20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.716+0000 7f6e377fe640 1 -- 172.21.15.78:0/4146056151 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e380840c0 con 0x7f6e40153e80 2023-10-14T09:17:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.716+0000 7f6e3effd640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e200664a0 0x7f6e20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:56.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.716+0000 7f6e3effd640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e200664a0 0x7f6e20068960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6e401528a0 tx=0x7f6e30009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:56.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.720+0000 7f6e377fe640 1 -- 172.21.15.78:0/4146056151 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6e380515e0 con 0x7f6e40153e80 2023-10-14T09:17:56.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.872+0000 7f6e454ea640 1 -- 172.21.15.78:0/4146056151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e4014e190 con 0x7f6e40153e80 2023-10-14T09:17:56.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.872+0000 7f6e377fe640 1 -- 172.21.15.78:0/4146056151 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f6e38054c00 con 0x7f6e40153e80 2023-10-14T09:17:56.876 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:56.876 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:56.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 -- 172.21.15.78:0/4146056151 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e200664a0 msgr2=0x7f6e20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e200664a0 0x7f6e20068960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6e401528a0 tx=0x7f6e30009040 comp rx=0 tx=0).stop 2023-10-14T09:17:56.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 -- 172.21.15.78:0/4146056151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40153e80 msgr2=0x7f6e401efa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:56.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40153e80 0x7f6e401efa70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6e38007df0 tx=0x7f6e3800d4a0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 -- 172.21.15.78:0/4146056151 shutdown_connections 2023-10-14T09:17:56.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e40153e80 0x7f6e401efa70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6e200664a0 0x7f6e20068960 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6e4014ddb0 0x7f6e400bf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 --2- 172.21.15.78:0/4146056151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e400c6910 0x7f6e400c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:56.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 -- 172.21.15.78:0/4146056151 >> 172.21.15.78:0/4146056151 conn(0x7f6e400ab1f0 msgr2=0x7f6e400c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:56.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 -- 172.21.15.78:0/4146056151 shutdown_connections 2023-10-14T09:17:56.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:56.876+0000 7f6e454ea640 1 -- 172.21.15.78:0/4146056151 wait complete. 2023-10-14T09:17:56.897 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:56.899 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:57.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb7f80640 1 Processor -- start 2023-10-14T09:17:57.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb7f80640 1 -- start start 2023-10-14T09:17:57.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb7f80640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bb00c4030 0x7f0bb00c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb7f80640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bb0153d90 0x7f0bb01541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb7f80640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb00c7af0 con 0x7f0bb006cc50 2023-10-14T09:17:57.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb7f80640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb00c5300 con 0x7f0bb0153d90 2023-10-14T09:17:57.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb7f80640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb0157360 con 0x7f0bb00c4030 2023-10-14T09:17:57.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb551b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0bb006cc50 0x7f0bb00c4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50000/0 (socket says 172.21.15.78:50000) 2023-10-14T09:17:57.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb551b640 1 -- 172.21.15.78:0/3727732746 learned_addr learned my addr 172.21.15.78:0/3727732746 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:57.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb5d1c640 1 --2- 172.21.15.78:0/3727732746 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bb00c4030 0x7f0bb00c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb651d640 1 --2- 172.21.15.78:0/3727732746 >> v2:172.21.15.157:3300/0 conn(0x7f0bb0153d90 0x7f0bb01541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb4d1a640 1 -- 172.21.15.78:0/3727732746 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105435946 0 0) 0x7f0bb00c7af0 con 0x7f0bb006cc50 2023-10-14T09:17:57.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb4d1a640 1 -- 172.21.15.78:0/3727732746 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b9c003530 con 0x7f0bb006cc50 2023-10-14T09:17:57.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb5d1c640 1 -- 172.21.15.78:0/3727732746 >> v2:172.21.15.157:3300/0 conn(0x7f0bb0153d90 msgr2=0x7f0bb01541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:57.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb5d1c640 1 --2- 172.21.15.78:0/3727732746 >> v2:172.21.15.157:3300/0 conn(0x7f0bb0153d90 0x7f0bb01541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb5d1c640 1 -- 172.21.15.78:0/3727732746 >> v1:172.21.15.78:6789/0 conn(0x7f0bb006cc50 legacy=0x7f0bb00c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.036+0000 7f0bb5d1c640 1 -- 172.21.15.78:0/3727732746 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0157ee0 con 0x7f0bb00c4030 2023-10-14T09:17:57.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb5d1c640 1 --2- 172.21.15.78:0/3727732746 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bb00c4030 0x7f0bb00c75b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0097c0 tx=0x7f0bac01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15ab2a00d9f8ff2b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:57.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb4d1a640 1 -- 172.21.15.78:0/3727732746 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0ab5f0 con 0x7f0bb00c4030 2023-10-14T09:17:57.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb4d1a640 1 -- 172.21.15.78:0/3727732746 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac0ab750 con 0x7f0bb00c4030 2023-10-14T09:17:57.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb4d1a640 1 -- 172.21.15.78:0/3727732746 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0abac0 con 0x7f0bb00c4030 2023-10-14T09:17:57.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb7f80640 1 -- 172.21.15.78:0/3727732746 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bb00c4030 msgr2=0x7f0bb00c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb7f80640 1 --2- 172.21.15.78:0/3727732746 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bb00c4030 0x7f0bb00c75b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0097c0 tx=0x7f0bac01c3f0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb7f80640 1 -- 172.21.15.78:0/3727732746 shutdown_connections 2023-10-14T09:17:57.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb7f80640 1 --2- 172.21.15.78:0/3727732746 >> v2:172.21.15.157:3300/0 conn(0x7f0bb0153d90 0x7f0bb01541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb7f80640 1 --2- 172.21.15.78:0/3727732746 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bb00c4030 0x7f0bb00c75b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb7f80640 1 -- 172.21.15.78:0/3727732746 >> 172.21.15.78:0/3727732746 conn(0x7f0bb00ab240 msgr2=0x7f0bb00ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:57.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb7f80640 1 -- 172.21.15.78:0/3727732746 shutdown_connections 2023-10-14T09:17:57.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.040+0000 7f0bb7f80640 1 -- 172.21.15.78:0/3727732746 wait complete. 2023-10-14T09:17:57.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb7f80640 1 Processor -- start 2023-10-14T09:17:57.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb7f80640 1 -- start start 2023-10-14T09:17:57.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb7f80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bb006cc50 0x7f0bb00c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb7f80640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bb00c4030 0x7f0bb01f0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb7f80640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bb0153d90 0x7f0bb01f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb7f80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00c1fc0 con 0x7f0bb006cc50 2023-10-14T09:17:57.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb7f80640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb01f0a80 con 0x7f0bb0153d90 2023-10-14T09:17:57.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb7f80640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb014ee20 con 0x7f0bb00c4030 2023-10-14T09:17:57.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb5d1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bb006cc50 0x7f0bb00c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb5d1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bb006cc50 0x7f0bb00c1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60408/0 (socket says 172.21.15.78:60408) 2023-10-14T09:17:57.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb5d1c640 1 -- 172.21.15.78:0/2763054286 learned_addr learned my addr 172.21.15.78:0/2763054286 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:57.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb651d640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bb0153d90 0x7f0bb01f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb551b640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bb00c4030 0x7f0bb01f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb5d1c640 1 -- 172.21.15.78:0/2763054286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bb00c4030 msgr2=0x7f0bb01f0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb5d1c640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bb00c4030 0x7f0bb01f0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb5d1c640 1 -- 172.21.15.78:0/2763054286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bb0153d90 msgr2=0x7f0bb01f0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb5d1c640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bb0153d90 0x7f0bb01f0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb5d1c640 1 -- 172.21.15.78:0/2763054286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac009420 con 0x7f0bb006cc50 2023-10-14T09:17:57.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb5d1c640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bb006cc50 0x7f0bb00c1a80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0bac01aaa0 tx=0x7f0bac01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:57.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0ba67fc640 1 -- 172.21.15.78:0/2763054286 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0bf610 con 0x7f0bb006cc50 2023-10-14T09:17:57.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0ba67fc640 1 -- 172.21.15.78:0/2763054286 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac0bf770 con 0x7f0bb006cc50 2023-10-14T09:17:57.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb7f80640 1 -- 172.21.15.78:0/2763054286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb014e860 con 0x7f0bb006cc50 2023-10-14T09:17:57.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0ba67fc640 1 -- 172.21.15.78:0/2763054286 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0bfae0 con 0x7f0bb006cc50 2023-10-14T09:17:57.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.044+0000 7f0bb7f80640 1 -- 172.21.15.78:0/2763054286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb00c0a00 con 0x7f0bb006cc50 2023-10-14T09:17:57.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.048+0000 7f0bb7f80640 1 -- 172.21.15.78:0/2763054286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb0074110 con 0x7f0bb006cc50 2023-10-14T09:17:57.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.048+0000 7f0ba67fc640 1 -- 172.21.15.78:0/2763054286 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0bac0bfc40 con 0x7f0bb006cc50 2023-10-14T09:17:57.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.048+0000 7f0ba67fc640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0b940664a0 0x7f0b94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.048+0000 7f0ba67fc640 1 -- 172.21.15.78:0/2763054286 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bac0a8050 con 0x7f0bb006cc50 2023-10-14T09:17:57.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.048+0000 7f0bb551b640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0b940664a0 0x7f0b94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.048+0000 7f0bb551b640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0b940664a0 0x7f0b94068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00c6910 tx=0x7f0ba0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:57.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.052+0000 7f0ba67fc640 1 -- 172.21.15.78:0/2763054286 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0bac0ebd50 con 0x7f0bb006cc50 2023-10-14T09:17:57.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.208+0000 7f0bb7f80640 1 -- 172.21.15.78:0/2763054286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0bb00ae570 con 0x7f0bb006cc50 2023-10-14T09:17:57.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.208+0000 7f0ba67fc640 1 -- 172.21.15.78:0/2763054286 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0bac006e20 con 0x7f0bb006cc50 2023-10-14T09:17:57.211 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:57.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.208+0000 7f0bb7f80640 1 -- 172.21.15.78:0/2763054286 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0b940664a0 msgr2=0x7f0b94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.208+0000 7f0bb7f80640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0b940664a0 0x7f0b94068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00c6910 tx=0x7f0ba0009040 comp rx=0 tx=0).stop 2023-10-14T09:17:57.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.208+0000 7f0bb7f80640 1 -- 172.21.15.78:0/2763054286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bb006cc50 msgr2=0x7f0bb00c1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.208+0000 7f0bb7f80640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bb006cc50 0x7f0bb00c1a80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0bac01aaa0 tx=0x7f0bac01ac30 comp rx=0 tx=0).stop 2023-10-14T09:17:57.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.212+0000 7f0bb7f80640 1 -- 172.21.15.78:0/2763054286 shutdown_connections 2023-10-14T09:17:57.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.212+0000 7f0bb7f80640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bb0153d90 0x7f0bb01f0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.212+0000 7f0bb7f80640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0b940664a0 0x7f0b94068960 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.212+0000 7f0bb7f80640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bb00c4030 0x7f0bb01f0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.212+0000 7f0bb7f80640 1 --2- 172.21.15.78:0/2763054286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0bb006cc50 0x7f0bb00c1a80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.212+0000 7f0bb7f80640 1 -- 172.21.15.78:0/2763054286 >> 172.21.15.78:0/2763054286 conn(0x7f0bb00ab240 msgr2=0x7f0bb0152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:57.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.212+0000 7f0bb7f80640 1 -- 172.21.15.78:0/2763054286 shutdown_connections 2023-10-14T09:17:57.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.212+0000 7f0bb7f80640 1 -- 172.21.15.78:0/2763054286 wait complete. 2023-10-14T09:17:57.232 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:17:57.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda298ea640 1 Processor -- start 2023-10-14T09:17:57.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda298ea640 1 -- start start 2023-10-14T09:17:57.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda298ea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda24157be0 0x7fda240c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda298ea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda240c63b0 con 0x7fda240bcbc0 2023-10-14T09:17:57.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda298ea640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda240c6be0 con 0x7fda240c3eb0 2023-10-14T09:17:57.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda298ea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda240c6620 con 0x7fda24157be0 2023-10-14T09:17:57.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda1a7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda24157be0 0x7fda240c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda237fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fda240bcbc0 0x7fda24154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50002/0 (socket says 172.21.15.78:50002) 2023-10-14T09:17:57.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda1a7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda24157be0 0x7fda240c4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60414/0 (socket says 172.21.15.78:60414) 2023-10-14T09:17:57.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda237fe640 1 -- 172.21.15.78:0/679786979 learned_addr learned my addr 172.21.15.78:0/679786979 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:57.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda1a7fc640 1 -- 172.21.15.78:0/679786979 >> v1:172.21.15.157:6789/0 conn(0x7fda240c3eb0 legacy=0x7fda24153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:57.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda1a7fc640 1 -- 172.21.15.78:0/679786979 >> v1:172.21.15.78:6789/0 conn(0x7fda240bcbc0 legacy=0x7fda24154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda227fc640 1 -- 172.21.15.78:0/679786979 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525342045 0 0) 0x7fda240c63b0 con 0x7fda240bcbc0 2023-10-14T09:17:57.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.372+0000 7fda1a7fc640 1 -- 172.21.15.78:0/679786979 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240c6900 con 0x7fda24157be0 2023-10-14T09:17:57.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.376+0000 7fda1a7fc640 1 --2- 172.21.15.78:0/679786979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda24157be0 0x7fda240c4290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0097c0 tx=0x7fda0c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87c982035dfb763 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:57.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.376+0000 7fda227fc640 1 -- 172.21.15.78:0/679786979 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda241516c0 con 0x7fda24157be0 2023-10-14T09:17:57.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.376+0000 7fda227fc640 1 -- 172.21.15.78:0/679786979 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c0ac630 con 0x7fda24157be0 2023-10-14T09:17:57.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.376+0000 7fda227fc640 1 -- 172.21.15.78:0/679786979 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0ac9c0 con 0x7fda24157be0 2023-10-14T09:17:57.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.376+0000 7fda298ea640 1 -- 172.21.15.78:0/679786979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda24157be0 msgr2=0x7fda240c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.376+0000 7fda298ea640 1 --2- 172.21.15.78:0/679786979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda24157be0 0x7fda240c4290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0097c0 tx=0x7fda0c01c3b0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.376+0000 7fda298ea640 1 -- 172.21.15.78:0/679786979 shutdown_connections 2023-10-14T09:17:57.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.376+0000 7fda298ea640 1 --2- 172.21.15.78:0/679786979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda24157be0 0x7fda240c4290 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.376+0000 7fda298ea640 1 -- 172.21.15.78:0/679786979 >> 172.21.15.78:0/679786979 conn(0x7fda24071790 msgr2=0x7fda24071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:57.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.376+0000 7fda298ea640 1 -- 172.21.15.78:0/679786979 shutdown_connections 2023-10-14T09:17:57.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.376+0000 7fda298ea640 1 -- 172.21.15.78:0/679786979 wait complete. 2023-10-14T09:17:57.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda298ea640 1 Processor -- start 2023-10-14T09:17:57.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda298ea640 1 -- start start 2023-10-14T09:17:57.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda298ea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda240bcbc0 0x7fda241534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda298ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda240c3eb0 0x7fda24151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda298ea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda2414fee0 0x7fda24152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda298ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda241491c0 con 0x7fda240c3eb0 2023-10-14T09:17:57.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda298ea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24156a60 con 0x7fda2414fee0 2023-10-14T09:17:57.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda298ea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2415e7a0 con 0x7fda240bcbc0 2023-10-14T09:17:57.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda1a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda240c3eb0 0x7fda24151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda1a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda240c3eb0 0x7fda24151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60430/0 (socket says 172.21.15.78:60430) 2023-10-14T09:17:57.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda1a7fc640 1 -- 172.21.15.78:0/3726378203 learned_addr learned my addr 172.21.15.78:0/3726378203 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda237fe640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda2414fee0 0x7fda24152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda22ffd640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda240bcbc0 0x7fda241534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda1a7fc640 1 -- 172.21.15.78:0/3726378203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda240bcbc0 msgr2=0x7fda241534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda1a7fc640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda240bcbc0 0x7fda241534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda1a7fc640 1 -- 172.21.15.78:0/3726378203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda2414fee0 msgr2=0x7fda24152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda1a7fc640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda2414fee0 0x7fda24152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda1a7fc640 1 -- 172.21.15.78:0/3726378203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c009420 con 0x7fda240c3eb0 2023-10-14T09:17:57.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda22ffd640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda240bcbc0 0x7fda241534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:57.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda1a7fc640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda240c3eb0 0x7fda24151b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0af040 tx=0x7fda0c019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:57.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda20ff9640 1 -- 172.21.15.78:0/3726378203 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0b5620 con 0x7fda240c3eb0 2023-10-14T09:17:57.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda20ff9640 1 -- 172.21.15.78:0/3726378203 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c0b57a0 con 0x7fda240c3eb0 2023-10-14T09:17:57.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda298ea640 1 -- 172.21.15.78:0/3726378203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2415ea40 con 0x7fda240c3eb0 2023-10-14T09:17:57.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda20ff9640 1 -- 172.21.15.78:0/3726378203 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0b5b50 con 0x7fda240c3eb0 2023-10-14T09:17:57.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.380+0000 7fda298ea640 1 -- 172.21.15.78:0/3726378203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda24148b00 con 0x7fda240c3eb0 2023-10-14T09:17:57.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.384+0000 7fda298ea640 1 -- 172.21.15.78:0/3726378203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda24149300 con 0x7fda240c3eb0 2023-10-14T09:17:57.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.384+0000 7fda20ff9640 1 -- 172.21.15.78:0/3726378203 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fda0c0b3040 con 0x7fda240c3eb0 2023-10-14T09:17:57.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.384+0000 7fda20ff9640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda040664a0 0x7fda04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.384+0000 7fda20ff9640 1 -- 172.21.15.78:0/3726378203 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda0c11e510 con 0x7fda240c3eb0 2023-10-14T09:17:57.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.384+0000 7fda22ffd640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda040664a0 0x7fda04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.384+0000 7fda22ffd640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda040664a0 0x7fda04068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda140045c0 tx=0x7fda14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:57.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.388+0000 7fda20ff9640 1 -- 172.21.15.78:0/3726378203 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fda24149300 con 0x7fda240c3eb0 2023-10-14T09:17:57.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.536+0000 7fda298ea640 1 -- 172.21.15.78:0/3726378203 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda24149300 con 0x7fda240c3eb0 2023-10-14T09:17:57.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.536+0000 7fda20ff9640 1 -- 172.21.15.78:0/3726378203 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda24149300 con 0x7fda240c3eb0 2023-10-14T09:17:57.540 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:17:57.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 -- 172.21.15.78:0/3726378203 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda040664a0 msgr2=0x7fda04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda040664a0 0x7fda04068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda140045c0 tx=0x7fda14009040 comp rx=0 tx=0).stop 2023-10-14T09:17:57.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 -- 172.21.15.78:0/3726378203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda240c3eb0 msgr2=0x7fda24151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda240c3eb0 0x7fda24151b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0af040 tx=0x7fda0c019150 comp rx=0 tx=0).stop 2023-10-14T09:17:57.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 -- 172.21.15.78:0/3726378203 shutdown_connections 2023-10-14T09:17:57.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda2414fee0 0x7fda24152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda240c3eb0 0x7fda24151b50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda040664a0 0x7fda04068960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 --2- 172.21.15.78:0/3726378203 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda240bcbc0 0x7fda241534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 -- 172.21.15.78:0/3726378203 >> 172.21.15.78:0/3726378203 conn(0x7fda24071790 msgr2=0x7fda2406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:57.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 -- 172.21.15.78:0/3726378203 shutdown_connections 2023-10-14T09:17:57.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.540+0000 7fda298ea640 1 -- 172.21.15.78:0/3726378203 wait complete. 2023-10-14T09:17:57.561 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:17:57.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f580df0f640 1 Processor -- start 2023-10-14T09:17:57.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f580df0f640 1 -- start start 2023-10-14T09:17:57.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f580df0f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f580815b530 0x7f580815d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f580df0f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58080c0310 con 0x7f580813af90 2023-10-14T09:17:57.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f580df0f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5808151c90 con 0x7f58080bbd90 2023-10-14T09:17:57.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f580df0f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080bc1f0 con 0x7f580815b530 2023-10-14T09:17:57.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f58077fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f580813af90 0x7f58080bfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50012/0 (socket says 172.21.15.78:50012) 2023-10-14T09:17:57.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f58077fe640 1 -- 172.21.15.78:0/1463605639 learned_addr learned my addr 172.21.15.78:0/1463605639 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:57.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f5807fff640 1 --2- 172.21.15.78:0/1463605639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f580815b530 0x7f580815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f58067fc640 1 -- 172.21.15.78:0/1463605639 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145909475 0 0) 0x7f58080c0310 con 0x7f580813af90 2023-10-14T09:17:57.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f58067fc640 1 -- 172.21.15.78:0/1463605639 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f0003530 con 0x7f580813af90 2023-10-14T09:17:57.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f58067fc640 1 -- 172.21.15.78:0/1463605639 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031589458 0 0) 0x7f5808151c90 con 0x7f58080bbd90 2023-10-14T09:17:57.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f5807fff640 1 -- 172.21.15.78:0/1463605639 >> v1:172.21.15.157:6789/0 conn(0x7f58080bbd90 legacy=0x7f580806bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f5807fff640 1 -- 172.21.15.78:0/1463605639 >> v1:172.21.15.78:6789/0 conn(0x7f580813af90 legacy=0x7f58080bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.700+0000 7f5807fff640 1 -- 172.21.15.78:0/1463605639 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080bafd0 con 0x7f580815b530 2023-10-14T09:17:57.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.704+0000 7f5807fff640 1 --2- 172.21.15.78:0/1463605639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f580815b530 0x7f580815d920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5800009dc0 tx=0x7f580001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff5838c4f4911000 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.704+0000 7f58067fc640 1 -- 172.21.15.78:0/1463605639 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58000a5890 con 0x7f580815b530 2023-10-14T09:17:57.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.704+0000 7f58067fc640 1 -- 172.21.15.78:0/1463605639 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58000a59f0 con 0x7f580815b530 2023-10-14T09:17:57.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.704+0000 7f58067fc640 1 -- 172.21.15.78:0/1463605639 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58000a5d80 con 0x7f580815b530 2023-10-14T09:17:57.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.704+0000 7f580df0f640 1 -- 172.21.15.78:0/1463605639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f580815b530 msgr2=0x7f580815d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.704+0000 7f580df0f640 1 --2- 172.21.15.78:0/1463605639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f580815b530 0x7f580815d920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5800009dc0 tx=0x7f580001c8e0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.704+0000 7f580df0f640 1 -- 172.21.15.78:0/1463605639 shutdown_connections 2023-10-14T09:17:57.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.704+0000 7f580df0f640 1 --2- 172.21.15.78:0/1463605639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f580815b530 0x7f580815d920 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.704+0000 7f580df0f640 1 -- 172.21.15.78:0/1463605639 >> 172.21.15.78:0/1463605639 conn(0x7f58080c1d00 msgr2=0x7f58080c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:57.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.704+0000 7f580df0f640 1 -- 172.21.15.78:0/1463605639 shutdown_connections 2023-10-14T09:17:57.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.704+0000 7f580df0f640 1 -- 172.21.15.78:0/1463605639 wait complete. 2023-10-14T09:17:57.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f580df0f640 1 Processor -- start 2023-10-14T09:17:57.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f580df0f640 1 -- start start 2023-10-14T09:17:57.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f580df0f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58080bbd90 0x7f58080c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f580df0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580813af90 0x7f58081ec650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f580df0f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f580815b530 0x7f580812b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f580df0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58081ebc40 con 0x7f580813af90 2023-10-14T09:17:57.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f580df0f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580814f870 con 0x7f58080bbd90 2023-10-14T09:17:57.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f580df0f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080704b0 con 0x7f580815b530 2023-10-14T09:17:57.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f5806ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580813af90 0x7f58081ec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f5806ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580813af90 0x7f58081ec650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60444/0 (socket says 172.21.15.78:60444) 2023-10-14T09:17:57.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f5806ffd640 1 -- 172.21.15.78:0/4009371878 learned_addr learned my addr 172.21.15.78:0/4009371878 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f5806ffd640 1 -- 172.21.15.78:0/4009371878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f580815b530 msgr2=0x7f580812b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f5806ffd640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f580815b530 0x7f580812b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f5806ffd640 1 -- 172.21.15.78:0/4009371878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58080bbd90 msgr2=0x7f58080c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f5806ffd640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58080bbd90 0x7f58080c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f5806ffd640 1 -- 172.21.15.78:0/4009371878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5800009a70 con 0x7f580813af90 2023-10-14T09:17:57.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f5806ffd640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580813af90 0x7f58081ec650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00c480 tx=0x7f57fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:57.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f57effff640 1 -- 172.21.15.78:0/4009371878 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc005480 con 0x7f580813af90 2023-10-14T09:17:57.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f57effff640 1 -- 172.21.15.78:0/4009371878 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc003600 con 0x7f580813af90 2023-10-14T09:17:57.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f580df0f640 1 -- 172.21.15.78:0/4009371878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58081ec1c0 con 0x7f580813af90 2023-10-14T09:17:57.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f57effff640 1 -- 172.21.15.78:0/4009371878 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0039b0 con 0x7f580813af90 2023-10-14T09:17:57.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f580df0f640 1 -- 172.21.15.78:0/4009371878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58081ecb90 con 0x7f580813af90 2023-10-14T09:17:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.708+0000 7f580df0f640 1 -- 172.21.15.78:0/4009371878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5808074110 con 0x7f580813af90 2023-10-14T09:17:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.712+0000 7f57effff640 1 -- 172.21.15.78:0/4009371878 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f57fc003b10 con 0x7f580813af90 2023-10-14T09:17:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.712+0000 7f57effff640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57f40664a0 0x7f57f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.712+0000 7f57effff640 1 -- 172.21.15.78:0/4009371878 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57fc083430 con 0x7f580813af90 2023-10-14T09:17:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.712+0000 7f58077fe640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57f40664a0 0x7f57f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:57.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.712+0000 7f58077fe640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57f40664a0 0x7f57f4068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f57f8007fd0 tx=0x7f57f8007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:57.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.716+0000 7f57effff640 1 -- 172.21.15.78:0/4009371878 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f57fc0508a0 con 0x7f580813af90 2023-10-14T09:17:57.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.864+0000 7f580df0f640 1 -- 172.21.15.78:0/4009371878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58081ec350 con 0x7f580813af90 2023-10-14T09:17:57.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.864+0000 7f57effff640 1 -- 172.21.15.78:0/4009371878 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f57fc0170a0 con 0x7f580813af90 2023-10-14T09:17:57.868 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:17:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.864+0000 7f580df0f640 1 -- 172.21.15.78:0/4009371878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57f40664a0 msgr2=0x7f57f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.864+0000 7f580df0f640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57f40664a0 0x7f57f4068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f57f8007fd0 tx=0x7f57f8007900 comp rx=0 tx=0).stop 2023-10-14T09:17:57.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.864+0000 7f580df0f640 1 -- 172.21.15.78:0/4009371878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580813af90 msgr2=0x7f58081ec650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.864+0000 7f580df0f640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580813af90 0x7f58081ec650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f57fc00c480 tx=0x7f57fc00c940 comp rx=0 tx=0).stop 2023-10-14T09:17:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.864+0000 7f580df0f640 1 -- 172.21.15.78:0/4009371878 shutdown_connections 2023-10-14T09:17:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.864+0000 7f580df0f640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57f40664a0 0x7f57f4068960 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.864+0000 7f580df0f640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f580815b530 0x7f580812b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.864+0000 7f580df0f640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f580813af90 0x7f58081ec650 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.864+0000 7f580df0f640 1 --2- 172.21.15.78:0/4009371878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58080bbd90 0x7f58080c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:57.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.868+0000 7f580df0f640 1 -- 172.21.15.78:0/4009371878 >> 172.21.15.78:0/4009371878 conn(0x7f58080c1d00 msgr2=0x7f5808139840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:57.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.868+0000 7f580df0f640 1 -- 172.21.15.78:0/4009371878 shutdown_connections 2023-10-14T09:17:57.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:57.868+0000 7f580df0f640 1 -- 172.21.15.78:0/4009371878 wait complete. 2023-10-14T09:17:57.889 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T09:17:58.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab1966b640 1 Processor -- start 2023-10-14T09:17:58.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab1966b640 1 -- start start 2023-10-14T09:17:58.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab1966b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fab14151430 0x7fab141547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab1966b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab140c4180 0x7fab140c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab1966b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab14151810 con 0x7fab140c1eb0 2023-10-14T09:17:58.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab1966b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab140c27d0 con 0x7fab14151430 2023-10-14T09:17:58.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab1966b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1406f760 con 0x7fab140c4180 2023-10-14T09:17:58.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab12ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fab14151430 0x7fab141547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab12ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fab14151430 0x7fab141547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60452/0 (socket says 172.21.15.78:60452) 2023-10-14T09:17:58.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab12ffd640 1 -- 172.21.15.78:0/3131987406 learned_addr learned my addr 172.21.15.78:0/3131987406 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:58.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab137fe640 1 --2- 172.21.15.78:0/3131987406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab140c4180 0x7fab140c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab12ffd640 1 -- 172.21.15.78:0/3131987406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab140c4180 msgr2=0x7fab140c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:58.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab12ffd640 1 --2- 172.21.15.78:0/3131987406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab140c4180 0x7fab140c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab12ffd640 1 -- 172.21.15.78:0/3131987406 >> v1:172.21.15.157:6789/0 conn(0x7fab140c1eb0 legacy=0x7fab140c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:58.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.024+0000 7fab12ffd640 1 -- 172.21.15.78:0/3131987406 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14154d20 con 0x7fab14151430 2023-10-14T09:17:58.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab12ffd640 1 --2- 172.21.15.78:0/3131987406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab14151430 0x7fab141547e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fab04009870 tx=0x7fab0401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1d89e9de1f5961 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:58.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab127fc640 1 -- 172.21.15.78:0/3131987406 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab040ab600 con 0x7fab14151430 2023-10-14T09:17:58.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab127fc640 1 -- 172.21.15.78:0/3131987406 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab040a7050 con 0x7fab14151430 2023-10-14T09:17:58.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab127fc640 1 -- 172.21.15.78:0/3131987406 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab040ab980 con 0x7fab14151430 2023-10-14T09:17:58.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab1966b640 1 -- 172.21.15.78:0/3131987406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab14151430 msgr2=0x7fab141547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab1966b640 1 --2- 172.21.15.78:0/3131987406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab14151430 0x7fab141547e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fab04009870 tx=0x7fab0401c3b0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab1966b640 1 -- 172.21.15.78:0/3131987406 shutdown_connections 2023-10-14T09:17:58.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab1966b640 1 --2- 172.21.15.78:0/3131987406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab140c4180 0x7fab140c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab1966b640 1 --2- 172.21.15.78:0/3131987406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab14151430 0x7fab141547e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab1966b640 1 -- 172.21.15.78:0/3131987406 >> 172.21.15.78:0/3131987406 conn(0x7fab1406a060 msgr2=0x7fab1406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:58.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab1966b640 1 -- 172.21.15.78:0/3131987406 shutdown_connections 2023-10-14T09:17:58.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.028+0000 7fab1966b640 1 -- 172.21.15.78:0/3131987406 wait complete. 2023-10-14T09:17:58.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab1966b640 1 Processor -- start 2023-10-14T09:17:58.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab1966b640 1 -- start start 2023-10-14T09:17:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab1966b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab140c1eb0 0x7fab1406ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab1966b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab140c4180 0x7fab1414dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab1966b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab14151430 0x7fab1414e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab1966b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14152220 con 0x7fab14151430 2023-10-14T09:17:58.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab1966b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab141478a0 con 0x7fab140c4180 2023-10-14T09:17:58.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab1966b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab14147b80 con 0x7fab140c1eb0 2023-10-14T09:17:58.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab137fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab14151430 0x7fab1414e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab12ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab140c1eb0 0x7fab1406ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab137fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab14151430 0x7fab1414e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60464/0 (socket says 172.21.15.78:60464) 2023-10-14T09:17:58.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab137fe640 1 -- 172.21.15.78:0/3671676920 learned_addr learned my addr 172.21.15.78:0/3671676920 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab0a7fc640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab140c4180 0x7fab1414dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab12ffd640 1 -- 172.21.15.78:0/3671676920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab140c4180 msgr2=0x7fab1414dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab12ffd640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab140c4180 0x7fab1414dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab12ffd640 1 -- 172.21.15.78:0/3671676920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab14151430 msgr2=0x7fab1414e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab12ffd640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab14151430 0x7fab1414e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab12ffd640 1 -- 172.21.15.78:0/3671676920 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab040094d0 con 0x7fab140c1eb0 2023-10-14T09:17:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab137fe640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab14151430 0x7fab1414e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:58.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.032+0000 7fab12ffd640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab140c1eb0 0x7fab1406ba80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fab040ab000 tx=0x7fab04019150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:58.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.036+0000 7fab0bfff640 1 -- 172.21.15.78:0/3671676920 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab040b4640 con 0x7fab140c1eb0 2023-10-14T09:17:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.036+0000 7fab0bfff640 1 -- 172.21.15.78:0/3671676920 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab040b47a0 con 0x7fab140c1eb0 2023-10-14T09:17:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.036+0000 7fab0bfff640 1 -- 172.21.15.78:0/3671676920 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab040b4b50 con 0x7fab140c1eb0 2023-10-14T09:17:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.036+0000 7fab1966b640 1 -- 172.21.15.78:0/3671676920 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1414d0e0 con 0x7fab140c1eb0 2023-10-14T09:17:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.036+0000 7fab1966b640 1 -- 172.21.15.78:0/3671676920 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1414d6a0 con 0x7fab140c1eb0 2023-10-14T09:17:58.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.036+0000 7fab1966b640 1 -- 172.21.15.78:0/3671676920 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab14074180 con 0x7fab140c1eb0 2023-10-14T09:17:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.036+0000 7fab0bfff640 1 -- 172.21.15.78:0/3671676920 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fab040b2070 con 0x7fab140c1eb0 2023-10-14T09:17:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.036+0000 7fab0bfff640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7faaf40664d0 0x7faaf4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.036+0000 7fab0bfff640 1 -- 172.21.15.78:0/3671676920 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab0411e090 con 0x7fab140c1eb0 2023-10-14T09:17:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.036+0000 7fab0a7fc640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7faaf40664d0 0x7faaf4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.040+0000 7fab0a7fc640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7faaf40664d0 0x7faaf4068990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fab140ad5a0 tx=0x7faafc00d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:58.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.040+0000 7fab0bfff640 1 -- 172.21.15.78:0/3671676920 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fab040eb630 con 0x7fab140c1eb0 2023-10-14T09:17:58.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 -- 172.21.15.78:0/3671676920 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fab140c71e0 con 0x7fab140c1eb0 2023-10-14T09:17:58.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab0bfff640 1 -- 172.21.15.78:0/3671676920 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fab040b0080 con 0x7fab140c1eb0 2023-10-14T09:17:58.207 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-10-14T09:17:58.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 -- 172.21.15.78:0/3671676920 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7faaf40664d0 msgr2=0x7faaf4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7faaf40664d0 0x7faaf4068990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fab140ad5a0 tx=0x7faafc00d040 comp rx=0 tx=0).stop 2023-10-14T09:17:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 -- 172.21.15.78:0/3671676920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab140c1eb0 msgr2=0x7fab1406ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab140c1eb0 0x7fab1406ba80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fab040ab000 tx=0x7fab04019150 comp rx=0 tx=0).stop 2023-10-14T09:17:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 -- 172.21.15.78:0/3671676920 shutdown_connections 2023-10-14T09:17:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab14151430 0x7fab1414e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab140c4180 0x7fab1414dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7faaf40664d0 0x7faaf4068990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 --2- 172.21.15.78:0/3671676920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab140c1eb0 0x7fab1406ba80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 -- 172.21.15.78:0/3671676920 >> 172.21.15.78:0/3671676920 conn(0x7fab1406a060 msgr2=0x7fab140c76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 -- 172.21.15.78:0/3671676920 shutdown_connections 2023-10-14T09:17:58.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.204+0000 7fab1966b640 1 -- 172.21.15.78:0/3671676920 wait complete. 2023-10-14T09:17:58.229 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi078.front.sepia.ceph.com... 2023-10-14T09:17:58.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:58.229 DEBUG:teuthology.orchestra.run.smithi078:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-14T09:17:58.263 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:17:58.264 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:17:58.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:17:58.265 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T09:17:58.323 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:17:58.323 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:17:58.333 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:17:58.334 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:17:58.382 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:17:58.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd74ad6640 1 Processor -- start 2023-10-14T09:17:58.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd74ad6640 1 -- start start 2023-10-14T09:17:58.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd74ad6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efd700a8360 0x7efd700a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd74ad6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd7006cd70 0x7efd7006d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd74ad6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd70152a60 con 0x7efd7013b050 2023-10-14T09:17:58.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd74ad6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd700a9340 con 0x7efd7006cd70 2023-10-14T09:17:58.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd74ad6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd70151e50 con 0x7efd700a8360 2023-10-14T09:17:58.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd6ed9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd7006cd70 0x7efd7006d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd6ed9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd7006cd70 0x7efd7006d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60472/0 (socket says 172.21.15.78:60472) 2023-10-14T09:17:58.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd6ed9d640 1 -- 172.21.15.78:0/1530784788 learned_addr learned my addr 172.21.15.78:0/1530784788 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:58.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd67fff640 1 --2- 172.21.15.78:0/1530784788 >> v2:172.21.15.157:3300/0 conn(0x7efd700a8360 0x7efd700a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd6ed9d640 1 -- 172.21.15.78:0/1530784788 >> v2:172.21.15.157:3300/0 conn(0x7efd700a8360 msgr2=0x7efd700a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:58.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd6ed9d640 1 --2- 172.21.15.78:0/1530784788 >> v2:172.21.15.157:3300/0 conn(0x7efd700a8360 0x7efd700a87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd6ed9d640 1 -- 172.21.15.78:0/1530784788 >> v1:172.21.15.157:6789/0 conn(0x7efd7013b050 legacy=0x7efd70155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.516+0000 7efd6ed9d640 1 -- 172.21.15.78:0/1530784788 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70152130 con 0x7efd7006cd70 2023-10-14T09:17:58.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd6ed9d640 1 --2- 172.21.15.78:0/1530784788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cd70 0x7efd7006d200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efd7006dec0 tx=0x7efd6801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4df7e992666b08a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:58.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd6dd9b640 1 -- 172.21.15.78:0/1530784788 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680a57d0 con 0x7efd7006cd70 2023-10-14T09:17:58.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd6dd9b640 1 -- 172.21.15.78:0/1530784788 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd680a5930 con 0x7efd7006cd70 2023-10-14T09:17:58.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd6dd9b640 1 -- 172.21.15.78:0/1530784788 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680a5cc0 con 0x7efd7006cd70 2023-10-14T09:17:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd74ad6640 1 -- 172.21.15.78:0/1530784788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cd70 msgr2=0x7efd7006d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd74ad6640 1 --2- 172.21.15.78:0/1530784788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cd70 0x7efd7006d200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efd7006dec0 tx=0x7efd6801c910 comp rx=0 tx=0).stop 2023-10-14T09:17:58.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd74ad6640 1 -- 172.21.15.78:0/1530784788 shutdown_connections 2023-10-14T09:17:58.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd74ad6640 1 --2- 172.21.15.78:0/1530784788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cd70 0x7efd7006d200 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd74ad6640 1 --2- 172.21.15.78:0/1530784788 >> v2:172.21.15.157:3300/0 conn(0x7efd700a8360 0x7efd700a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd74ad6640 1 -- 172.21.15.78:0/1530784788 >> 172.21.15.78:0/1530784788 conn(0x7efd700c1cc0 msgr2=0x7efd700c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:58.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd74ad6640 1 -- 172.21.15.78:0/1530784788 shutdown_connections 2023-10-14T09:17:58.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.520+0000 7efd74ad6640 1 -- 172.21.15.78:0/1530784788 wait complete. 2023-10-14T09:17:58.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd74ad6640 1 Processor -- start 2023-10-14T09:17:58.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd74ad6640 1 -- start start 2023-10-14T09:17:58.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd74ad6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cd70 0x7efd700be570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd74ad6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd700a8360 0x7efd701f0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd74ad6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7013b050 0x7efd701ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd74ad6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd701ed300 con 0x7efd7006cd70 2023-10-14T09:17:58.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd74ad6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd701effe0 con 0x7efd7013b050 2023-10-14T09:17:58.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd74ad6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd700beb50 con 0x7efd700a8360 2023-10-14T09:17:58.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd6e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cd70 0x7efd700be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd6e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cd70 0x7efd700be570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60488/0 (socket says 172.21.15.78:60488) 2023-10-14T09:17:58.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd6e59c640 1 -- 172.21.15.78:0/841689929 learned_addr learned my addr 172.21.15.78:0/841689929 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:58.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd6ed9d640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7013b050 0x7efd701ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd67fff640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd700a8360 0x7efd701f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd6e59c640 1 -- 172.21.15.78:0/841689929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd700a8360 msgr2=0x7efd701f0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd6e59c640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd700a8360 0x7efd701f0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd6e59c640 1 -- 172.21.15.78:0/841689929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7013b050 msgr2=0x7efd701ecdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd6e59c640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7013b050 0x7efd701ecdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd6e59c640 1 -- 172.21.15.78:0/841689929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68009b30 con 0x7efd7006cd70 2023-10-14T09:17:58.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd6ed9d640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7013b050 0x7efd701ecdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:58.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd6e59c640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cd70 0x7efd700be570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c500 tx=0x7efd6000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:58.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd66ffd640 1 -- 172.21.15.78:0/841689929 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60005220 con 0x7efd7006cd70 2023-10-14T09:17:58.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd66ffd640 1 -- 172.21.15.78:0/841689929 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60005380 con 0x7efd7006cd70 2023-10-14T09:17:58.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd66ffd640 1 -- 172.21.15.78:0/841689929 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60007270 con 0x7efd7006cd70 2023-10-14T09:17:58.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd74ad6640 1 -- 172.21.15.78:0/841689929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd700bee30 con 0x7efd7006cd70 2023-10-14T09:17:58.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.524+0000 7efd74ad6640 1 -- 172.21.15.78:0/841689929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd701efc70 con 0x7efd7006cd70 2023-10-14T09:17:58.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.528+0000 7efd74ad6640 1 -- 172.21.15.78:0/841689929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd701efe30 con 0x7efd7006cd70 2023-10-14T09:17:58.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.528+0000 7efd66ffd640 1 -- 172.21.15.78:0/841689929 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efd600073d0 con 0x7efd7006cd70 2023-10-14T09:17:58.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.528+0000 7efd66ffd640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd500664a0 0x7efd50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.528+0000 7efd66ffd640 1 -- 172.21.15.78:0/841689929 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd600837f0 con 0x7efd7006cd70 2023-10-14T09:17:58.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.528+0000 7efd67fff640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd500664a0 0x7efd50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.528+0000 7efd67fff640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd500664a0 0x7efd50068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efd700bf7f0 tx=0x7efd58008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:58.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.532+0000 7efd66ffd640 1 -- 172.21.15.78:0/841689929 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efd60050be0 con 0x7efd7006cd70 2023-10-14T09:17:58.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.684+0000 7efd74ad6640 1 -- 172.21.15.78:0/841689929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd70074180 con 0x7efd7006cd70 2023-10-14T09:17:58.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.684+0000 7efd66ffd640 1 -- 172.21.15.78:0/841689929 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7efd60054200 con 0x7efd7006cd70 2023-10-14T09:17:58.688 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:17:58.689 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:17:58.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 -- 172.21.15.78:0/841689929 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd500664a0 msgr2=0x7efd50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd500664a0 0x7efd50068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efd700bf7f0 tx=0x7efd58008040 comp rx=0 tx=0).stop 2023-10-14T09:17:58.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 -- 172.21.15.78:0/841689929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cd70 msgr2=0x7efd700be570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cd70 0x7efd700be570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c500 tx=0x7efd6000c9c0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 -- 172.21.15.78:0/841689929 shutdown_connections 2023-10-14T09:17:58.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd7013b050 0x7efd701ecdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd500664a0 0x7efd50068960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd700a8360 0x7efd701f0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 --2- 172.21.15.78:0/841689929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7006cd70 0x7efd700be570 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 -- 172.21.15.78:0/841689929 >> 172.21.15.78:0/841689929 conn(0x7efd700c1cc0 msgr2=0x7efd700c07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:58.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 -- 172.21.15.78:0/841689929 shutdown_connections 2023-10-14T09:17:58.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.688+0000 7efd74ad6640 1 -- 172.21.15.78:0/841689929 wait complete. 2023-10-14T09:17:58.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:17:58.710 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:17:58.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a93c4640 1 Processor -- start 2023-10-14T09:17:58.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a93c4640 1 -- start start 2023-10-14T09:17:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a93c4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f87a40c4030 0x7f87a40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a93c4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87a4153d90 0x7f87a41541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a93c4640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a40c7af0 con 0x7f87a406cc50 2023-10-14T09:17:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a93c4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a40c5300 con 0x7f87a40c4030 2023-10-14T09:17:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a93c4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4157360 con 0x7f87a4153d90 2023-10-14T09:17:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a2ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f87a40c4030 0x7f87a40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a2ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f87a40c4030 0x7f87a40c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60494/0 (socket says 172.21.15.78:60494) 2023-10-14T09:17:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a2ffd640 1 -- 172.21.15.78:0/47671016 learned_addr learned my addr 172.21.15.78:0/47671016 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a37fe640 1 --2- 172.21.15.78:0/47671016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87a4153d90 0x7f87a41541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a2ffd640 1 -- 172.21.15.78:0/47671016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87a4153d90 msgr2=0x7f87a41541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a2ffd640 1 --2- 172.21.15.78:0/47671016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87a4153d90 0x7f87a41541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a2ffd640 1 -- 172.21.15.78:0/47671016 >> v1:172.21.15.157:6789/0 conn(0x7f87a406cc50 legacy=0x7f87a40c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a2ffd640 1 -- 172.21.15.78:0/47671016 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a4157ee0 con 0x7f87a40c4030 2023-10-14T09:17:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.848+0000 7f87a37fe640 1 --2- 172.21.15.78:0/47671016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87a4153d90 0x7f87a41541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:17:58.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a2ffd640 1 --2- 172.21.15.78:0/47671016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a40c4030 0x7f87a40c75b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8794009870 tx=0x7f879401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe0c7f7b5503189 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:58.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a27fc640 1 -- 172.21.15.78:0/47671016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940aa610 con 0x7f87a40c4030 2023-10-14T09:17:58.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a27fc640 1 -- 172.21.15.78:0/47671016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87940a6040 con 0x7f87a40c4030 2023-10-14T09:17:58.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a27fc640 1 -- 172.21.15.78:0/47671016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940aa990 con 0x7f87a40c4030 2023-10-14T09:17:58.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a93c4640 1 -- 172.21.15.78:0/47671016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a40c4030 msgr2=0x7f87a40c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a93c4640 1 --2- 172.21.15.78:0/47671016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a40c4030 0x7f87a40c75b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8794009870 tx=0x7f879401c4b0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a93c4640 1 -- 172.21.15.78:0/47671016 shutdown_connections 2023-10-14T09:17:58.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a93c4640 1 --2- 172.21.15.78:0/47671016 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87a4153d90 0x7f87a41541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a93c4640 1 --2- 172.21.15.78:0/47671016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a40c4030 0x7f87a40c75b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a93c4640 1 -- 172.21.15.78:0/47671016 >> 172.21.15.78:0/47671016 conn(0x7f87a40ab240 msgr2=0x7f87a40ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:58.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a93c4640 1 -- 172.21.15.78:0/47671016 shutdown_connections 2023-10-14T09:17:58.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.852+0000 7f87a93c4640 1 -- 172.21.15.78:0/47671016 wait complete. 2023-10-14T09:17:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a93c4640 1 Processor -- start 2023-10-14T09:17:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a93c4640 1 -- start start 2023-10-14T09:17:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a93c4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87a406cc50 0x7f87a40a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a93c4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87a40c4030 0x7f87a40add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a93c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a4153d90 0x7f87a4148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a93c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a40aaa90 con 0x7f87a4153d90 2023-10-14T09:17:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a93c4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a40ab010 con 0x7f87a40c4030 2023-10-14T09:17:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a93c4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a41f0480 con 0x7f87a406cc50 2023-10-14T09:17:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a4153d90 0x7f87a4148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a4153d90 0x7f87a4148840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60504/0 (socket says 172.21.15.78:60504) 2023-10-14T09:17:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a37fe640 1 -- 172.21.15.78:0/2074864515 learned_addr learned my addr 172.21.15.78:0/2074864515 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a2ffd640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87a406cc50 0x7f87a40a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f879a7fc640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87a40c4030 0x7f87a40add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a37fe640 1 -- 172.21.15.78:0/2074864515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87a406cc50 msgr2=0x7f87a40a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a37fe640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87a406cc50 0x7f87a40a9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a37fe640 1 -- 172.21.15.78:0/2074864515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87a40c4030 msgr2=0x7f87a40add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:58.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a37fe640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87a40c4030 0x7f87a40add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:58.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a37fe640 1 -- 172.21.15.78:0/2074864515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87940094d0 con 0x7f87a4153d90 2023-10-14T09:17:58.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a37fe640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a4153d90 0x7f87a4148840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f879c007d40 tx=0x7f879c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:58.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f879bfff640 1 -- 172.21.15.78:0/2074864515 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0039a0 con 0x7f87a4153d90 2023-10-14T09:17:58.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f879bfff640 1 -- 172.21.15.78:0/2074864515 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c00f040 con 0x7f87a4153d90 2023-10-14T09:17:58.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a93c4640 1 -- 172.21.15.78:0/2074864515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a40aad30 con 0x7f87a4153d90 2023-10-14T09:17:58.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f879bfff640 1 -- 172.21.15.78:0/2074864515 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c003d40 con 0x7f87a4153d90 2023-10-14T09:17:58.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.856+0000 7f87a93c4640 1 -- 172.21.15.78:0/2074864515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a40ae270 con 0x7f87a4153d90 2023-10-14T09:17:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.860+0000 7f87a93c4640 1 -- 172.21.15.78:0/2074864515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a4074110 con 0x7f87a4153d90 2023-10-14T09:17:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.860+0000 7f879bfff640 1 -- 172.21.15.78:0/2074864515 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f879c004030 con 0x7f87a4153d90 2023-10-14T09:17:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.860+0000 7f879bfff640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87840664a0 0x7f8784068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.860+0000 7f879bfff640 1 -- 172.21.15.78:0/2074864515 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f879c084030 con 0x7f87a4153d90 2023-10-14T09:17:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.860+0000 7f87a2ffd640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87840664a0 0x7f8784068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.860+0000 7f87a2ffd640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87840664a0 0x7f8784068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f87940ae000 tx=0x7f87940b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:58.864+0000 7f879bfff640 1 -- 172.21.15.78:0/2074864515 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f879c051570 con 0x7f87a4153d90 2023-10-14T09:17:59.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.012+0000 7f87a93c4640 1 -- 172.21.15.78:0/2074864515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87a41ec360 con 0x7f87a4153d90 2023-10-14T09:17:59.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.012+0000 7f879bfff640 1 -- 172.21.15.78:0/2074864515 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f879c054b90 con 0x7f87a4153d90 2023-10-14T09:17:59.017 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:17:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 -- 172.21.15.78:0/2074864515 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87840664a0 msgr2=0x7f8784068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87840664a0 0x7f8784068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f87940ae000 tx=0x7f87940b5040 comp rx=0 tx=0).stop 2023-10-14T09:17:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 -- 172.21.15.78:0/2074864515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a4153d90 msgr2=0x7f87a4148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a4153d90 0x7f87a4148840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f879c007d40 tx=0x7f879c00d4a0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 -- 172.21.15.78:0/2074864515 shutdown_connections 2023-10-14T09:17:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a4153d90 0x7f87a4148840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f87a40c4030 0x7f87a40add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f87840664a0 0x7f8784068960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 --2- 172.21.15.78:0/2074864515 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f87a406cc50 0x7f87a40a9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 -- 172.21.15.78:0/2074864515 >> 172.21.15.78:0/2074864515 conn(0x7f87a40ab240 msgr2=0x7f87a40ab620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 -- 172.21.15.78:0/2074864515 shutdown_connections 2023-10-14T09:17:59.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.016+0000 7f87a93c4640 1 -- 172.21.15.78:0/2074864515 wait complete. 2023-10-14T09:17:59.038 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:17:59.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.176+0000 7fd12f33f640 1 Processor -- start 2023-10-14T09:17:59.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.176+0000 7fd12f33f640 1 -- start start 2023-10-14T09:17:59.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.180+0000 7fd12f33f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd12806c900 0x7fd1280c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.180+0000 7fd12f33f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1280c4360 con 0x7fd1280bcc50 2023-10-14T09:17:59.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.180+0000 7fd12f33f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd128157c20 con 0x7fd1280c6320 2023-10-14T09:17:59.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.180+0000 7fd12f33f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1280c4010 con 0x7fd12806c900 2023-10-14T09:17:59.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.180+0000 7fd12db3c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd1280bcc50 0x7fd128154290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50020/0 (socket says 172.21.15.78:50020) 2023-10-14T09:17:59.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.180+0000 7fd12db3c640 1 -- 172.21.15.78:0/2173761044 learned_addr learned my addr 172.21.15.78:0/2173761044 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:59.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.180+0000 7fd12eb3e640 1 --2- 172.21.15.78:0/2173761044 >> v2:172.21.15.78:3300/0 conn(0x7fd12806c900 0x7fd1280c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.180+0000 7fd12eb3e640 1 -- 172.21.15.78:0/2173761044 >> v1:172.21.15.157:6789/0 conn(0x7fd1280c6320 legacy=0x7fd128153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.180+0000 7fd12eb3e640 1 -- 172.21.15.78:0/2173761044 >> v1:172.21.15.78:6789/0 conn(0x7fd1280bcc50 legacy=0x7fd128154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.180+0000 7fd12eb3e640 1 -- 172.21.15.78:0/2173761044 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128157ec0 con 0x7fd12806c900 2023-10-14T09:17:59.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.180+0000 7fd12d33b640 1 -- 172.21.15.78:0/2173761044 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980755701 0 0) 0x7fd1280c4360 con 0x7fd1280bcc50 2023-10-14T09:17:59.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12eb3e640 1 --2- 172.21.15.78:0/2173761044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd12806c900 0x7fd1280c6700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd120009d90 tx=0x7fd12001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbea2fc168254480 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12d33b640 1 -- 172.21.15.78:0/2173761044 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200a5890 con 0x7fd12806c900 2023-10-14T09:17:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12d33b640 1 -- 172.21.15.78:0/2173761044 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1200a59f0 con 0x7fd12806c900 2023-10-14T09:17:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12d33b640 1 -- 172.21.15.78:0/2173761044 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200a5d80 con 0x7fd12806c900 2023-10-14T09:17:59.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 -- 172.21.15.78:0/2173761044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd12806c900 msgr2=0x7fd1280c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 --2- 172.21.15.78:0/2173761044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd12806c900 0x7fd1280c6700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd120009d90 tx=0x7fd12001c8c0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 -- 172.21.15.78:0/2173761044 shutdown_connections 2023-10-14T09:17:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 --2- 172.21.15.78:0/2173761044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd12806c900 0x7fd1280c6700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 -- 172.21.15.78:0/2173761044 >> 172.21.15.78:0/2173761044 conn(0x7fd128071790 msgr2=0x7fd128071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:59.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 -- 172.21.15.78:0/2173761044 shutdown_connections 2023-10-14T09:17:59.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 -- 172.21.15.78:0/2173761044 wait complete. 2023-10-14T09:17:59.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 Processor -- start 2023-10-14T09:17:59.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 -- start start 2023-10-14T09:17:59.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd12806c900 0x7fd12814fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1280c6320 0x7fd12814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd128155980 0x7fd128155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd128156350 con 0x7fd1280c6320 2023-10-14T09:17:59.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd128153580 con 0x7fd128155980 2023-10-14T09:17:59.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12f33f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd128155210 con 0x7fd12806c900 2023-10-14T09:17:59.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.184+0000 7fd12db3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1280c6320 0x7fd12814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12db3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1280c6320 0x7fd12814e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60520/0 (socket says 172.21.15.78:60520) 2023-10-14T09:17:59.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12db3c640 1 -- 172.21.15.78:0/3731026387 learned_addr learned my addr 172.21.15.78:0/3731026387 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:59.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12eb3e640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd128155980 0x7fd128155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12e33d640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd12806c900 0x7fd12814fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12db3c640 1 -- 172.21.15.78:0/3731026387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd12806c900 msgr2=0x7fd12814fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12db3c640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd12806c900 0x7fd12814fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12db3c640 1 -- 172.21.15.78:0/3731026387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd128155980 msgr2=0x7fd128155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12db3c640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd128155980 0x7fd128155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12db3c640 1 -- 172.21.15.78:0/3731026387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120009a70 con 0x7fd1280c6320 2023-10-14T09:17:59.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12db3c640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1280c6320 0x7fd12814e900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd11800c4d0 tx=0x7fd11800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:59.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd11effd640 1 -- 172.21.15.78:0/3731026387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180074e0 con 0x7fd1280c6320 2023-10-14T09:17:59.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd11effd640 1 -- 172.21.15.78:0/3731026387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118007640 con 0x7fd1280c6320 2023-10-14T09:17:59.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd11effd640 1 -- 172.21.15.78:0/3731026387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118004a30 con 0x7fd1280c6320 2023-10-14T09:17:59.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12f33f640 1 -- 172.21.15.78:0/3731026387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1281554f0 con 0x7fd1280c6320 2023-10-14T09:17:59.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12f33f640 1 -- 172.21.15.78:0/3731026387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1280abd50 con 0x7fd1280c6320 2023-10-14T09:17:59.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd12f33f640 1 -- 172.21.15.78:0/3731026387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd128155680 con 0x7fd1280c6320 2023-10-14T09:17:59.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.188+0000 7fd11effd640 1 -- 172.21.15.78:0/3731026387 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd118004b90 con 0x7fd1280c6320 2023-10-14T09:17:59.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.192+0000 7fd11effd640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd10c0664a0 0x7fd10c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.192+0000 7fd11effd640 1 -- 172.21.15.78:0/3731026387 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd118082eb0 con 0x7fd1280c6320 2023-10-14T09:17:59.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.192+0000 7fd12e33d640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd10c0664a0 0x7fd10c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.192+0000 7fd12e33d640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd10c0664a0 0x7fd10c068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd1280c7cd0 tx=0x7fd124009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:59.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.192+0000 7fd11effd640 1 -- 172.21.15.78:0/3731026387 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd118050470 con 0x7fd1280c6320 2023-10-14T09:17:59.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.344+0000 7fd12f33f640 1 -- 172.21.15.78:0/3731026387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd128074110 con 0x7fd1280c6320 2023-10-14T09:17:59.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.344+0000 7fd11effd640 1 -- 172.21.15.78:0/3731026387 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd118053a90 con 0x7fd1280c6320 2023-10-14T09:17:59.348 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:17:59.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 -- 172.21.15.78:0/3731026387 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd10c0664a0 msgr2=0x7fd10c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd10c0664a0 0x7fd10c068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd1280c7cd0 tx=0x7fd124009040 comp rx=0 tx=0).stop 2023-10-14T09:17:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 -- 172.21.15.78:0/3731026387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1280c6320 msgr2=0x7fd12814e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1280c6320 0x7fd12814e900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd11800c4d0 tx=0x7fd11800c990 comp rx=0 tx=0).stop 2023-10-14T09:17:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 -- 172.21.15.78:0/3731026387 shutdown_connections 2023-10-14T09:17:59.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd128155980 0x7fd128155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1280c6320 0x7fd12814e900 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd10c0664a0 0x7fd10c068960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 --2- 172.21.15.78:0/3731026387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd12806c900 0x7fd12814fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 -- 172.21.15.78:0/3731026387 >> 172.21.15.78:0/3731026387 conn(0x7fd128071790 msgr2=0x7fd128071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:59.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 -- 172.21.15.78:0/3731026387 shutdown_connections 2023-10-14T09:17:59.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.348+0000 7fd12f33f640 1 -- 172.21.15.78:0/3731026387 wait complete. 2023-10-14T09:17:59.369 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:17:59.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.504+0000 7f6d5d405640 1 Processor -- start 2023-10-14T09:17:59.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d5d405640 1 -- start start 2023-10-14T09:17:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d5d405640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6d580c4030 0x7f6d580c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d5d405640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580c7af0 con 0x7f6d58153d90 2023-10-14T09:17:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d5d405640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d58157360 con 0x7f6d5806cc50 2023-10-14T09:17:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d5d405640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580c5300 con 0x7f6d580c4030 2023-10-14T09:17:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d56ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6d580c4030 0x7f6d580c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d577fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6d58153d90 0x7f6d581541a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50036/0 (socket says 172.21.15.78:50036) 2023-10-14T09:17:59.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d577fe640 1 -- 172.21.15.78:0/1793300001 learned_addr learned my addr 172.21.15.78:0/1793300001 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:17:59.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d56ffd640 1 -- 172.21.15.78:0/1793300001 >> v1:172.21.15.157:6789/0 conn(0x7f6d5806cc50 legacy=0x7f6d580c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:59.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d56ffd640 1 -- 172.21.15.78:0/1793300001 >> v1:172.21.15.78:6789/0 conn(0x7f6d58153d90 legacy=0x7f6d581541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d56ffd640 1 -- 172.21.15.78:0/1793300001 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58157ee0 con 0x7f6d580c4030 2023-10-14T09:17:59.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.508+0000 7f6d567fc640 1 -- 172.21.15.78:0/1793300001 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536683967 0 0) 0x7f6d580c7af0 con 0x7f6d58153d90 2023-10-14T09:17:59.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d56ffd640 1 --2- 172.21.15.78:0/1793300001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d580c4030 0x7f6d580c75b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6d400097c0 tx=0x7f6d4001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814ea04d9cc44f15 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:59.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d567fc640 1 -- 172.21.15.78:0/1793300001 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d400ac410 con 0x7f6d580c4030 2023-10-14T09:17:59.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d567fc640 1 -- 172.21.15.78:0/1793300001 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d400ac570 con 0x7f6d580c4030 2023-10-14T09:17:59.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d567fc640 1 -- 172.21.15.78:0/1793300001 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d400ac900 con 0x7f6d580c4030 2023-10-14T09:17:59.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d5d405640 1 -- 172.21.15.78:0/1793300001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d580c4030 msgr2=0x7f6d580c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d5d405640 1 --2- 172.21.15.78:0/1793300001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d580c4030 0x7f6d580c75b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6d400097c0 tx=0x7f6d4001c3b0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d5d405640 1 -- 172.21.15.78:0/1793300001 shutdown_connections 2023-10-14T09:17:59.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d5d405640 1 --2- 172.21.15.78:0/1793300001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d580c4030 0x7f6d580c75b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d5d405640 1 -- 172.21.15.78:0/1793300001 >> 172.21.15.78:0/1793300001 conn(0x7f6d580ab240 msgr2=0x7f6d580ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:59.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d5d405640 1 -- 172.21.15.78:0/1793300001 shutdown_connections 2023-10-14T09:17:59.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d5d405640 1 -- 172.21.15.78:0/1793300001 wait complete. 2023-10-14T09:17:59.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d5d405640 1 Processor -- start 2023-10-14T09:17:59.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.512+0000 7f6d5d405640 1 -- start start 2023-10-14T09:17:59.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d5d405640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d5806cc50 0x7f6d580c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d5d405640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d580c4030 0x7f6d58146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d5d405640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d58153d90 0x7f6d58147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d5d405640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58150290 con 0x7f6d5806cc50 2023-10-14T09:17:59.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d5d405640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58147540 con 0x7f6d58153d90 2023-10-14T09:17:59.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d5d405640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580aa840 con 0x7f6d580c4030 2023-10-14T09:17:59.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d56ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d5806cc50 0x7f6d580c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d56ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d5806cc50 0x7f6d580c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60526/0 (socket says 172.21.15.78:60526) 2023-10-14T09:17:59.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d56ffd640 1 -- 172.21.15.78:0/1629341280 learned_addr learned my addr 172.21.15.78:0/1629341280 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:59.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d56ffd640 1 -- 172.21.15.78:0/1629341280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d580c4030 msgr2=0x7f6d58146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d56ffd640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d580c4030 0x7f6d58146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d56ffd640 1 -- 172.21.15.78:0/1629341280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d58153d90 msgr2=0x7f6d58147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d56ffd640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d58153d90 0x7f6d58147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d56ffd640 1 -- 172.21.15.78:0/1629341280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d40009420 con 0x7f6d5806cc50 2023-10-14T09:17:59.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d56ffd640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d5806cc50 0x7f6d580c7fe0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6d400af040 tx=0x7f6d40019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:59.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d4ffff640 1 -- 172.21.15.78:0/1629341280 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40006e20 con 0x7f6d5806cc50 2023-10-14T09:17:59.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d4ffff640 1 -- 172.21.15.78:0/1629341280 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d400b5620 con 0x7f6d5806cc50 2023-10-14T09:17:59.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d5d405640 1 -- 172.21.15.78:0/1629341280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d580ab050 con 0x7f6d5806cc50 2023-10-14T09:17:59.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d4ffff640 1 -- 172.21.15.78:0/1629341280 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d400b59d0 con 0x7f6d5806cc50 2023-10-14T09:17:59.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d5d405640 1 -- 172.21.15.78:0/1629341280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d580aaa90 con 0x7f6d5806cc50 2023-10-14T09:17:59.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d5d405640 1 -- 172.21.15.78:0/1629341280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d58074110 con 0x7f6d5806cc50 2023-10-14T09:17:59.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.516+0000 7f6d4ffff640 1 -- 172.21.15.78:0/1629341280 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6d400b3040 con 0x7f6d5806cc50 2023-10-14T09:17:59.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.520+0000 7f6d4ffff640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6d380664a0 0x7f6d38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.520+0000 7f6d4ffff640 1 -- 172.21.15.78:0/1629341280 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d4011dff0 con 0x7f6d5806cc50 2023-10-14T09:17:59.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.520+0000 7f6d4e7fc640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6d380664a0 0x7f6d38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.520+0000 7f6d4e7fc640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6d380664a0 0x7f6d38068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d48007fd0 tx=0x7f6d480079a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:59.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.524+0000 7f6d4ffff640 1 -- 172.21.15.78:0/1629341280 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6d400eb4e0 con 0x7f6d5806cc50 2023-10-14T09:17:59.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.672+0000 7f6d5d405640 1 -- 172.21.15.78:0/1629341280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d580c7040 con 0x7f6d5806cc50 2023-10-14T09:17:59.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.672+0000 7f6d4ffff640 1 -- 172.21.15.78:0/1629341280 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d400eeb00 con 0x7f6d5806cc50 2023-10-14T09:17:59.676 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:17:59.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.672+0000 7f6d5d405640 1 -- 172.21.15.78:0/1629341280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6d380664a0 msgr2=0x7f6d38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.672+0000 7f6d5d405640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6d380664a0 0x7f6d38068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d48007fd0 tx=0x7f6d480079a0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.672+0000 7f6d5d405640 1 -- 172.21.15.78:0/1629341280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d5806cc50 msgr2=0x7f6d580c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.672+0000 7f6d5d405640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d5806cc50 0x7f6d580c7fe0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6d400af040 tx=0x7f6d40019150 comp rx=0 tx=0).stop 2023-10-14T09:17:59.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.672+0000 7f6d5d405640 1 -- 172.21.15.78:0/1629341280 shutdown_connections 2023-10-14T09:17:59.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.676+0000 7f6d5d405640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d58153d90 0x7f6d58147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.676+0000 7f6d5d405640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6d380664a0 0x7f6d38068960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.676+0000 7f6d5d405640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6d580c4030 0x7f6d58146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.676+0000 7f6d5d405640 1 --2- 172.21.15.78:0/1629341280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d5806cc50 0x7f6d580c7fe0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.676+0000 7f6d5d405640 1 -- 172.21.15.78:0/1629341280 >> 172.21.15.78:0/1629341280 conn(0x7f6d580ab240 msgr2=0x7f6d580ab620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:59.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.676+0000 7f6d5d405640 1 -- 172.21.15.78:0/1629341280 shutdown_connections 2023-10-14T09:17:59.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.676+0000 7f6d5d405640 1 -- 172.21.15.78:0/1629341280 wait complete. 2023-10-14T09:17:59.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T09:17:59.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb619da7640 1 Processor -- start 2023-10-14T09:17:59.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb619da7640 1 -- start start 2023-10-14T09:17:59.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb619da7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb614151200 0x7fb6140c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb619da7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6140c73b0 0x7fb614153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb619da7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6141515e0 con 0x7fb6140c4370 2023-10-14T09:17:59.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb619da7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb614157b60 con 0x7fb614151200 2023-10-14T09:17:59.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb619da7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb614157d60 con 0x7fb6140c73b0 2023-10-14T09:17:59.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb60bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6140c73b0 0x7fb614153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb618da5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb614151200 0x7fb6140c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb60bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6140c73b0 0x7fb614153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:36442/0 (socket says 172.21.15.78:36442) 2023-10-14T09:17:59.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb618da5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb614151200 0x7fb6140c3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:39508/0 (socket says 172.21.15.78:39508) 2023-10-14T09:17:59.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb60bfff640 1 -- 172.21.15.78:0/2507039769 learned_addr learned my addr 172.21.15.78:0/2507039769 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:59.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb60b7fe640 1 -- 172.21.15.78:0/2507039769 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867069587 0 0) 0x7fb6141515e0 con 0x7fb6140c4370 2023-10-14T09:17:59.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb60b7fe640 1 -- 172.21.15.78:0/2507039769 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5fc003530 con 0x7fb6140c4370 2023-10-14T09:17:59.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb60bfff640 1 -- 172.21.15.78:0/2507039769 >> v2:172.21.15.157:3300/0 conn(0x7fb614151200 msgr2=0x7fb6140c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:17:59.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb60bfff640 1 --2- 172.21.15.78:0/2507039769 >> v2:172.21.15.157:3300/0 conn(0x7fb614151200 0x7fb6140c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb60bfff640 1 -- 172.21.15.78:0/2507039769 >> v1:172.21.15.157:6789/0 conn(0x7fb6140c4370 legacy=0x7fb614154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb60bfff640 1 -- 172.21.15.78:0/2507039769 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140c64c0 con 0x7fb6140c73b0 2023-10-14T09:17:59.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.832+0000 7fb618da5640 1 --2- 172.21.15.78:0/2507039769 >> v2:172.21.15.157:3300/0 conn(0x7fb614151200 0x7fb6140c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:17:59.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb60bfff640 1 --2- 172.21.15.78:0/2507039769 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6140c73b0 0x7fb614153bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb604009870 tx=0x7fb60401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0b003d604da4fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:59.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb60b7fe640 1 -- 172.21.15.78:0/2507039769 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040ab600 con 0x7fb6140c73b0 2023-10-14T09:17:59.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb60b7fe640 1 -- 172.21.15.78:0/2507039769 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6040a7050 con 0x7fb6140c73b0 2023-10-14T09:17:59.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb60b7fe640 1 -- 172.21.15.78:0/2507039769 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040ab980 con 0x7fb6140c73b0 2023-10-14T09:17:59.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb619da7640 1 -- 172.21.15.78:0/2507039769 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6140c73b0 msgr2=0x7fb614153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb619da7640 1 --2- 172.21.15.78:0/2507039769 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6140c73b0 0x7fb614153bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb604009870 tx=0x7fb60401c420 comp rx=0 tx=0).stop 2023-10-14T09:17:59.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb619da7640 1 -- 172.21.15.78:0/2507039769 shutdown_connections 2023-10-14T09:17:59.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb619da7640 1 --2- 172.21.15.78:0/2507039769 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb6140c73b0 0x7fb614153bc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb619da7640 1 --2- 172.21.15.78:0/2507039769 >> v2:172.21.15.157:3300/0 conn(0x7fb614151200 0x7fb6140c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb619da7640 1 -- 172.21.15.78:0/2507039769 >> 172.21.15.78:0/2507039769 conn(0x7fb6140719c0 msgr2=0x7fb614071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:17:59.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb619da7640 1 -- 172.21.15.78:0/2507039769 shutdown_connections 2023-10-14T09:17:59.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.836+0000 7fb619da7640 1 -- 172.21.15.78:0/2507039769 wait complete. 2023-10-14T09:17:59.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb619da7640 1 Processor -- start 2023-10-14T09:17:59.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb619da7640 1 -- start start 2023-10-14T09:17:59.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb619da7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6140c4370 0x7fb6141ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb619da7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6140c73b0 0x7fb6140ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb619da7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb614151200 0x7fb6140c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb619da7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140bf690 con 0x7fb6140c4370 2023-10-14T09:17:59.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb619da7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140bf0d0 con 0x7fb6140c73b0 2023-10-14T09:17:59.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb619da7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140bf3b0 con 0x7fb614151200 2023-10-14T09:17:59.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb618da5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6140c4370 0x7fb6141ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb618da5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6140c4370 0x7fb6141ec6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60528/0 (socket says 172.21.15.78:60528) 2023-10-14T09:17:59.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb618da5640 1 -- 172.21.15.78:0/2380344593 learned_addr learned my addr 172.21.15.78:0/2380344593 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:17:59.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb618da5640 1 -- 172.21.15.78:0/2380344593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb614151200 msgr2=0x7fb6140c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb618da5640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb614151200 0x7fb6140c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb618da5640 1 -- 172.21.15.78:0/2380344593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6140c73b0 msgr2=0x7fb6140ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:17:59.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb618da5640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6140c73b0 0x7fb6140ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:17:59.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb618da5640 1 -- 172.21.15.78:0/2380344593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610009420 con 0x7fb6140c4370 2023-10-14T09:17:59.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb618da5640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6140c4370 0x7fb6141ec6c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb61000e980 tx=0x7fb61000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:59.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb6097fa640 1 -- 172.21.15.78:0/2380344593 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000ca00 con 0x7fb6140c4370 2023-10-14T09:17:59.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb6097fa640 1 -- 172.21.15.78:0/2380344593 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61000cb60 con 0x7fb6140c4370 2023-10-14T09:17:59.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb619da7640 1 -- 172.21.15.78:0/2380344593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6040094d0 con 0x7fb6140c4370 2023-10-14T09:17:59.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb6097fa640 1 -- 172.21.15.78:0/2380344593 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61000ced0 con 0x7fb6140c4370 2023-10-14T09:17:59.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.840+0000 7fb619da7640 1 -- 172.21.15.78:0/2380344593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6140c90b0 con 0x7fb6140c4370 2023-10-14T09:17:59.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.844+0000 7fb619da7640 1 -- 172.21.15.78:0/2380344593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6140679c0 con 0x7fb6140c4370 2023-10-14T09:17:59.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.844+0000 7fb6097fa640 1 -- 172.21.15.78:0/2380344593 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb610013470 con 0x7fb6140c4370 2023-10-14T09:17:59.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.844+0000 7fb6097fa640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb6000664a0 0x7fb600068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:17:59.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.844+0000 7fb6097fa640 1 -- 172.21.15.78:0/2380344593 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6100840a0 con 0x7fb6140c4370 2023-10-14T09:17:59.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.844+0000 7fb60bfff640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb6000664a0 0x7fb600068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:17:59.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.844+0000 7fb60bfff640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb6000664a0 0x7fb600068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb6040ad000 tx=0x7fb604004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:17:59.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:17:59.848+0000 7fb6097fa640 1 -- 172.21.15.78:0/2380344593 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb6100515b0 con 0x7fb6140c4370 2023-10-14T09:18:00.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.012+0000 7fb619da7640 1 -- 172.21.15.78:0/2380344593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb61404e9c0 con 0x7fb6140c4370 2023-10-14T09:18:00.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.012+0000 7fb6097fa640 1 -- 172.21.15.78:0/2380344593 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb610054bd0 con 0x7fb6140c4370 2023-10-14T09:18:00.016 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-10-14T09:18:00.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 -- 172.21.15.78:0/2380344593 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb6000664a0 msgr2=0x7fb600068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb6000664a0 0x7fb600068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb6040ad000 tx=0x7fb604004740 comp rx=0 tx=0).stop 2023-10-14T09:18:00.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 -- 172.21.15.78:0/2380344593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6140c4370 msgr2=0x7fb6141ec6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6140c4370 0x7fb6141ec6c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb61000e980 tx=0x7fb61000ee40 comp rx=0 tx=0).stop 2023-10-14T09:18:00.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 -- 172.21.15.78:0/2380344593 shutdown_connections 2023-10-14T09:18:00.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb6000664a0 0x7fb600068960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb614151200 0x7fb6140c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6140c73b0 0x7fb6140ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 --2- 172.21.15.78:0/2380344593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6140c4370 0x7fb6141ec6c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 -- 172.21.15.78:0/2380344593 >> 172.21.15.78:0/2380344593 conn(0x7fb6140719c0 msgr2=0x7fb614154f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:00.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 -- 172.21.15.78:0/2380344593 shutdown_connections 2023-10-14T09:18:00.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.016+0000 7fb619da7640 1 -- 172.21.15.78:0/2380344593 wait complete. 2023-10-14T09:18:00.037 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:18:00.037 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:18:00.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:18:00.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68dd409640 1 Processor -- start 2023-10-14T09:18:00.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68dd409640 1 -- start start 2023-10-14T09:18:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68dd409640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f68d814ddb0 0x7f68d80c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68dd409640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f68d80c6910 0x7f68d80c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68dd409640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d806c470 con 0x7f68d8153e80 2023-10-14T09:18:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68dd409640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d80c64f0 con 0x7f68d80c6910 2023-10-14T09:18:00.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68dd409640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d80c5300 con 0x7f68d814ddb0 2023-10-14T09:18:00.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68d77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f68d80c6910 0x7f68d80c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68d77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f68d80c6910 0x7f68d80c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60534/0 (socket says 172.21.15.78:60534) 2023-10-14T09:18:00.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68d77fe640 1 -- 172.21.15.78:0/4144119146 learned_addr learned my addr 172.21.15.78:0/4144119146 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:00.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68d6ffd640 1 --2- 172.21.15.78:0/4144119146 >> v2:172.21.15.157:3300/0 conn(0x7f68d814ddb0 0x7f68d80c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68d77fe640 1 -- 172.21.15.78:0/4144119146 >> v2:172.21.15.157:3300/0 conn(0x7f68d814ddb0 msgr2=0x7f68d80c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:00.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68d77fe640 1 --2- 172.21.15.78:0/4144119146 >> v2:172.21.15.157:3300/0 conn(0x7f68d814ddb0 0x7f68d80c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68d77fe640 1 -- 172.21.15.78:0/4144119146 >> v1:172.21.15.78:6789/0 conn(0x7f68d8153e80 legacy=0x7f68d806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68d77fe640 1 -- 172.21.15.78:0/4144119146 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d806c750 con 0x7f68d80c6910 2023-10-14T09:18:00.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.184+0000 7f68d67fc640 1 -- 172.21.15.78:0/4144119146 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290776091 0 0) 0x7f68d806c470 con 0x7f68d8153e80 2023-10-14T09:18:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68d77fe640 1 --2- 172.21.15.78:0/4144119146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68d80c6910 0x7f68d80c3fe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f68d80a8d80 tx=0x7f68d001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace4afff802d5ce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68d67fc640 1 -- 172.21.15.78:0/4144119146 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00ab600 con 0x7f68d80c6910 2023-10-14T09:18:00.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68d67fc640 1 -- 172.21.15.78:0/4144119146 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d00a7050 con 0x7f68d80c6910 2023-10-14T09:18:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68d67fc640 1 -- 172.21.15.78:0/4144119146 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00ab980 con 0x7f68d80c6910 2023-10-14T09:18:00.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68dd409640 1 -- 172.21.15.78:0/4144119146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68d80c6910 msgr2=0x7f68d80c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68dd409640 1 --2- 172.21.15.78:0/4144119146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68d80c6910 0x7f68d80c3fe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f68d80a8d80 tx=0x7f68d001c3e0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68dd409640 1 -- 172.21.15.78:0/4144119146 shutdown_connections 2023-10-14T09:18:00.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68dd409640 1 --2- 172.21.15.78:0/4144119146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68d80c6910 0x7f68d80c3fe0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68dd409640 1 --2- 172.21.15.78:0/4144119146 >> v2:172.21.15.157:3300/0 conn(0x7f68d814ddb0 0x7f68d80c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68dd409640 1 -- 172.21.15.78:0/4144119146 >> 172.21.15.78:0/4144119146 conn(0x7f68d80ab1f0 msgr2=0x7f68d80ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68dd409640 1 -- 172.21.15.78:0/4144119146 shutdown_connections 2023-10-14T09:18:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.188+0000 7f68dd409640 1 -- 172.21.15.78:0/4144119146 wait complete. 2023-10-14T09:18:00.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68dd409640 1 Processor -- start 2023-10-14T09:18:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68dd409640 1 -- start start 2023-10-14T09:18:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68dd409640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d80c6910 0x7f68d8150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68dd409640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d814ddb0 0x7f68d814bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68dd409640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68d8153e80 0x7f68d814b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68dd409640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d814f690 con 0x7f68d8153e80 2023-10-14T09:18:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68dd409640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d814f970 con 0x7f68d814ddb0 2023-10-14T09:18:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68dd409640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d814fc50 con 0x7f68d80c6910 2023-10-14T09:18:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68d77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68d8153e80 0x7f68d814b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68d77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68d8153e80 0x7f68d814b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60538/0 (socket says 172.21.15.78:60538) 2023-10-14T09:18:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68d77fe640 1 -- 172.21.15.78:0/941136402 learned_addr learned my addr 172.21.15.78:0/941136402 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68d6ffd640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d80c6910 0x7f68d8150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68ce7fc640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d814ddb0 0x7f68d814bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68d77fe640 1 -- 172.21.15.78:0/941136402 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d80c6910 msgr2=0x7f68d8150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68d77fe640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d80c6910 0x7f68d8150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68d77fe640 1 -- 172.21.15.78:0/941136402 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d814ddb0 msgr2=0x7f68d814bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68d77fe640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d814ddb0 0x7f68d814bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68d77fe640 1 -- 172.21.15.78:0/941136402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00094d0 con 0x7f68d8153e80 2023-10-14T09:18:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68ce7fc640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d814ddb0 0x7f68d814bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68d77fe640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68d8153e80 0x7f68d814b220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68d00ae040 tx=0x7f68d0019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68cffff640 1 -- 172.21.15.78:0/941136402 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00b4410 con 0x7f68d8153e80 2023-10-14T09:18:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68cffff640 1 -- 172.21.15.78:0/941136402 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d00b4570 con 0x7f68d8153e80 2023-10-14T09:18:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68cffff640 1 -- 172.21.15.78:0/941136402 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00b4920 con 0x7f68d8153e80 2023-10-14T09:18:00.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68dd409640 1 -- 172.21.15.78:0/941136402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d814ff30 con 0x7f68d8153e80 2023-10-14T09:18:00.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.192+0000 7f68dd409640 1 -- 172.21.15.78:0/941136402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d81504f0 con 0x7f68d8153e80 2023-10-14T09:18:00.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.196+0000 7f68dd409640 1 -- 172.21.15.78:0/941136402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d81506b0 con 0x7f68d8153e80 2023-10-14T09:18:00.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.196+0000 7f68cffff640 1 -- 172.21.15.78:0/941136402 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f68d00b2040 con 0x7f68d8153e80 2023-10-14T09:18:00.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.196+0000 7f68cffff640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f68b80664a0 0x7f68b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.196+0000 7f68cffff640 1 -- 172.21.15.78:0/941136402 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68d011cf20 con 0x7f68d8153e80 2023-10-14T09:18:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.196+0000 7f68d6ffd640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f68b80664a0 0x7f68b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.196+0000 7f68d6ffd640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f68b80664a0 0x7f68b8068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f68c80113e0 tx=0x7f68c800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.200+0000 7f68cffff640 1 -- 172.21.15.78:0/941136402 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f68d00ea3c0 con 0x7f68d8153e80 2023-10-14T09:18:00.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 -- 172.21.15.78:0/941136402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68d8074180 con 0x7f68d8153e80 2023-10-14T09:18:00.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68cffff640 1 -- 172.21.15.78:0/941136402 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f68d00bc020 con 0x7f68d8153e80 2023-10-14T09:18:00.359 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:00.359 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:18:00.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 -- 172.21.15.78:0/941136402 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f68b80664a0 msgr2=0x7f68b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f68b80664a0 0x7f68b8068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f68c80113e0 tx=0x7f68c800b040 comp rx=0 tx=0).stop 2023-10-14T09:18:00.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 -- 172.21.15.78:0/941136402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68d8153e80 msgr2=0x7f68d814b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68d8153e80 0x7f68d814b220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f68d00ae040 tx=0x7f68d0019180 comp rx=0 tx=0).stop 2023-10-14T09:18:00.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 -- 172.21.15.78:0/941136402 shutdown_connections 2023-10-14T09:18:00.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68d8153e80 0x7f68d814b220 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f68d814ddb0 0x7f68d814bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f68b80664a0 0x7f68b8068960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 --2- 172.21.15.78:0/941136402 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68d80c6910 0x7f68d8150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 -- 172.21.15.78:0/941136402 >> 172.21.15.78:0/941136402 conn(0x7f68d80ab1f0 msgr2=0x7f68d80a9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:00.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 -- 172.21.15.78:0/941136402 shutdown_connections 2023-10-14T09:18:00.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.356+0000 7f68dd409640 1 -- 172.21.15.78:0/941136402 wait complete. 2023-10-14T09:18:00.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:18:00.381 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:18:00.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa5354c9640 1 Processor -- start 2023-10-14T09:18:00.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa5354c9640 1 -- start start 2023-10-14T09:18:00.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa5354c9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa530150ac0 0x7fa530150f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa5354c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa530151fd0 con 0x7fa530139dc0 2023-10-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa5354c9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa530153e40 con 0x7fa5301532c0 2023-10-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa5354c9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5300702c0 con 0x7fa530150ac0 2023-10-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa52effd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa530139dc0 0x7fa5300718a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50054/0 (socket says 172.21.15.78:50054) 2023-10-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa52effd640 1 -- 172.21.15.78:0/3815301570 learned_addr learned my addr 172.21.15.78:0/3815301570 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:00.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa5267fc640 1 --2- 172.21.15.78:0/3815301570 >> v2:172.21.15.157:3300/0 conn(0x7fa530150ac0 0x7fa530150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa52e7fc640 1 -- 172.21.15.78:0/3815301570 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513759014 0 0) 0x7fa530151fd0 con 0x7fa530139dc0 2023-10-14T09:18:00.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa52e7fc640 1 -- 172.21.15.78:0/3815301570 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa51c003530 con 0x7fa530139dc0 2023-10-14T09:18:00.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa52e7fc640 1 -- 172.21.15.78:0/3815301570 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2676017307 0 0) 0x7fa51c003530 con 0x7fa530139dc0 2023-10-14T09:18:00.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa5267fc640 1 -- 172.21.15.78:0/3815301570 >> v1:172.21.15.157:6789/0 conn(0x7fa5301532c0 legacy=0x7fa530153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa5267fc640 1 -- 172.21.15.78:0/3815301570 >> v1:172.21.15.78:6789/0 conn(0x7fa530139dc0 legacy=0x7fa5300718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.520+0000 7fa5267fc640 1 -- 172.21.15.78:0/3815301570 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa530152220 con 0x7fa530150ac0 2023-10-14T09:18:00.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa5267fc640 1 --2- 172.21.15.78:0/3815301570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa530150ac0 0x7fa530150f40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5180097c0 tx=0x7fa51801c1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acf06d110551f87f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:00.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa52e7fc640 1 -- 172.21.15.78:0/3815301570 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa520001680 con 0x7fa530150ac0 2023-10-14T09:18:00.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa52e7fc640 1 -- 172.21.15.78:0/3815301570 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5180a7050 con 0x7fa530150ac0 2023-10-14T09:18:00.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa52e7fc640 1 -- 172.21.15.78:0/3815301570 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5180ab620 con 0x7fa530150ac0 2023-10-14T09:18:00.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa5354c9640 1 -- 172.21.15.78:0/3815301570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa530150ac0 msgr2=0x7fa530150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa5354c9640 1 --2- 172.21.15.78:0/3815301570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa530150ac0 0x7fa530150f40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5180097c0 tx=0x7fa51801c1c0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa5354c9640 1 -- 172.21.15.78:0/3815301570 shutdown_connections 2023-10-14T09:18:00.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa5354c9640 1 --2- 172.21.15.78:0/3815301570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa530150ac0 0x7fa530150f40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa5354c9640 1 -- 172.21.15.78:0/3815301570 >> 172.21.15.78:0/3815301570 conn(0x7fa5300c1d00 msgr2=0x7fa5300c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:00.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa5354c9640 1 -- 172.21.15.78:0/3815301570 shutdown_connections 2023-10-14T09:18:00.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa5354c9640 1 -- 172.21.15.78:0/3815301570 wait complete. 2023-10-14T09:18:00.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.524+0000 7fa5354c9640 1 Processor -- start 2023-10-14T09:18:00.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5354c9640 1 -- start start 2023-10-14T09:18:00.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5354c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa530139dc0 0x7fa530133cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5354c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa530150ac0 0x7fa5300bb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5354c9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5301532c0 0x7fa5300bb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5354c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa530152ea0 con 0x7fa530150ac0 2023-10-14T09:18:00.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5354c9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300bbe10 con 0x7fa5301532c0 2023-10-14T09:18:00.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5354c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300c4080 con 0x7fa530139dc0 2023-10-14T09:18:00.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa530150ac0 0x7fa5300bb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5267fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa530150ac0 0x7fa5300bb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60548/0 (socket says 172.21.15.78:60548) 2023-10-14T09:18:00.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5267fc640 1 -- 172.21.15.78:0/56314626 learned_addr learned my addr 172.21.15.78:0/56314626 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:00.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa52effd640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa530139dc0 0x7fa530133cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa52f7fe640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5301532c0 0x7fa5300bb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5267fc640 1 -- 172.21.15.78:0/56314626 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa530139dc0 msgr2=0x7fa530133cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5267fc640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa530139dc0 0x7fa530133cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5267fc640 1 -- 172.21.15.78:0/56314626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5301532c0 msgr2=0x7fa5300bb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5267fc640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5301532c0 0x7fa5300bb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5267fc640 1 -- 172.21.15.78:0/56314626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa518009420 con 0x7fa530150ac0 2023-10-14T09:18:00.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa52f7fe640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5301532c0 0x7fa5300bb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:00.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5267fc640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa530150ac0 0x7fa5300bb390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa5180097c0 tx=0x7fa51801aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:00.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa527fff640 1 -- 172.21.15.78:0/56314626 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5180abd80 con 0x7fa530150ac0 2023-10-14T09:18:00.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa527fff640 1 -- 172.21.15.78:0/56314626 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa518004020 con 0x7fa530150ac0 2023-10-14T09:18:00.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa527fff640 1 -- 172.21.15.78:0/56314626 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5180043d0 con 0x7fa530150ac0 2023-10-14T09:18:00.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5354c9640 1 -- 172.21.15.78:0/56314626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5300c4360 con 0x7fa530150ac0 2023-10-14T09:18:00.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5354c9640 1 -- 172.21.15.78:0/56314626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5300c4920 con 0x7fa530150ac0 2023-10-14T09:18:00.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.528+0000 7fa5354c9640 1 -- 172.21.15.78:0/56314626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa530074110 con 0x7fa530150ac0 2023-10-14T09:18:00.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.532+0000 7fa527fff640 1 -- 172.21.15.78:0/56314626 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa518003620 con 0x7fa530150ac0 2023-10-14T09:18:00.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.532+0000 7fa527fff640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5100664a0 0x7fa510068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.532+0000 7fa527fff640 1 -- 172.21.15.78:0/56314626 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa51811e050 con 0x7fa530150ac0 2023-10-14T09:18:00.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.532+0000 7fa52effd640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5100664a0 0x7fa510068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.532+0000 7fa52effd640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5100664a0 0x7fa510068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa520000f70 tx=0x7fa520001e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:00.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.536+0000 7fa527fff640 1 -- 172.21.15.78:0/56314626 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5180eb5f0 con 0x7fa530150ac0 2023-10-14T09:18:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.684+0000 7fa5354c9640 1 -- 172.21.15.78:0/56314626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5300c0030 con 0x7fa530150ac0 2023-10-14T09:18:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.684+0000 7fa527fff640 1 -- 172.21.15.78:0/56314626 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5180eec10 con 0x7fa530150ac0 2023-10-14T09:18:00.689 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:18:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 -- 172.21.15.78:0/56314626 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5100664a0 msgr2=0x7fa510068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5100664a0 0x7fa510068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa520000f70 tx=0x7fa520001e30 comp rx=0 tx=0).stop 2023-10-14T09:18:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 -- 172.21.15.78:0/56314626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa530150ac0 msgr2=0x7fa5300bb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa530150ac0 0x7fa5300bb390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa5180097c0 tx=0x7fa51801aa00 comp rx=0 tx=0).stop 2023-10-14T09:18:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 -- 172.21.15.78:0/56314626 shutdown_connections 2023-10-14T09:18:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5301532c0 0x7fa5300bb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa530150ac0 0x7fa5300bb390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa5100664a0 0x7fa510068960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 --2- 172.21.15.78:0/56314626 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa530139dc0 0x7fa530133cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 -- 172.21.15.78:0/56314626 >> 172.21.15.78:0/56314626 conn(0x7fa5300c1d00 msgr2=0x7fa53014eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 -- 172.21.15.78:0/56314626 shutdown_connections 2023-10-14T09:18:00.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.688+0000 7fa5354c9640 1 -- 172.21.15.78:0/56314626 wait complete. 2023-10-14T09:18:00.710 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:18:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa1a12a640 1 Processor -- start 2023-10-14T09:18:00.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa1a12a640 1 -- start start 2023-10-14T09:18:00.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa1a12a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffa140c4030 0x7ffa140c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa1a12a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1406cc50 0x7ffa140c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa1a12a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa14153d90 0x7ffa141541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa1a12a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa140c5300 con 0x7ffa14153d90 2023-10-14T09:18:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa1a12a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa140c7af0 con 0x7ffa140c4030 2023-10-14T09:18:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa1a12a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14157360 con 0x7ffa1406cc50 2023-10-14T09:18:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa13fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa14153d90 0x7ffa141541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa13fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa14153d90 0x7ffa141541e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60564/0 (socket says 172.21.15.78:60564) 2023-10-14T09:18:00.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa13fff640 1 -- 172.21.15.78:0/693245058 learned_addr learned my addr 172.21.15.78:0/693245058 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:00.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa137fe640 1 --2- 172.21.15.78:0/693245058 >> v2:172.21.15.157:3300/0 conn(0x7ffa140c4030 0x7ffa140c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa12ffd640 1 --2- 172.21.15.78:0/693245058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1406cc50 0x7ffa140c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa13fff640 1 -- 172.21.15.78:0/693245058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1406cc50 msgr2=0x7ffa140c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa13fff640 1 --2- 172.21.15.78:0/693245058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1406cc50 0x7ffa140c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa13fff640 1 -- 172.21.15.78:0/693245058 >> v2:172.21.15.157:3300/0 conn(0x7ffa140c4030 msgr2=0x7ffa140c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa13fff640 1 --2- 172.21.15.78:0/693245058 >> v2:172.21.15.157:3300/0 conn(0x7ffa140c4030 0x7ffa140c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.848+0000 7ffa13fff640 1 -- 172.21.15.78:0/693245058 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14157ee0 con 0x7ffa14153d90 2023-10-14T09:18:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa13fff640 1 --2- 172.21.15.78:0/693245058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa14153d90 0x7ffa141541e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa140c6da0 tx=0x7ffa0c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167648df057b8627 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa127fc640 1 -- 172.21.15.78:0/693245058 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0a56d0 con 0x7ffa14153d90 2023-10-14T09:18:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa127fc640 1 -- 172.21.15.78:0/693245058 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0a5830 con 0x7ffa14153d90 2023-10-14T09:18:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa127fc640 1 -- 172.21.15.78:0/693245058 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0a5bc0 con 0x7ffa14153d90 2023-10-14T09:18:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa1a12a640 1 -- 172.21.15.78:0/693245058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa14153d90 msgr2=0x7ffa141541e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa1a12a640 1 --2- 172.21.15.78:0/693245058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa14153d90 0x7ffa141541e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa140c6da0 tx=0x7ffa0c01c940 comp rx=0 tx=0).stop 2023-10-14T09:18:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa1a12a640 1 -- 172.21.15.78:0/693245058 shutdown_connections 2023-10-14T09:18:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa1a12a640 1 --2- 172.21.15.78:0/693245058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa14153d90 0x7ffa141541e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa1a12a640 1 --2- 172.21.15.78:0/693245058 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1406cc50 0x7ffa140c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa1a12a640 1 --2- 172.21.15.78:0/693245058 >> v2:172.21.15.157:3300/0 conn(0x7ffa140c4030 0x7ffa140c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa1a12a640 1 -- 172.21.15.78:0/693245058 >> 172.21.15.78:0/693245058 conn(0x7ffa140ab240 msgr2=0x7ffa140ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa1a12a640 1 -- 172.21.15.78:0/693245058 shutdown_connections 2023-10-14T09:18:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.852+0000 7ffa1a12a640 1 -- 172.21.15.78:0/693245058 wait complete. 2023-10-14T09:18:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa1a12a640 1 Processor -- start 2023-10-14T09:18:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa1a12a640 1 -- start start 2023-10-14T09:18:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa1a12a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1406cc50 0x7ffa140adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa1a12a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa140c4030 0x7ffa140c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa1a12a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa14153d90 0x7ffa140c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa1a12a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140c1be0 con 0x7ffa140c4030 2023-10-14T09:18:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa1a12a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140c0130 con 0x7ffa14153d90 2023-10-14T09:18:00.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa1a12a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140c0410 con 0x7ffa1406cc50 2023-10-14T09:18:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa12ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa140c4030 0x7ffa140c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa12ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa140c4030 0x7ffa140c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60574/0 (socket says 172.21.15.78:60574) 2023-10-14T09:18:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa12ffd640 1 -- 172.21.15.78:0/2407258823 learned_addr learned my addr 172.21.15.78:0/2407258823 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa137fe640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1406cc50 0x7ffa140adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa13fff640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa14153d90 0x7ffa140c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa12ffd640 1 -- 172.21.15.78:0/2407258823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1406cc50 msgr2=0x7ffa140adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa12ffd640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1406cc50 0x7ffa140adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa12ffd640 1 -- 172.21.15.78:0/2407258823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa14153d90 msgr2=0x7ffa140c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:00.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa12ffd640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa14153d90 0x7ffa140c25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:00.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa12ffd640 1 -- 172.21.15.78:0/2407258823 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c009b30 con 0x7ffa140c4030 2023-10-14T09:18:00.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa12ffd640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa140c4030 0x7ffa140c2070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800d7d0 tx=0x7ffa0800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:00.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ff9fbfff640 1 -- 172.21.15.78:0/2407258823 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080096a0 con 0x7ffa140c4030 2023-10-14T09:18:00.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ff9fbfff640 1 -- 172.21.15.78:0/2407258823 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa08009800 con 0x7ffa140c4030 2023-10-14T09:18:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa1a12a640 1 -- 172.21.15.78:0/2407258823 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa140c1870 con 0x7ffa140c4030 2023-10-14T09:18:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ff9fbfff640 1 -- 172.21.15.78:0/2407258823 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08009bb0 con 0x7ffa140c4030 2023-10-14T09:18:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa1a12a640 1 -- 172.21.15.78:0/2407258823 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa140ae110 con 0x7ffa140c4030 2023-10-14T09:18:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.856+0000 7ffa1a12a640 1 -- 172.21.15.78:0/2407258823 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa140c1d50 con 0x7ffa140c4030 2023-10-14T09:18:00.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.860+0000 7ff9fbfff640 1 -- 172.21.15.78:0/2407258823 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffa08009d10 con 0x7ffa140c4030 2023-10-14T09:18:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.860+0000 7ff9fbfff640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffa000664a0 0x7ffa00068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.860+0000 7ff9fbfff640 1 -- 172.21.15.78:0/2407258823 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa08084430 con 0x7ffa140c4030 2023-10-14T09:18:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.860+0000 7ffa137fe640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffa000664a0 0x7ffa00068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:00.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.860+0000 7ffa137fe640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffa000664a0 0x7ffa00068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa140c4e80 tx=0x7ffa04009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:00.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:00.864+0000 7ff9fbfff640 1 -- 172.21.15.78:0/2407258823 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffa08051950 con 0x7ffa140c4030 2023-10-14T09:18:01.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ffa1a12a640 1 -- 172.21.15.78:0/2407258823 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa14074110 con 0x7ffa140c4030 2023-10-14T09:18:01.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ff9fbfff640 1 -- 172.21.15.78:0/2407258823 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa08054f70 con 0x7ffa140c4030 2023-10-14T09:18:01.015 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:18:01.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ffa1a12a640 1 -- 172.21.15.78:0/2407258823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffa000664a0 msgr2=0x7ffa00068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ffa1a12a640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffa000664a0 0x7ffa00068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa140c4e80 tx=0x7ffa04009190 comp rx=0 tx=0).stop 2023-10-14T09:18:01.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ffa1a12a640 1 -- 172.21.15.78:0/2407258823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa140c4030 msgr2=0x7ffa140c2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ffa1a12a640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa140c4030 0x7ffa140c2070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800d7d0 tx=0x7ffa0800dc90 comp rx=0 tx=0).stop 2023-10-14T09:18:01.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ffa1a12a640 1 -- 172.21.15.78:0/2407258823 shutdown_connections 2023-10-14T09:18:01.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ffa1a12a640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffa14153d90 0x7ffa140c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ffa1a12a640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa140c4030 0x7ffa140c2070 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ffa1a12a640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ffa000664a0 0x7ffa00068960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ffa1a12a640 1 --2- 172.21.15.78:0/2407258823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffa1406cc50 0x7ffa140adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.012+0000 7ffa1a12a640 1 -- 172.21.15.78:0/2407258823 >> 172.21.15.78:0/2407258823 conn(0x7ffa140ab240 msgr2=0x7ffa141557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:01.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.016+0000 7ffa1a12a640 1 -- 172.21.15.78:0/2407258823 shutdown_connections 2023-10-14T09:18:01.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.016+0000 7ffa1a12a640 1 -- 172.21.15.78:0/2407258823 wait complete. 2023-10-14T09:18:01.038 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:18:01.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.176+0000 7f5bfa6bb640 1 Processor -- start 2023-10-14T09:18:01.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bfa6bb640 1 -- start start 2023-10-14T09:18:01.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bfa6bb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5bf406c900 0x7f5bf40c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bfa6bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf40c4360 con 0x7f5bf40c6320 2023-10-14T09:18:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bfa6bb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf4157c20 con 0x7f5bf40bcc50 2023-10-14T09:18:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bfa6bb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf40c4010 con 0x7f5bf406c900 2023-10-14T09:18:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bf96b9640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5bf40c6320 0x7f5bf4153b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50058/0 (socket says 172.21.15.78:50058) 2023-10-14T09:18:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bf96b9640 1 -- 172.21.15.78:0/1920193150 learned_addr learned my addr 172.21.15.78:0/1920193150 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bf9eba640 1 --2- 172.21.15.78:0/1920193150 >> v2:172.21.15.157:3300/0 conn(0x7f5bf406c900 0x7f5bf40c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bebfff640 1 -- 172.21.15.78:0/1920193150 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119464741 0 0) 0x7f5bf40c4360 con 0x7f5bf40c6320 2023-10-14T09:18:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bebfff640 1 -- 172.21.15.78:0/1920193150 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5be0003530 con 0x7f5bf40c6320 2023-10-14T09:18:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bf9eba640 1 -- 172.21.15.78:0/1920193150 >> v1:172.21.15.157:6789/0 conn(0x7f5bf40bcc50 legacy=0x7f5bf4154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bf9eba640 1 -- 172.21.15.78:0/1920193150 >> v1:172.21.15.78:6789/0 conn(0x7f5bf40c6320 legacy=0x7f5bf4153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.180+0000 7f5bf9eba640 1 -- 172.21.15.78:0/1920193150 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf4157ec0 con 0x7f5bf406c900 2023-10-14T09:18:01.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bf9eba640 1 --2- 172.21.15.78:0/1920193150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf406c900 0x7f5bf40c6700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009d90 tx=0x7f5bec01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e0c23a8c5d7212 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:01.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bebfff640 1 -- 172.21.15.78:0/1920193150 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0a5890 con 0x7f5bf406c900 2023-10-14T09:18:01.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bebfff640 1 -- 172.21.15.78:0/1920193150 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec0a59f0 con 0x7f5bf406c900 2023-10-14T09:18:01.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bebfff640 1 -- 172.21.15.78:0/1920193150 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0a5d80 con 0x7f5bf406c900 2023-10-14T09:18:01.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/1920193150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf406c900 msgr2=0x7f5bf40c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bfa6bb640 1 --2- 172.21.15.78:0/1920193150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf406c900 0x7f5bf40c6700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009d90 tx=0x7f5bec01c8c0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/1920193150 shutdown_connections 2023-10-14T09:18:01.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bfa6bb640 1 --2- 172.21.15.78:0/1920193150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf406c900 0x7f5bf40c6700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/1920193150 >> 172.21.15.78:0/1920193150 conn(0x7f5bf4071790 msgr2=0x7f5bf4071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:01.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/1920193150 shutdown_connections 2023-10-14T09:18:01.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/1920193150 wait complete. 2023-10-14T09:18:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bfa6bb640 1 Processor -- start 2023-10-14T09:18:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.184+0000 7f5bfa6bb640 1 -- start start 2023-10-14T09:18:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bfa6bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bf406c900 0x7f5bf414f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bfa6bb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bf40c6320 0x7f5bf41ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bfa6bb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf4152d60 0x7f5bf41ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bfa6bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf41525a0 con 0x7f5bf406c900 2023-10-14T09:18:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bfa6bb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf414ed20 con 0x7f5bf4152d60 2023-10-14T09:18:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bfa6bb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf414e760 con 0x7f5bf40c6320 2023-10-14T09:18:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf96b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bf406c900 0x7f5bf414f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf96b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bf406c900 0x7f5bf414f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60582/0 (socket says 172.21.15.78:60582) 2023-10-14T09:18:01.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf96b9640 1 -- 172.21.15.78:0/534323640 learned_addr learned my addr 172.21.15.78:0/534323640 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:01.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf9eba640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf4152d60 0x7f5bf41ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf96b9640 1 -- 172.21.15.78:0/534323640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bf40c6320 msgr2=0x7f5bf41ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf8eb8640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bf40c6320 0x7f5bf41ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf96b9640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bf40c6320 0x7f5bf41ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf96b9640 1 -- 172.21.15.78:0/534323640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf4152d60 msgr2=0x7f5bf41ef480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf96b9640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf4152d60 0x7f5bf41ef480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf96b9640 1 -- 172.21.15.78:0/534323640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec009a70 con 0x7f5bf406c900 2023-10-14T09:18:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf9eba640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf4152d60 0x7f5bf41ef480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf8eb8640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bf40c6320 0x7f5bf41ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bf96b9640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bf406c900 0x7f5bf414f850 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c420 tx=0x7f5bf000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5be9ffb640 1 -- 172.21.15.78:0/534323640 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0005cf0 con 0x7f5bf406c900 2023-10-14T09:18:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5be9ffb640 1 -- 172.21.15.78:0/534323640 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf0005e50 con 0x7f5bf406c900 2023-10-14T09:18:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5be9ffb640 1 -- 172.21.15.78:0/534323640 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf00072d0 con 0x7f5bf406c900 2023-10-14T09:18:01.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/534323640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf414ea40 con 0x7f5bf406c900 2023-10-14T09:18:01.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/534323640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf4155040 con 0x7f5bf406c900 2023-10-14T09:18:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/534323640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf4152400 con 0x7f5bf406c900 2023-10-14T09:18:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.188+0000 7f5be9ffb640 1 -- 172.21.15.78:0/534323640 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5bf0007430 con 0x7f5bf406c900 2023-10-14T09:18:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.192+0000 7f5be9ffb640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd80664a0 0x7f5bd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.192+0000 7f5be9ffb640 1 -- 172.21.15.78:0/534323640 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bf0083390 con 0x7f5bf406c900 2023-10-14T09:18:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.192+0000 7f5bf8eb8640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd80664a0 0x7f5bd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.192+0000 7f5bf8eb8640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd80664a0 0x7f5bd8068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4154fd0 tx=0x7f5be4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.196+0000 7f5be9ffb640 1 -- 172.21.15.78:0/534323640 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5bf4152400 con 0x7f5bf406c900 2023-10-14T09:18:01.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.344+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/534323640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5bf4152400 con 0x7f5bf406c900 2023-10-14T09:18:01.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.344+0000 7f5be9ffb640 1 -- 172.21.15.78:0/534323640 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5bf4152400 con 0x7f5bf406c900 2023-10-14T09:18:01.348 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:18:01.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/534323640 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd80664a0 msgr2=0x7f5bd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd80664a0 0x7f5bd8068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4154fd0 tx=0x7f5be4009040 comp rx=0 tx=0).stop 2023-10-14T09:18:01.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/534323640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bf406c900 msgr2=0x7f5bf414f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bf406c900 0x7f5bf414f850 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c420 tx=0x7f5bf000c8e0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/534323640 shutdown_connections 2023-10-14T09:18:01.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5bf4152d60 0x7f5bf41ef480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5bd80664a0 0x7f5bd8068960 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5bf40c6320 0x7f5bf41ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 --2- 172.21.15.78:0/534323640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bf406c900 0x7f5bf414f850 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/534323640 >> 172.21.15.78:0/534323640 conn(0x7f5bf4071790 msgr2=0x7f5bf40c7820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:01.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/534323640 shutdown_connections 2023-10-14T09:18:01.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.348+0000 7f5bfa6bb640 1 -- 172.21.15.78:0/534323640 wait complete. 2023-10-14T09:18:01.369 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T09:18:01.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.504+0000 7f06e6ba1640 1 Processor -- start 2023-10-14T09:18:01.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.504+0000 7f06e6ba1640 1 -- start start 2023-10-14T09:18:01.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.504+0000 7f06e6ba1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f06e00c1eb0 0x7f06e00c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.504+0000 7f06e6ba1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06e00c7d30 0x7f06e00c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.504+0000 7f06e6ba1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e0151810 con 0x7f06e0151430 2023-10-14T09:18:01.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.504+0000 7f06e6ba1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e00c27d0 con 0x7f06e00c1eb0 2023-10-14T09:18:01.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.504+0000 7f06e6ba1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e006f760 con 0x7f06e00c7d30 2023-10-14T09:18:01.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.504+0000 7f06d7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f06e00c1eb0 0x7f06e00c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.504+0000 7f06d7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f06e00c1eb0 0x7f06e00c77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60596/0 (socket says 172.21.15.78:60596) 2023-10-14T09:18:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.504+0000 7f06d7fff640 1 -- 172.21.15.78:0/2322149448 learned_addr learned my addr 172.21.15.78:0/2322149448 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.504+0000 7f06e493d640 1 --1- 172.21.15.78:0/2322149448 >> v1:172.21.15.78:6789/0 conn(0x7f06e0151430 0x7f06e01547e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50072/0 (socket says 172.21.15.78:50072) 2023-10-14T09:18:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06e513e640 1 --2- 172.21.15.78:0/2322149448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06e00c7d30 0x7f06e00c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06d7fff640 1 -- 172.21.15.78:0/2322149448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06e00c7d30 msgr2=0x7f06e00c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06d7fff640 1 --2- 172.21.15.78:0/2322149448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06e00c7d30 0x7f06e00c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06d7fff640 1 -- 172.21.15.78:0/2322149448 >> v1:172.21.15.78:6789/0 conn(0x7f06e0151430 legacy=0x7f06e01547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06d7fff640 1 -- 172.21.15.78:0/2322149448 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e006fa00 con 0x7f06e00c1eb0 2023-10-14T09:18:01.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06e513e640 1 --2- 172.21.15.78:0/2322149448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06e00c7d30 0x7f06e00c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06d7fff640 1 --2- 172.21.15.78:0/2322149448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00c1eb0 0x7f06e00c77f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009870 tx=0x7f06d001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a4f746f83b221a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06d77fe640 1 -- 172.21.15.78:0/2322149448 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00ac410 con 0x7f06e00c1eb0 2023-10-14T09:18:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06d77fe640 1 -- 172.21.15.78:0/2322149448 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d00ac570 con 0x7f06e00c1eb0 2023-10-14T09:18:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06d77fe640 1 -- 172.21.15.78:0/2322149448 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00ac900 con 0x7f06e00c1eb0 2023-10-14T09:18:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06e6ba1640 1 -- 172.21.15.78:0/2322149448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00c1eb0 msgr2=0x7f06e00c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06e6ba1640 1 --2- 172.21.15.78:0/2322149448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00c1eb0 0x7f06e00c77f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009870 tx=0x7f06d001c3b0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06e6ba1640 1 -- 172.21.15.78:0/2322149448 shutdown_connections 2023-10-14T09:18:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06e6ba1640 1 --2- 172.21.15.78:0/2322149448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06e00c7d30 0x7f06e00c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06e6ba1640 1 --2- 172.21.15.78:0/2322149448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00c1eb0 0x7f06e00c77f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06e6ba1640 1 -- 172.21.15.78:0/2322149448 >> 172.21.15.78:0/2322149448 conn(0x7f06e006a060 msgr2=0x7f06e006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:01.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.508+0000 7f06e6ba1640 1 -- 172.21.15.78:0/2322149448 shutdown_connections 2023-10-14T09:18:01.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e6ba1640 1 -- 172.21.15.78:0/2322149448 wait complete. 2023-10-14T09:18:01.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e6ba1640 1 Processor -- start 2023-10-14T09:18:01.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e6ba1640 1 -- start start 2023-10-14T09:18:01.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e6ba1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00c1eb0 0x7f06e0146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e6ba1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06e00c7d30 0x7f06e00c0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e6ba1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e0151430 0x7f06e01ef590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e6ba1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01f0270 con 0x7f06e00c1eb0 2023-10-14T09:18:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e6ba1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00c0a70 con 0x7f06e0151430 2023-10-14T09:18:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e6ba1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e00a8180 con 0x7f06e00c7d30 2023-10-14T09:18:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e493d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00c1eb0 0x7f06e0146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e493d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00c1eb0 0x7f06e0146ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60606/0 (socket says 172.21.15.78:60606) 2023-10-14T09:18:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e493d640 1 -- 172.21.15.78:0/3236212173 learned_addr learned my addr 172.21.15.78:0/3236212173 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e513e640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e0151430 0x7f06e01ef590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06d7fff640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06e00c7d30 0x7f06e00c0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e493d640 1 -- 172.21.15.78:0/3236212173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06e00c7d30 msgr2=0x7f06e00c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e493d640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06e00c7d30 0x7f06e00c0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e493d640 1 -- 172.21.15.78:0/3236212173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e0151430 msgr2=0x7f06e01ef590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e493d640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e0151430 0x7f06e01ef590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e493d640 1 -- 172.21.15.78:0/3236212173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d00094d0 con 0x7f06e00c1eb0 2023-10-14T09:18:01.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e513e640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e0151430 0x7f06e01ef590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:01.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e493d640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00c1eb0 0x7f06e0146ce0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00c490 tx=0x7f06dc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:01.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06d57fa640 1 -- 172.21.15.78:0/3236212173 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc007480 con 0x7f06e00c1eb0 2023-10-14T09:18:01.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06d57fa640 1 -- 172.21.15.78:0/3236212173 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc0075e0 con 0x7f06e00c1eb0 2023-10-14T09:18:01.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06d57fa640 1 -- 172.21.15.78:0/3236212173 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc004a10 con 0x7f06e00c1eb0 2023-10-14T09:18:01.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.512+0000 7f06e6ba1640 1 -- 172.21.15.78:0/3236212173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e00a8400 con 0x7f06e00c1eb0 2023-10-14T09:18:01.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.516+0000 7f06e6ba1640 1 -- 172.21.15.78:0/3236212173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e0148ad0 con 0x7f06e00c1eb0 2023-10-14T09:18:01.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.516+0000 7f06e6ba1640 1 -- 172.21.15.78:0/3236212173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e0074180 con 0x7f06e00c1eb0 2023-10-14T09:18:01.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.516+0000 7f06d57fa640 1 -- 172.21.15.78:0/3236212173 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f06dc004b70 con 0x7f06e00c1eb0 2023-10-14T09:18:01.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.516+0000 7f06d57fa640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f06cc0664a0 0x7f06cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.516+0000 7f06d57fa640 1 -- 172.21.15.78:0/3236212173 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06dc082e00 con 0x7f06e00c1eb0 2023-10-14T09:18:01.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.516+0000 7f06d7fff640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f06cc0664a0 0x7f06cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.516+0000 7f06d7fff640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f06cc0664a0 0x7f06cc068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ae000 tx=0x7f06d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:01.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.520+0000 7f06d57fa640 1 -- 172.21.15.78:0/3236212173 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f06dc050320 con 0x7f06e00c1eb0 2023-10-14T09:18:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.680+0000 7f06e6ba1640 1 -- 172.21.15.78:0/3236212173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f06e00c71e0 con 0x7f06e00c1eb0 2023-10-14T09:18:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06d57fa640 1 -- 172.21.15.78:0/3236212173 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f06dc053940 con 0x7f06e00c1eb0 2023-10-14T09:18:01.685 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-10-14T09:18:01.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 -- 172.21.15.78:0/3236212173 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f06cc0664a0 msgr2=0x7f06cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f06cc0664a0 0x7f06cc068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06d00ae000 tx=0x7f06d0009040 comp rx=0 tx=0).stop 2023-10-14T09:18:01.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 -- 172.21.15.78:0/3236212173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00c1eb0 msgr2=0x7f06e0146ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00c1eb0 0x7f06e0146ce0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00c490 tx=0x7f06dc00c950 comp rx=0 tx=0).stop 2023-10-14T09:18:01.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 -- 172.21.15.78:0/3236212173 shutdown_connections 2023-10-14T09:18:01.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f06e0151430 0x7f06e01ef590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f06cc0664a0 0x7f06cc068960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f06e00c7d30 0x7f06e00c0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 --2- 172.21.15.78:0/3236212173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e00c1eb0 0x7f06e0146ce0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 -- 172.21.15.78:0/3236212173 >> 172.21.15.78:0/3236212173 conn(0x7f06e006a060 msgr2=0x7f06e014f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 -- 172.21.15.78:0/3236212173 shutdown_connections 2023-10-14T09:18:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.684+0000 7f06e6ba1640 1 -- 172.21.15.78:0/3236212173 wait complete. 2023-10-14T09:18:01.706 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi157.front.sepia.ceph.com... 2023-10-14T09:18:01.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:18:01.707 DEBUG:teuthology.orchestra.run.smithi157:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-14T09:18:01.740 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:18:01.741 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:18:01.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:18:01.742 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T09:18:01.805 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-10-14T09:18:01.806 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.940+0000 7f660653e640 1 Processor -- start 2023-10-14T09:18:01.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f660653e640 1 -- start start 2023-10-14T09:18:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f660653e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f660014ddb0 0x7f66000c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f660653e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66000c6910 0x7f66000c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f660653e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660006c470 con 0x7f6600153e80 2023-10-14T09:18:01.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f660653e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66000c64f0 con 0x7f660014ddb0 2023-10-14T09:18:01.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f660653e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66000c5300 con 0x7f66000c6910 2023-10-14T09:18:01.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f65fffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f660014ddb0 0x7f66000c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f65fffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f660014ddb0 0x7f66000c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60608/0 (socket says 172.21.15.78:60608) 2023-10-14T09:18:01.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f65fffff640 1 -- 172.21.15.78:0/2683234566 learned_addr learned my addr 172.21.15.78:0/2683234566 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:01.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f65ff7fe640 1 --1- 172.21.15.78:0/2683234566 >> v1:172.21.15.78:6789/0 conn(0x7f6600153e80 0x7f660006bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50078/0 (socket says 172.21.15.78:50078) 2023-10-14T09:18:01.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f65fffff640 1 -- 172.21.15.78:0/2683234566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66000c6910 msgr2=0x7f66000c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:01.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f6604adb640 1 --2- 172.21.15.78:0/2683234566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66000c6910 0x7f66000c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f65fffff640 1 --2- 172.21.15.78:0/2683234566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66000c6910 0x7f66000c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f65fffff640 1 -- 172.21.15.78:0/2683234566 >> v1:172.21.15.78:6789/0 conn(0x7f6600153e80 legacy=0x7f660006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f65fffff640 1 -- 172.21.15.78:0/2683234566 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660006c750 con 0x7f660014ddb0 2023-10-14T09:18:01.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f6604adb640 1 --2- 172.21.15.78:0/2683234566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66000c6910 0x7f66000c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:01.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.944+0000 7f65feffd640 1 -- 172.21.15.78:0/2683234566 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118203362 0 0) 0x7f660006c470 con 0x7f6600153e80 2023-10-14T09:18:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f65fffff640 1 --2- 172.21.15.78:0/2683234566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f660014ddb0 0x7f66000c7780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009870 tx=0x7f65f001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16beefe0c7f1d306 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f65feffd640 1 -- 172.21.15.78:0/2683234566 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f00ac640 con 0x7f660014ddb0 2023-10-14T09:18:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f65feffd640 1 -- 172.21.15.78:0/2683234566 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f00ac7a0 con 0x7f660014ddb0 2023-10-14T09:18:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f65feffd640 1 -- 172.21.15.78:0/2683234566 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f00acb30 con 0x7f660014ddb0 2023-10-14T09:18:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f660653e640 1 -- 172.21.15.78:0/2683234566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f660014ddb0 msgr2=0x7f66000c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f660653e640 1 --2- 172.21.15.78:0/2683234566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f660014ddb0 0x7f66000c7780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009870 tx=0x7f65f001c420 comp rx=0 tx=0).stop 2023-10-14T09:18:01.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f660653e640 1 -- 172.21.15.78:0/2683234566 shutdown_connections 2023-10-14T09:18:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f660653e640 1 --2- 172.21.15.78:0/2683234566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66000c6910 0x7f66000c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f660653e640 1 --2- 172.21.15.78:0/2683234566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f660014ddb0 0x7f66000c7780 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f660653e640 1 -- 172.21.15.78:0/2683234566 >> 172.21.15.78:0/2683234566 conn(0x7f66000ab1f0 msgr2=0x7f66000ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:01.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f660653e640 1 -- 172.21.15.78:0/2683234566 shutdown_connections 2023-10-14T09:18:01.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f660653e640 1 -- 172.21.15.78:0/2683234566 wait complete. 2023-10-14T09:18:01.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.948+0000 7f660653e640 1 Processor -- start 2023-10-14T09:18:01.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f660653e640 1 -- start start 2023-10-14T09:18:01.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f660653e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66000c6910 0x7f66001ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f660653e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660014ddb0 0x7f6600157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f660653e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6600153e80 0x7f6600150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f660653e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6600157750 con 0x7f6600153e80 2023-10-14T09:18:01.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f660653e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66001ed810 con 0x7f660014ddb0 2023-10-14T09:18:01.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f660653e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660014ecf0 con 0x7f66000c6910 2023-10-14T09:18:01.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f6604adb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6600153e80 0x7f6600150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f6604adb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6600153e80 0x7f6600150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60620/0 (socket says 172.21.15.78:60620) 2023-10-14T09:18:01.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f6604adb640 1 -- 172.21.15.78:0/3077774248 learned_addr learned my addr 172.21.15.78:0/3077774248 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:01.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f65fffff640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66000c6910 0x7f66001ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f65ff7fe640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660014ddb0 0x7f6600157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f6604adb640 1 -- 172.21.15.78:0/3077774248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66000c6910 msgr2=0x7f66001ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f6604adb640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66000c6910 0x7f66001ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f6604adb640 1 -- 172.21.15.78:0/3077774248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660014ddb0 msgr2=0x7f6600157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:01.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f6604adb640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660014ddb0 0x7f6600157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:01.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f6604adb640 1 -- 172.21.15.78:0/3077774248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00094d0 con 0x7f6600153e80 2023-10-14T09:18:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f6604adb640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6600153e80 0x7f6600150110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f65f800cd80 tx=0x7f65f800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f65fcff9640 1 -- 172.21.15.78:0/3077774248 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f800f680 con 0x7f6600153e80 2023-10-14T09:18:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f65fcff9640 1 -- 172.21.15.78:0/3077774248 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f800f800 con 0x7f6600153e80 2023-10-14T09:18:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f660653e640 1 -- 172.21.15.78:0/3077774248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660014f810 con 0x7f6600153e80 2023-10-14T09:18:01.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f65fcff9640 1 -- 172.21.15.78:0/3077774248 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f800fbb0 con 0x7f6600153e80 2023-10-14T09:18:01.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f660653e640 1 -- 172.21.15.78:0/3077774248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660014f250 con 0x7f6600153e80 2023-10-14T09:18:01.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f660653e640 1 -- 172.21.15.78:0/3077774248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6600157520 con 0x7f6600153e80 2023-10-14T09:18:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.952+0000 7f65fcff9640 1 -- 172.21.15.78:0/3077774248 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f65f800b040 con 0x7f6600153e80 2023-10-14T09:18:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.956+0000 7f65fcff9640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65ec0664d0 0x7f65ec068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.956+0000 7f65fcff9640 1 -- 172.21.15.78:0/3077774248 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65f80847b0 con 0x7f6600153e80 2023-10-14T09:18:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.956+0000 7f65fffff640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65ec0664d0 0x7f65ec068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:01.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.956+0000 7f65fffff640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65ec0664d0 0x7f65ec068990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65f00ae000 tx=0x7f65f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:01.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:01.960+0000 7f65fcff9640 1 -- 172.21.15.78:0/3077774248 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6600157520 con 0x7f6600153e80 2023-10-14T09:18:02.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.140+0000 7f660653e640 1 -- 172.21.15.78:0/3077774248 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6600157520 con 0x7f6600153e80 2023-10-14T09:18:02.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.140+0000 7f65fcff9640 1 -- 172.21.15.78:0/3077774248 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f6600157520 con 0x7f6600153e80 2023-10-14T09:18:02.144 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:02.144 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1987032053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1987032053},{"type":"v1","addr":"172.21.15.157:6834","nonce":1987032053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/20028755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":20028755},{"type":"v1","addr":"172.21.15.78:6836","nonce":20028755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3671283338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3671283338},{"type":"v1","addr":"172.21.15.78:6837","nonce":3671283338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:17:25.006130+0000","modified":"2023-10-14T09:17:28.036173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/3774780175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3774780175},{"type":"v1","addr":"172.21.15.157:6835","nonce":3774780175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:18:02.147 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-10-14T09:18:02.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.140+0000 7f660653e640 1 -- 172.21.15.78:0/3077774248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65ec0664d0 msgr2=0x7f65ec068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.140+0000 7f660653e640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65ec0664d0 0x7f65ec068990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65f00ae000 tx=0x7f65f0008040 comp rx=0 tx=0).stop 2023-10-14T09:18:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.140+0000 7f660653e640 1 -- 172.21.15.78:0/3077774248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6600153e80 msgr2=0x7f6600150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.140+0000 7f660653e640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6600153e80 0x7f6600150110 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f65f800cd80 tx=0x7f65f800a650 comp rx=0 tx=0).stop 2023-10-14T09:18:02.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.140+0000 7f660653e640 1 -- 172.21.15.78:0/3077774248 shutdown_connections 2023-10-14T09:18:02.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.140+0000 7f660653e640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6600153e80 0x7f6600150110 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.144+0000 7f660653e640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660014ddb0 0x7f6600157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.144+0000 7f660653e640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65ec0664d0 0x7f65ec068990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.144+0000 7f660653e640 1 --2- 172.21.15.78:0/3077774248 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66000c6910 0x7f66001ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.144+0000 7f660653e640 1 -- 172.21.15.78:0/3077774248 >> 172.21.15.78:0/3077774248 conn(0x7f66000ab1f0 msgr2=0x7f6600072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:02.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.144+0000 7f660653e640 1 -- 172.21.15.78:0/3077774248 shutdown_connections 2023-10-14T09:18:02.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.144+0000 7f660653e640 1 -- 172.21.15.78:0/3077774248 wait complete. 2023-10-14T09:18:02.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:18:02.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.300+0000 7f7a0f70f640 1 Processor -- start 2023-10-14T09:18:02.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.300+0000 7f7a0f70f640 1 -- start start 2023-10-14T09:18:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0f70f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7a0814e0f0 0x7f7a08152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0f70f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7a0814ed10 0x7f7a0814f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0f70f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a081531d0 con 0x7f7a0814f700 2023-10-14T09:18:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0f70f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a08153e50 con 0x7f7a0814ed10 2023-10-14T09:18:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0f70f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a081534b0 con 0x7f7a0814e0f0 2023-10-14T09:18:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0ccaa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7a0814ed10 0x7f7a0814f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0ccaa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7a0814ed10 0x7f7a0814f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60622/0 (socket says 172.21.15.78:60622) 2023-10-14T09:18:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0ccaa640 1 -- 172.21.15.78:0/2012833102 learned_addr learned my addr 172.21.15.78:0/2012833102 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0d4ab640 1 --2- 172.21.15.78:0/2012833102 >> v2:172.21.15.157:3300/0 conn(0x7f7a0814e0f0 0x7f7a08152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0ccaa640 1 -- 172.21.15.78:0/2012833102 >> v2:172.21.15.157:3300/0 conn(0x7f7a0814e0f0 msgr2=0x7f7a08152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0ccaa640 1 --2- 172.21.15.78:0/2012833102 >> v2:172.21.15.157:3300/0 conn(0x7f7a0814e0f0 0x7f7a08152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0ccaa640 1 -- 172.21.15.78:0/2012833102 >> v1:172.21.15.78:6789/0 conn(0x7f7a0814f700 legacy=0x7f7a08150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f7a0ccaa640 1 -- 172.21.15.78:0/2012833102 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08153790 con 0x7f7a0814ed10 2023-10-14T09:18:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.304+0000 7f79fffff640 1 -- 172.21.15.78:0/2012833102 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402275336 0 0) 0x7f7a081531d0 con 0x7f7a0814f700 2023-10-14T09:18:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f7a0ccaa640 1 --2- 172.21.15.78:0/2012833102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a0814ed10 0x7f7a0814f1c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a080c16f0 tx=0x7f79f801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a8544e53cd9177 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f79fffff640 1 -- 172.21.15.78:0/2012833102 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80ab600 con 0x7f7a0814ed10 2023-10-14T09:18:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f79fffff640 1 -- 172.21.15.78:0/2012833102 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f80a7050 con 0x7f7a0814ed10 2023-10-14T09:18:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f79fffff640 1 -- 172.21.15.78:0/2012833102 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80ab980 con 0x7f7a0814ed10 2023-10-14T09:18:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f7a0f70f640 1 -- 172.21.15.78:0/2012833102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a0814ed10 msgr2=0x7f7a0814f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f7a0f70f640 1 --2- 172.21.15.78:0/2012833102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a0814ed10 0x7f7a0814f1c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a080c16f0 tx=0x7f79f801c470 comp rx=0 tx=0).stop 2023-10-14T09:18:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f7a0f70f640 1 -- 172.21.15.78:0/2012833102 shutdown_connections 2023-10-14T09:18:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f7a0f70f640 1 --2- 172.21.15.78:0/2012833102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a0814ed10 0x7f7a0814f1c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f7a0f70f640 1 --2- 172.21.15.78:0/2012833102 >> v2:172.21.15.157:3300/0 conn(0x7f7a0814e0f0 0x7f7a08152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f7a0f70f640 1 -- 172.21.15.78:0/2012833102 >> 172.21.15.78:0/2012833102 conn(0x7f7a080c1cc0 msgr2=0x7f7a080c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f7a0f70f640 1 -- 172.21.15.78:0/2012833102 shutdown_connections 2023-10-14T09:18:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f7a0f70f640 1 -- 172.21.15.78:0/2012833102 wait complete. 2023-10-14T09:18:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f7a0f70f640 1 Processor -- start 2023-10-14T09:18:02.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.308+0000 7f7a0f70f640 1 -- start start 2023-10-14T09:18:02.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0f70f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a0814e0f0 0x7f7a080c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0f70f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a0814ed10 0x7f7a08146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0f70f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a0814f700 0x7f7a08147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0f70f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080708a0 con 0x7f7a0814ed10 2023-10-14T09:18:02.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0f70f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a08142750 con 0x7f7a0814e0f0 2023-10-14T09:18:02.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0f70f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081ece40 con 0x7f7a0814f700 2023-10-14T09:18:02.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0ccaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a0814ed10 0x7f7a08146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0ccaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a0814ed10 0x7f7a08146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60626/0 (socket says 172.21.15.78:60626) 2023-10-14T09:18:02.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0ccaa640 1 -- 172.21.15.78:0/1992228322 learned_addr learned my addr 172.21.15.78:0/1992228322 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:02.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0d4ab640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a0814e0f0 0x7f7a080c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0dcac640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a0814f700 0x7f7a08147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0ccaa640 1 -- 172.21.15.78:0/1992228322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a0814f700 msgr2=0x7f7a08147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0ccaa640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a0814f700 0x7f7a08147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0ccaa640 1 -- 172.21.15.78:0/1992228322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a0814e0f0 msgr2=0x7f7a080c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0ccaa640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a0814e0f0 0x7f7a080c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0ccaa640 1 -- 172.21.15.78:0/1992228322 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f80094d0 con 0x7f7a0814ed10 2023-10-14T09:18:02.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0dcac640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a0814f700 0x7f7a08147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0ccaa640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a0814ed10 0x7f7a08146be0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f79f801a0a0 tx=0x7f7a081519b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f79fdffb640 1 -- 172.21.15.78:0/1992228322 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80b4420 con 0x7f7a0814ed10 2023-10-14T09:18:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f79fdffb640 1 -- 172.21.15.78:0/1992228322 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f80b4580 con 0x7f7a0814ed10 2023-10-14T09:18:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f79fdffb640 1 -- 172.21.15.78:0/1992228322 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80b4930 con 0x7f7a0814ed10 2023-10-14T09:18:02.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0f70f640 1 -- 172.21.15.78:0/1992228322 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a081ed6e0 con 0x7f7a0814ed10 2023-10-14T09:18:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0f70f640 1 -- 172.21.15.78:0/1992228322 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a081ed090 con 0x7f7a0814ed10 2023-10-14T09:18:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f7a0f70f640 1 -- 172.21.15.78:0/1992228322 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a08074180 con 0x7f7a0814ed10 2023-10-14T09:18:02.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.312+0000 7f79fdffb640 1 -- 172.21.15.78:0/1992228322 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f79f80b2070 con 0x7f7a0814ed10 2023-10-14T09:18:02.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.316+0000 7f79fdffb640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79ec0664a0 0x7f79ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.316+0000 7f79fdffb640 1 -- 172.21.15.78:0/1992228322 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79f811cec0 con 0x7f7a0814ed10 2023-10-14T09:18:02.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.316+0000 7f7a0d4ab640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79ec0664a0 0x7f79ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.316+0000 7f7a0d4ab640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79ec0664a0 0x7f79ec068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009ac0 tx=0x7f7a04009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:02.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.320+0000 7f79fdffb640 1 -- 172.21.15.78:0/1992228322 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f79f80ea3d0 con 0x7f7a0814ed10 2023-10-14T09:18:02.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.468+0000 7f7a0f70f640 1 -- 172.21.15.78:0/1992228322 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a081ed870 con 0x7f7a0814ed10 2023-10-14T09:18:02.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f79fdffb640 1 -- 172.21.15.78:0/1992228322 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f79f80ed9f0 con 0x7f7a0814ed10 2023-10-14T09:18:02.474 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:02.475 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:18:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 -- 172.21.15.78:0/1992228322 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79ec0664a0 msgr2=0x7f79ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79ec0664a0 0x7f79ec068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009ac0 tx=0x7f7a04009190 comp rx=0 tx=0).stop 2023-10-14T09:18:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 -- 172.21.15.78:0/1992228322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a0814ed10 msgr2=0x7f7a08146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a0814ed10 0x7f7a08146be0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f79f801a0a0 tx=0x7f7a081519b0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 -- 172.21.15.78:0/1992228322 shutdown_connections 2023-10-14T09:18:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79ec0664a0 0x7f79ec068960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7a0814f700 0x7f7a08147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a0814ed10 0x7f7a08146be0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 --2- 172.21.15.78:0/1992228322 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a0814e0f0 0x7f7a080c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 -- 172.21.15.78:0/1992228322 >> 172.21.15.78:0/1992228322 conn(0x7f7a080c1cc0 msgr2=0x7f7a080aa390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:02.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 -- 172.21.15.78:0/1992228322 shutdown_connections 2023-10-14T09:18:02.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.472+0000 7f7a0f70f640 1 -- 172.21.15.78:0/1992228322 wait complete. 2023-10-14T09:18:02.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T09:17:23.221895+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T09:17:24.005188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:18:02.497 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:18:02.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0fbb8640 1 Processor -- start 2023-10-14T09:18:02.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0fbb8640 1 -- start start 2023-10-14T09:18:02.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0fbb8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e080c4030 0x7f7e080c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0fbb8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7e08153d90 0x7f7e081541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0fbb8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080c7af0 con 0x7f7e0806cc50 2023-10-14T09:18:02.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0fbb8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e080c5300 con 0x7f7e08153d90 2023-10-14T09:18:02.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0fbb8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08157360 con 0x7f7e080c4030 2023-10-14T09:18:02.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0d954640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e080c4030 0x7f7e080c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0e155640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7e08153d90 0x7f7e081541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0d954640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e080c4030 0x7f7e080c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:36554/0 (socket says 172.21.15.78:36554) 2023-10-14T09:18:02.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0d954640 1 -- 172.21.15.78:0/2373851218 learned_addr learned my addr 172.21.15.78:0/2373851218 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:02.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0d954640 1 -- 172.21.15.78:0/2373851218 >> v2:172.21.15.157:3300/0 conn(0x7f7e08153d90 msgr2=0x7f7e081541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:02.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0d954640 1 --2- 172.21.15.78:0/2373851218 >> v2:172.21.15.157:3300/0 conn(0x7f7e08153d90 0x7f7e081541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0d954640 1 -- 172.21.15.78:0/2373851218 >> v1:172.21.15.157:6789/0 conn(0x7f7e0806cc50 legacy=0x7f7e080c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.636+0000 7f7e0d954640 1 -- 172.21.15.78:0/2373851218 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08157ee0 con 0x7f7e080c4030 2023-10-14T09:18:02.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0d954640 1 --2- 172.21.15.78:0/2373851218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e080c4030 0x7f7e080c75b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009870 tx=0x7f7e0401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3da8c4372f31e117 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:02.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0c952640 1 -- 172.21.15.78:0/2373851218 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040aa610 con 0x7f7e080c4030 2023-10-14T09:18:02.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0c952640 1 -- 172.21.15.78:0/2373851218 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e040a6040 con 0x7f7e080c4030 2023-10-14T09:18:02.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0c952640 1 -- 172.21.15.78:0/2373851218 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040aa990 con 0x7f7e080c4030 2023-10-14T09:18:02.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/2373851218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e080c4030 msgr2=0x7f7e080c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0fbb8640 1 --2- 172.21.15.78:0/2373851218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e080c4030 0x7f7e080c75b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009870 tx=0x7f7e0401c4b0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/2373851218 shutdown_connections 2023-10-14T09:18:02.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0fbb8640 1 --2- 172.21.15.78:0/2373851218 >> v2:172.21.15.157:3300/0 conn(0x7f7e08153d90 0x7f7e081541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0fbb8640 1 --2- 172.21.15.78:0/2373851218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e080c4030 0x7f7e080c75b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/2373851218 >> 172.21.15.78:0/2373851218 conn(0x7f7e080ab240 msgr2=0x7f7e080ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:02.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/2373851218 shutdown_connections 2023-10-14T09:18:02.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.640+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/2373851218 wait complete. 2023-10-14T09:18:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0fbb8640 1 Processor -- start 2023-10-14T09:18:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0fbb8640 1 -- start start 2023-10-14T09:18:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0fbb8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e0806cc50 0x7f7e080aa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0fbb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e080c4030 0x7f7e080a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0fbb8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e08153d90 0x7f7e081488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0fbb8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081510f0 con 0x7f7e080c4030 2023-10-14T09:18:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0fbb8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081555c0 con 0x7f7e0806cc50 2023-10-14T09:18:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0fbb8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081558a0 con 0x7f7e08153d90 2023-10-14T09:18:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0d153640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e080c4030 0x7f7e080a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0d153640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e080c4030 0x7f7e080a9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60640/0 (socket says 172.21.15.78:60640) 2023-10-14T09:18:02.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0d153640 1 -- 172.21.15.78:0/4002713765 learned_addr learned my addr 172.21.15.78:0/4002713765 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:02.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0d954640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e0806cc50 0x7f7e080aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0e155640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e08153d90 0x7f7e081488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0d153640 1 -- 172.21.15.78:0/4002713765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e08153d90 msgr2=0x7f7e081488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0d153640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e08153d90 0x7f7e081488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0d153640 1 -- 172.21.15.78:0/4002713765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e0806cc50 msgr2=0x7f7e080aa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0d153640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e0806cc50 0x7f7e080aa820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0d153640 1 -- 172.21.15.78:0/4002713765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040094d0 con 0x7f7e080c4030 2023-10-14T09:18:02.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0d153640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e080c4030 0x7f7e080a9b70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7df800c4d0 tx=0x7f7df800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:02.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7dfe7fc640 1 -- 172.21.15.78:0/4002713765 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df80052d0 con 0x7f7e080c4030 2023-10-14T09:18:02.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7dfe7fc640 1 -- 172.21.15.78:0/4002713765 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df8005430 con 0x7f7e080c4030 2023-10-14T09:18:02.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/4002713765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e08155b80 con 0x7f7e080c4030 2023-10-14T09:18:02.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7dfe7fc640 1 -- 172.21.15.78:0/4002713765 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8012830 con 0x7f7e080c4030 2023-10-14T09:18:02.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.644+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/4002713765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e080aad60 con 0x7f7e080c4030 2023-10-14T09:18:02.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.648+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/4002713765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e08074110 con 0x7f7e080c4030 2023-10-14T09:18:02.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.648+0000 7f7dfe7fc640 1 -- 172.21.15.78:0/4002713765 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7df8012990 con 0x7f7e080c4030 2023-10-14T09:18:02.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.648+0000 7f7dfe7fc640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7dec0664d0 0x7f7dec068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.648+0000 7f7dfe7fc640 1 -- 172.21.15.78:0/4002713765 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7df8083780 con 0x7f7e080c4030 2023-10-14T09:18:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.648+0000 7f7e0d954640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7dec0664d0 0x7f7dec068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.648+0000 7f7e0d954640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7dec0664d0 0x7f7dec068990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7e040ae000 tx=0x7f7e040b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:02.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.652+0000 7f7dfe7fc640 1 -- 172.21.15.78:0/4002713765 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7df8050d20 con 0x7f7e080c4030 2023-10-14T09:18:02.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/4002713765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e081521a0 con 0x7f7e080c4030 2023-10-14T09:18:02.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7dfe7fc640 1 -- 172.21.15.78:0/4002713765 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7df8054340 con 0x7f7e080c4030 2023-10-14T09:18:02.806 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:18:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/4002713765 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7dec0664d0 msgr2=0x7f7dec068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7dec0664d0 0x7f7dec068990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7e040ae000 tx=0x7f7e040b5040 comp rx=0 tx=0).stop 2023-10-14T09:18:02.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/4002713765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e080c4030 msgr2=0x7f7e080a9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e080c4030 0x7f7e080a9b70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7df800c4d0 tx=0x7f7df800c990 comp rx=0 tx=0).stop 2023-10-14T09:18:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/4002713765 shutdown_connections 2023-10-14T09:18:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7dec0664d0 0x7f7dec068990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e08153d90 0x7f7e081488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e080c4030 0x7f7e080a9b70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 --2- 172.21.15.78:0/4002713765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e0806cc50 0x7f7e080aa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/4002713765 >> 172.21.15.78:0/4002713765 conn(0x7f7e080ab240 msgr2=0x7f7e0814ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:02.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/4002713765 shutdown_connections 2023-10-14T09:18:02.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.804+0000 7f7e0fbb8640 1 -- 172.21.15.78:0/4002713765 wait complete. 2023-10-14T09:18:02.827 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:18:02.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.964+0000 7fbf5d7aa640 1 Processor -- start 2023-10-14T09:18:02.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.964+0000 7fbf5d7aa640 1 -- start start 2023-10-14T09:18:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf5d7aa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbf5806c970 0x7fbf581571a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf5d7aa640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbf580bcbe0 0x7fbf5814a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf5d7aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5806c580 con 0x7fbf5814a2e0 2023-10-14T09:18:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf5d7aa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf580c3f30 con 0x7fbf5806c970 2023-10-14T09:18:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf5d7aa640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf58153bb0 con 0x7fbf580bcbe0 2023-10-14T09:18:02.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf4e7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbf5806c970 0x7fbf581571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf4e7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbf5806c970 0x7fbf581571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60648/0 (socket says 172.21.15.78:60648) 2023-10-14T09:18:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf4e7fc640 1 -- 172.21.15.78:0/2339240105 learned_addr learned my addr 172.21.15.78:0/2339240105 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf56ffd640 1 --1- 172.21.15.78:0/2339240105 >> v1:172.21.15.78:6789/0 conn(0x7fbf5814a2e0 0x7fbf58154390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50094/0 (socket says 172.21.15.78:50094) 2023-10-14T09:18:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf577fe640 1 --2- 172.21.15.78:0/2339240105 >> v2:172.21.15.157:3300/0 conn(0x7fbf580bcbe0 0x7fbf5814a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf4e7fc640 1 -- 172.21.15.78:0/2339240105 >> v2:172.21.15.157:3300/0 conn(0x7fbf580bcbe0 msgr2=0x7fbf5814a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf4e7fc640 1 --2- 172.21.15.78:0/2339240105 >> v2:172.21.15.157:3300/0 conn(0x7fbf580bcbe0 0x7fbf5814a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf4e7fc640 1 -- 172.21.15.78:0/2339240105 >> v1:172.21.15.78:6789/0 conn(0x7fbf5814a2e0 legacy=0x7fbf58154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf4e7fc640 1 -- 172.21.15.78:0/2339240105 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf580c41d0 con 0x7fbf5806c970 2023-10-14T09:18:02.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.968+0000 7fbf4e7fc640 1 --2- 172.21.15.78:0/2339240105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf5806c970 0x7fbf581571a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbf580c5be0 tx=0x7fbf4001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b89d8f7e0051c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf567fc640 1 -- 172.21.15.78:0/2339240105 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf400ad460 con 0x7fbf5806c970 2023-10-14T09:18:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf567fc640 1 -- 172.21.15.78:0/2339240105 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf400ad5c0 con 0x7fbf5806c970 2023-10-14T09:18:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf567fc640 1 -- 172.21.15.78:0/2339240105 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf400ad950 con 0x7fbf5806c970 2023-10-14T09:18:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/2339240105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf5806c970 msgr2=0x7fbf581571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 --2- 172.21.15.78:0/2339240105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf5806c970 0x7fbf581571a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbf580c5be0 tx=0x7fbf4001c470 comp rx=0 tx=0).stop 2023-10-14T09:18:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/2339240105 shutdown_connections 2023-10-14T09:18:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 --2- 172.21.15.78:0/2339240105 >> v2:172.21.15.157:3300/0 conn(0x7fbf580bcbe0 0x7fbf5814a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 --2- 172.21.15.78:0/2339240105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf5806c970 0x7fbf581571a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/2339240105 >> 172.21.15.78:0/2339240105 conn(0x7fbf58071790 msgr2=0x7fbf58071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:02.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/2339240105 shutdown_connections 2023-10-14T09:18:02.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/2339240105 wait complete. 2023-10-14T09:18:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 Processor -- start 2023-10-14T09:18:02.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 -- start start 2023-10-14T09:18:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf5806c970 0x7fbf58152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf580bcbe0 0x7fbf581ecbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf5814a2e0 0x7fbf581ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580abf60 con 0x7fbf5806c970 2023-10-14T09:18:02.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf581ed670 con 0x7fbf580bcbe0 2023-10-14T09:18:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf5d7aa640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580aeba0 con 0x7fbf5814a2e0 2023-10-14T09:18:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf56ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf5806c970 0x7fbf58152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf56ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf5806c970 0x7fbf58152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60654/0 (socket says 172.21.15.78:60654) 2023-10-14T09:18:02.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf56ffd640 1 -- 172.21.15.78:0/1495585837 learned_addr learned my addr 172.21.15.78:0/1495585837 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.972+0000 7fbf4e7fc640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf580bcbe0 0x7fbf581ecbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf577fe640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf5814a2e0 0x7fbf581ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf56ffd640 1 -- 172.21.15.78:0/1495585837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf5814a2e0 msgr2=0x7fbf581ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf56ffd640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf5814a2e0 0x7fbf581ed130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf56ffd640 1 -- 172.21.15.78:0/1495585837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf580bcbe0 msgr2=0x7fbf581ecbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf56ffd640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf580bcbe0 0x7fbf581ecbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf56ffd640 1 -- 172.21.15.78:0/1495585837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400094d0 con 0x7fbf5806c970 2023-10-14T09:18:02.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf56ffd640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf5806c970 0x7fbf58152fb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800c8a0 tx=0x7fbf4800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf4ffff640 1 -- 172.21.15.78:0/1495585837 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800a640 con 0x7fbf5806c970 2023-10-14T09:18:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf4ffff640 1 -- 172.21.15.78:0/1495585837 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4800a7a0 con 0x7fbf5806c970 2023-10-14T09:18:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf4ffff640 1 -- 172.21.15.78:0/1495585837 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800ab10 con 0x7fbf5806c970 2023-10-14T09:18:02.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/1495585837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf580ae8a0 con 0x7fbf5806c970 2023-10-14T09:18:02.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/1495585837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf580ac440 con 0x7fbf5806c970 2023-10-14T09:18:02.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/1495585837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf58074110 con 0x7fbf5806c970 2023-10-14T09:18:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf4ffff640 1 -- 172.21.15.78:0/1495585837 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbf4800ac70 con 0x7fbf5806c970 2023-10-14T09:18:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf4ffff640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbf380664d0 0x7fbf38068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:02.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf4ffff640 1 -- 172.21.15.78:0/1495585837 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf48083680 con 0x7fbf5806c970 2023-10-14T09:18:02.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.976+0000 7fbf4e7fc640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbf380664d0 0x7fbf38068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:02.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.980+0000 7fbf4e7fc640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbf380664d0 0x7fbf38068990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf400af000 tx=0x7fbf40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:02.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:02.980+0000 7fbf4ffff640 1 -- 172.21.15.78:0/1495585837 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbf48050ba0 con 0x7fbf5806c970 2023-10-14T09:18:03.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.128+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/1495585837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf5806c750 con 0x7fbf5806c970 2023-10-14T09:18:03.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.128+0000 7fbf4ffff640 1 -- 172.21.15.78:0/1495585837 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf480541c0 con 0x7fbf5806c970 2023-10-14T09:18:03.133 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:18:03.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/1495585837 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbf380664d0 msgr2=0x7fbf38068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbf380664d0 0x7fbf38068990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf400af000 tx=0x7fbf40008040 comp rx=0 tx=0).stop 2023-10-14T09:18:03.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/1495585837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf5806c970 msgr2=0x7fbf58152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf5806c970 0x7fbf58152fb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800c8a0 tx=0x7fbf4800cd60 comp rx=0 tx=0).stop 2023-10-14T09:18:03.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/1495585837 shutdown_connections 2023-10-14T09:18:03.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbf380664d0 0x7fbf38068990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbf5814a2e0 0x7fbf581ed130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf580bcbe0 0x7fbf581ecbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 --2- 172.21.15.78:0/1495585837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf5806c970 0x7fbf58152fb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/1495585837 >> 172.21.15.78:0/1495585837 conn(0x7fbf58071790 msgr2=0x7fbf58155a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:03.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/1495585837 shutdown_connections 2023-10-14T09:18:03.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.132+0000 7fbf5d7aa640 1 -- 172.21.15.78:0/1495585837 wait complete. 2023-10-14T09:18:03.153 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:18:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.292+0000 7f117a772640 1 Processor -- start 2023-10-14T09:18:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.292+0000 7f117a772640 1 -- start start 2023-10-14T09:18:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.292+0000 7f117a772640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f117413af90 0x7f11740bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.292+0000 7f117a772640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11740bfc00 0x7f117406bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f117a772640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1174151c90 con 0x7f11740c0060 2023-10-14T09:18:03.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f117a772640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11740bada0 con 0x7f117413af90 2023-10-14T09:18:03.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f117a772640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11740bafd0 con 0x7f11740bfc00 2023-10-14T09:18:03.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f1178d0f640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f11740c0060 0x7f1174155200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50102/0 (socket says 172.21.15.78:50102) 2023-10-14T09:18:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f1178d0f640 1 -- 172.21.15.78:0/841787732 learned_addr learned my addr 172.21.15.78:0/841787732 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f1173fff640 1 --2- 172.21.15.78:0/841787732 >> v2:172.21.15.157:3300/0 conn(0x7f117413af90 0x7f11740bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f11737fe640 1 --2- 172.21.15.78:0/841787732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11740bfc00 0x7f117406bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f1172ffd640 1 -- 172.21.15.78:0/841787732 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893076458 0 0) 0x7f1174151c90 con 0x7f11740c0060 2023-10-14T09:18:03.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f1172ffd640 1 -- 172.21.15.78:0/841787732 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f115c007940 con 0x7f11740c0060 2023-10-14T09:18:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f1173fff640 1 -- 172.21.15.78:0/841787732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11740bfc00 msgr2=0x7f117406bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f1173fff640 1 --2- 172.21.15.78:0/841787732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11740bfc00 0x7f117406bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f1172ffd640 1 -- 172.21.15.78:0/841787732 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1623616812 0 0) 0x7f115c007940 con 0x7f11740c0060 2023-10-14T09:18:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f1173fff640 1 -- 172.21.15.78:0/841787732 >> v1:172.21.15.78:6789/0 conn(0x7f11740c0060 legacy=0x7f1174155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.296+0000 7f1173fff640 1 -- 172.21.15.78:0/841787732 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740bb2b0 con 0x7f117413af90 2023-10-14T09:18:03.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f1173fff640 1 --2- 172.21.15.78:0/841787732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f117413af90 0x7f11740bbd90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f11640097c0 tx=0x7f116401c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=676179b24374f5bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f1172ffd640 1 -- 172.21.15.78:0/841787732 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c001a00 con 0x7f117413af90 2023-10-14T09:18:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f1172ffd640 1 -- 172.21.15.78:0/841787732 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11640a7050 con 0x7f117413af90 2023-10-14T09:18:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f1172ffd640 1 -- 172.21.15.78:0/841787732 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11640ab400 con 0x7f117413af90 2023-10-14T09:18:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f117a772640 1 -- 172.21.15.78:0/841787732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f117413af90 msgr2=0x7f11740bbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f117a772640 1 --2- 172.21.15.78:0/841787732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f117413af90 0x7f11740bbd90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f11640097c0 tx=0x7f116401c2e0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f117a772640 1 -- 172.21.15.78:0/841787732 shutdown_connections 2023-10-14T09:18:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f117a772640 1 --2- 172.21.15.78:0/841787732 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11740bfc00 0x7f117406bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f117a772640 1 --2- 172.21.15.78:0/841787732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f117413af90 0x7f11740bbd90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f117a772640 1 -- 172.21.15.78:0/841787732 >> 172.21.15.78:0/841787732 conn(0x7f11740c1d00 msgr2=0x7f11740c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:03.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f117a772640 1 -- 172.21.15.78:0/841787732 shutdown_connections 2023-10-14T09:18:03.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f117a772640 1 -- 172.21.15.78:0/841787732 wait complete. 2023-10-14T09:18:03.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f117a772640 1 Processor -- start 2023-10-14T09:18:03.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.300+0000 7f117a772640 1 -- start start 2023-10-14T09:18:03.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f117a772640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11740bfc00 0x7f11741375f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f117a772640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11740c0060 0x7f11740bc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f117a772640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f117413af90 0x7f11740bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f117a772640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117413bd80 con 0x7f117413af90 2023-10-14T09:18:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f117a772640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117414f5f0 con 0x7f11740c0060 2023-10-14T09:18:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f117a772640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11741ebbe0 con 0x7f11740bfc00 2023-10-14T09:18:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1178d0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f117413af90 0x7f11740bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1178d0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f117413af90 0x7f11740bcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60662/0 (socket says 172.21.15.78:60662) 2023-10-14T09:18:03.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1178d0f640 1 -- 172.21.15.78:0/2412926485 learned_addr learned my addr 172.21.15.78:0/2412926485 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:03.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1173fff640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11740bfc00 0x7f11741375f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f11737fe640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11740c0060 0x7f11740bc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1178d0f640 1 -- 172.21.15.78:0/2412926485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11740bfc00 msgr2=0x7f11741375f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1178d0f640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11740bfc00 0x7f11741375f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1178d0f640 1 -- 172.21.15.78:0/2412926485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11740c0060 msgr2=0x7f11740bc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1178d0f640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11740c0060 0x7f11740bc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1178d0f640 1 -- 172.21.15.78:0/2412926485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1164009420 con 0x7f117413af90 2023-10-14T09:18:03.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1178d0f640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f117413af90 0x7f11740bcd40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f116c00cc70 tx=0x7f116c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1170ff9640 1 -- 172.21.15.78:0/2412926485 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c00ce80 con 0x7f117413af90 2023-10-14T09:18:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1170ff9640 1 -- 172.21.15.78:0/2412926485 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c012400 con 0x7f117413af90 2023-10-14T09:18:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1170ff9640 1 -- 172.21.15.78:0/2412926485 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0127d0 con 0x7f117413af90 2023-10-14T09:18:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f117a772640 1 -- 172.21.15.78:0/2412926485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11741ebec0 con 0x7f117413af90 2023-10-14T09:18:03.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f117a772640 1 -- 172.21.15.78:0/2412926485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117414f280 con 0x7f117413af90 2023-10-14T09:18:03.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f117a772640 1 -- 172.21.15.78:0/2412926485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11741530e0 con 0x7f117413af90 2023-10-14T09:18:03.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.304+0000 7f1170ff9640 1 -- 172.21.15.78:0/2412926485 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f116c007070 con 0x7f117413af90 2023-10-14T09:18:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.308+0000 7f1170ff9640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11600664a0 0x7f1160068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.308+0000 7f1170ff9640 1 -- 172.21.15.78:0/2412926485 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f116c083f60 con 0x7f117413af90 2023-10-14T09:18:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.308+0000 7f1173fff640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11600664a0 0x7f1160068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.308+0000 7f1173fff640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11600664a0 0x7f1160068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11640ad000 tx=0x7f11640a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:03.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.312+0000 7f1170ff9640 1 -- 172.21.15.78:0/2412926485 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f11741530e0 con 0x7f117413af90 2023-10-14T09:18:03.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 -- 172.21.15.78:0/2412926485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11741530e0 con 0x7f117413af90 2023-10-14T09:18:03.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f1170ff9640 1 -- 172.21.15.78:0/2412926485 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11741530e0 con 0x7f117413af90 2023-10-14T09:18:03.463 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:18:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 -- 172.21.15.78:0/2412926485 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11600664a0 msgr2=0x7f1160068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11600664a0 0x7f1160068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11640ad000 tx=0x7f11640a6000 comp rx=0 tx=0).stop 2023-10-14T09:18:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 -- 172.21.15.78:0/2412926485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f117413af90 msgr2=0x7f11740bcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f117413af90 0x7f11740bcd40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f116c00cc70 tx=0x7f116c00a430 comp rx=0 tx=0).stop 2023-10-14T09:18:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 -- 172.21.15.78:0/2412926485 shutdown_connections 2023-10-14T09:18:03.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f117413af90 0x7f11740bcd40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f11740c0060 0x7f11740bc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11600664a0 0x7f1160068960 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 --2- 172.21.15.78:0/2412926485 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11740bfc00 0x7f11741375f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 -- 172.21.15.78:0/2412926485 >> 172.21.15.78:0/2412926485 conn(0x7f11740c1d00 msgr2=0x7f1174151f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:03.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 -- 172.21.15.78:0/2412926485 shutdown_connections 2023-10-14T09:18:03.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.460+0000 7f117a772640 1 -- 172.21.15.78:0/2412926485 wait complete. 2023-10-14T09:18:03.485 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:03.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7fa479640 1 Processor -- start 2023-10-14T09:18:03.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7fa479640 1 -- start start 2023-10-14T09:18:03.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7fa479640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd7f40c0450 0x7fd7f406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7fa479640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f40c1230 0x7fd7f40c0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7fa479640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f406bcc0 con 0x7fd7f406d750 2023-10-14T09:18:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7fa479640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f406c340 con 0x7fd7f40c0450 2023-10-14T09:18:03.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7fa479640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f406ce70 con 0x7fd7f40c1230 2023-10-14T09:18:03.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7f37fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f40c1230 0x7fd7f40c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7f37fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f40c1230 0x7fd7f40c0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:36604/0 (socket says 172.21.15.78:36604) 2023-10-14T09:18:03.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7f37fe640 1 -- 172.21.15.78:0/983491135 learned_addr learned my addr 172.21.15.78:0/983491135 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:03.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7f3fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd7f40c0450 0x7fd7f406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7f2ffd640 1 -- 172.21.15.78:0/983491135 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760064158 0 0) 0x7fd7f406bcc0 con 0x7fd7f406d750 2023-10-14T09:18:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7f37fe640 1 -- 172.21.15.78:0/983491135 >> v2:172.21.15.157:3300/0 conn(0x7fd7f40c0450 msgr2=0x7fd7f406fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7f37fe640 1 --2- 172.21.15.78:0/983491135 >> v2:172.21.15.157:3300/0 conn(0x7fd7f40c0450 0x7fd7f406fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7f37fe640 1 -- 172.21.15.78:0/983491135 >> v1:172.21.15.157:6789/0 conn(0x7fd7f406d750 legacy=0x7fd7f406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7f37fe640 1 -- 172.21.15.78:0/983491135 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4150dd0 con 0x7fd7f40c1230 2023-10-14T09:18:03.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.620+0000 7fd7f3fff640 1 --2- 172.21.15.78:0/983491135 >> v2:172.21.15.157:3300/0 conn(0x7fd7f40c0450 0x7fd7f406fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:18:03.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7f37fe640 1 --2- 172.21.15.78:0/983491135 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f40c1230 0x7fd7f40c0830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800bb10 tx=0x7fd7e801f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab6a16b6d677849 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:03.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7f2ffd640 1 -- 172.21.15.78:0/983491135 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80a7b70 con 0x7fd7f40c1230 2023-10-14T09:18:03.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7f2ffd640 1 -- 172.21.15.78:0/983491135 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e80a7cd0 con 0x7fd7f40c1230 2023-10-14T09:18:03.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7f2ffd640 1 -- 172.21.15.78:0/983491135 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80af660 con 0x7fd7f40c1230 2023-10-14T09:18:03.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7fa479640 1 -- 172.21.15.78:0/983491135 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f40c1230 msgr2=0x7fd7f40c0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7fa479640 1 --2- 172.21.15.78:0/983491135 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f40c1230 0x7fd7f40c0830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800bb10 tx=0x7fd7e801f670 comp rx=0 tx=0).stop 2023-10-14T09:18:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7fa479640 1 -- 172.21.15.78:0/983491135 shutdown_connections 2023-10-14T09:18:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7fa479640 1 --2- 172.21.15.78:0/983491135 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f40c1230 0x7fd7f40c0830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7fa479640 1 --2- 172.21.15.78:0/983491135 >> v2:172.21.15.157:3300/0 conn(0x7fd7f40c0450 0x7fd7f406fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7fa479640 1 -- 172.21.15.78:0/983491135 >> 172.21.15.78:0/983491135 conn(0x7fd7f40c1cc0 msgr2=0x7fd7f40c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7fa479640 1 -- 172.21.15.78:0/983491135 shutdown_connections 2023-10-14T09:18:03.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.624+0000 7fd7fa479640 1 -- 172.21.15.78:0/983491135 wait complete. 2023-10-14T09:18:03.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7fa479640 1 Processor -- start 2023-10-14T09:18:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7fa479640 1 -- start start 2023-10-14T09:18:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7fa479640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f406d750 0x7fd7f41590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7fa479640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f40c0450 0x7fd7f414e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7fa479640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7f40c1230 0x7fd7f414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7fa479640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f41eca90 con 0x7fd7f40c0450 2023-10-14T09:18:03.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7fa479640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f41f0440 con 0x7fd7f40c1230 2023-10-14T09:18:03.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7fa479640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f41ecf20 con 0x7fd7f406d750 2023-10-14T09:18:03.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f40c0450 0x7fd7f414e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f40c0450 0x7fd7f414e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60678/0 (socket says 172.21.15.78:60678) 2023-10-14T09:18:03.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f37fe640 1 -- 172.21.15.78:0/3063220661 learned_addr learned my addr 172.21.15.78:0/3063220661 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:03.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f8a16640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7f40c1230 0x7fd7f414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f3fff640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f406d750 0x7fd7f41590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f37fe640 1 -- 172.21.15.78:0/3063220661 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f406d750 msgr2=0x7fd7f41590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f37fe640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f406d750 0x7fd7f41590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f37fe640 1 -- 172.21.15.78:0/3063220661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7f40c1230 msgr2=0x7fd7f414ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f37fe640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7f40c1230 0x7fd7f414ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f37fe640 1 -- 172.21.15.78:0/3063220661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4009420 con 0x7fd7f40c0450 2023-10-14T09:18:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f37fe640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f40c0450 0x7fd7f414e730 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd7e801d2c0 tx=0x7fd7e801b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:03.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f0ff9640 1 -- 172.21.15.78:0/3063220661 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80ba660 con 0x7fd7f40c0450 2023-10-14T09:18:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f0ff9640 1 -- 172.21.15.78:0/3063220661 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e80ba7c0 con 0x7fd7f40c0450 2023-10-14T09:18:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7fa479640 1 -- 172.21.15.78:0/3063220661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e800b770 con 0x7fd7f40c0450 2023-10-14T09:18:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7f0ff9640 1 -- 172.21.15.78:0/3063220661 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80bab50 con 0x7fd7f40c0450 2023-10-14T09:18:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.628+0000 7fd7fa479640 1 -- 172.21.15.78:0/3063220661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f41ec160 con 0x7fd7f40c0450 2023-10-14T09:18:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.632+0000 7fd7fa479640 1 -- 172.21.15.78:0/3063220661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f4074180 con 0x7fd7f40c0450 2023-10-14T09:18:03.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.632+0000 7fd7f0ff9640 1 -- 172.21.15.78:0/3063220661 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7e80c2360 con 0x7fd7f40c0450 2023-10-14T09:18:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.632+0000 7fd7f0ff9640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7e00664a0 0x7fd7e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.632+0000 7fd7f0ff9640 1 -- 172.21.15.78:0/3063220661 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7e80a7e40 con 0x7fd7f40c0450 2023-10-14T09:18:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.632+0000 7fd7f3fff640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7e00664a0 0x7fd7e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.632+0000 7fd7f3fff640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7e00664a0 0x7fd7e0068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009cf0 tx=0x7fd7e4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.636+0000 7fd7f0ff9640 1 -- 172.21.15.78:0/3063220661 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd7e80ec1d0 con 0x7fd7f40c0450 2023-10-14T09:18:03.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 -- 172.21.15.78:0/3063220661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7f40c2810 con 0x7fd7f40c0450 2023-10-14T09:18:03.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7f0ff9640 1 -- 172.21.15.78:0/3063220661 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fd7e80bf090 con 0x7fd7f40c0450 2023-10-14T09:18:03.822 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:03.823 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1987032053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1987032053},{"type":"v1","addr":"172.21.15.157:6834","nonce":1987032053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/20028755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":20028755},{"type":"v1","addr":"172.21.15.78:6836","nonce":20028755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3671283338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3671283338},{"type":"v1","addr":"172.21.15.78:6837","nonce":3671283338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:17:25.006130+0000","modified":"2023-10-14T09:17:28.036173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/3774780175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3774780175},{"type":"v1","addr":"172.21.15.157:6835","nonce":3774780175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:18:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-10-14T09:18:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 -- 172.21.15.78:0/3063220661 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7e00664a0 msgr2=0x7fd7e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7e00664a0 0x7fd7e0068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009cf0 tx=0x7fd7e4009190 comp rx=0 tx=0).stop 2023-10-14T09:18:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 -- 172.21.15.78:0/3063220661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f40c0450 msgr2=0x7fd7f414e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f40c0450 0x7fd7f414e730 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd7e801d2c0 tx=0x7fd7e801b9b0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 -- 172.21.15.78:0/3063220661 shutdown_connections 2023-10-14T09:18:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd7f40c1230 0x7fd7f414ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f40c0450 0x7fd7f414e730 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7e00664a0 0x7fd7e0068960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 --2- 172.21.15.78:0/3063220661 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd7f406d750 0x7fd7f41590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 -- 172.21.15.78:0/3063220661 >> 172.21.15.78:0/3063220661 conn(0x7fd7f40c1cc0 msgr2=0x7fd7f40c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 -- 172.21.15.78:0/3063220661 shutdown_connections 2023-10-14T09:18:03.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.820+0000 7fd7fa479640 1 -- 172.21.15.78:0/3063220661 wait complete. 2023-10-14T09:18:03.843 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:18:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.976+0000 7f0efa0d6640 1 Processor -- start 2023-10-14T09:18:03.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.976+0000 7f0efa0d6640 1 -- start start 2023-10-14T09:18:03.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.976+0000 7f0efa0d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ef4071f00 0x7f0ef40a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.976+0000 7f0efa0d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0ef406ab50 0x7f0ef4157a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.976+0000 7f0efa0d6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef4072390 con 0x7f0ef4154a10 2023-10-14T09:18:03.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.976+0000 7f0efa0d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef40a7f70 con 0x7f0ef406ab50 2023-10-14T09:18:03.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.976+0000 7f0efa0d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef406d580 con 0x7f0ef4071f00 2023-10-14T09:18:03.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0ef406ab50 0x7f0ef4157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0ef406ab50 0x7f0ef4157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60686/0 (socket says 172.21.15.78:60686) 2023-10-14T09:18:03.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef3fff640 1 -- 172.21.15.78:0/2423062297 learned_addr learned my addr 172.21.15.78:0/2423062297 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:03.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef2ffd640 1 --2- 172.21.15.78:0/2423062297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ef4071f00 0x7f0ef40a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef3fff640 1 -- 172.21.15.78:0/2423062297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ef4071f00 msgr2=0x7f0ef40a8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:03.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef3fff640 1 --2- 172.21.15.78:0/2423062297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ef4071f00 0x7f0ef40a8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef3fff640 1 -- 172.21.15.78:0/2423062297 >> v1:172.21.15.157:6789/0 conn(0x7f0ef4154a10 legacy=0x7f0ef4069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:03.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef3fff640 1 -- 172.21.15.78:0/2423062297 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef406d860 con 0x7f0ef406ab50 2023-10-14T09:18:03.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef2ffd640 1 --2- 172.21.15.78:0/2423062297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ef4071f00 0x7f0ef40a8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:03.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef3fff640 1 --2- 172.21.15.78:0/2423062297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef406ab50 0x7f0ef4157a30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009e50 tx=0x7f0eec01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ec60b337d0247a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:03.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef27fc640 1 -- 172.21.15.78:0/2423062297 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0a5660 con 0x7f0ef406ab50 2023-10-14T09:18:03.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef27fc640 1 -- 172.21.15.78:0/2423062297 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec0a57c0 con 0x7f0ef406ab50 2023-10-14T09:18:03.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.980+0000 7f0ef27fc640 1 -- 172.21.15.78:0/2423062297 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0a5b50 con 0x7f0ef406ab50 2023-10-14T09:18:03.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 -- 172.21.15.78:0/2423062297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef406ab50 msgr2=0x7f0ef4157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 --2- 172.21.15.78:0/2423062297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef406ab50 0x7f0ef4157a30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009e50 tx=0x7f0eec01c980 comp rx=0 tx=0).stop 2023-10-14T09:18:03.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 -- 172.21.15.78:0/2423062297 shutdown_connections 2023-10-14T09:18:03.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 --2- 172.21.15.78:0/2423062297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef406ab50 0x7f0ef4157a30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 --2- 172.21.15.78:0/2423062297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ef4071f00 0x7f0ef40a8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 -- 172.21.15.78:0/2423062297 >> 172.21.15.78:0/2423062297 conn(0x7f0ef406c9c0 msgr2=0x7f0ef406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:03.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 -- 172.21.15.78:0/2423062297 shutdown_connections 2023-10-14T09:18:03.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 -- 172.21.15.78:0/2423062297 wait complete. 2023-10-14T09:18:03.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 Processor -- start 2023-10-14T09:18:03.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 -- start start 2023-10-14T09:18:03.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef406ab50 0x7f0ef40c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ef4154a10 0x7f0ef41ecfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef41366b0 0x7f0ef413b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef41ed510 con 0x7f0ef41366b0 2023-10-14T09:18:03.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40c49a0 con 0x7f0ef406ab50 2023-10-14T09:18:03.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0efa0d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40c4c80 con 0x7f0ef4154a10 2023-10-14T09:18:03.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0ef3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef41366b0 0x7f0ef413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0ef37fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef406ab50 0x7f0ef40c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0ef3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef41366b0 0x7f0ef413b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60690/0 (socket says 172.21.15.78:60690) 2023-10-14T09:18:03.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0ef3fff640 1 -- 172.21.15.78:0/240757943 learned_addr learned my addr 172.21.15.78:0/240757943 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:03.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.984+0000 7f0ef2ffd640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ef4154a10 0x7f0ef41ecfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0ef3fff640 1 -- 172.21.15.78:0/240757943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ef4154a10 msgr2=0x7f0ef41ecfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0ef3fff640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ef4154a10 0x7f0ef41ecfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0ef3fff640 1 -- 172.21.15.78:0/240757943 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef406ab50 msgr2=0x7f0ef40c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:03.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0ef3fff640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef406ab50 0x7f0ef40c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:03.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0ef3fff640 1 -- 172.21.15.78:0/240757943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec009b30 con 0x7f0ef41366b0 2023-10-14T09:18:03.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0ef3fff640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef41366b0 0x7f0ef413b740 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0eec01a5b0 tx=0x7f0eec019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:03.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0edbfff640 1 -- 172.21.15.78:0/240757943 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0b8670 con 0x7f0ef41366b0 2023-10-14T09:18:03.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0edbfff640 1 -- 172.21.15.78:0/240757943 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec0b87d0 con 0x7f0ef41366b0 2023-10-14T09:18:03.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0edbfff640 1 -- 172.21.15.78:0/240757943 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0b8b60 con 0x7f0ef41366b0 2023-10-14T09:18:03.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0efa0d6640 1 -- 172.21.15.78:0/240757943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef413af40 con 0x7f0ef41366b0 2023-10-14T09:18:03.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0efa0d6640 1 -- 172.21.15.78:0/240757943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef4136b60 con 0x7f0ef41366b0 2023-10-14T09:18:03.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0efa0d6640 1 -- 172.21.15.78:0/240757943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef4074180 con 0x7f0ef41366b0 2023-10-14T09:18:03.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0edbfff640 1 -- 172.21.15.78:0/240757943 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0eec0b8cc0 con 0x7f0ef41366b0 2023-10-14T09:18:03.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0edbfff640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0ee00664a0 0x7f0ee0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:03.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.988+0000 7f0edbfff640 1 -- 172.21.15.78:0/240757943 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0eec11f240 con 0x7f0ef41366b0 2023-10-14T09:18:03.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.992+0000 7f0ef37fe640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0ee00664a0 0x7f0ee0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:03.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.992+0000 7f0ef37fe640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0ee00664a0 0x7f0ee0068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4007fd0 tx=0x7f0ee4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:03.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:03.992+0000 7f0edbfff640 1 -- 172.21.15.78:0/240757943 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0eec0ec880 con 0x7f0ef41366b0 2023-10-14T09:18:04.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.144+0000 7f0efa0d6640 1 -- 172.21.15.78:0/240757943 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ef406a8a0 con 0x7f0ef41366b0 2023-10-14T09:18:04.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0edbfff640 1 -- 172.21.15.78:0/240757943 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f0eec0efea0 con 0x7f0ef41366b0 2023-10-14T09:18:04.150 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:04.150 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:18:04.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 -- 172.21.15.78:0/240757943 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0ee00664a0 msgr2=0x7f0ee0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0ee00664a0 0x7f0ee0068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4007fd0 tx=0x7f0ee4009040 comp rx=0 tx=0).stop 2023-10-14T09:18:04.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 -- 172.21.15.78:0/240757943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef41366b0 msgr2=0x7f0ef413b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef41366b0 0x7f0ef413b740 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0eec01a5b0 tx=0x7f0eec019720 comp rx=0 tx=0).stop 2023-10-14T09:18:04.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 -- 172.21.15.78:0/240757943 shutdown_connections 2023-10-14T09:18:04.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ef41366b0 0x7f0ef413b740 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0ee00664a0 0x7f0ee0068960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ef4154a10 0x7f0ef41ecfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 --2- 172.21.15.78:0/240757943 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ef406ab50 0x7f0ef40c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 -- 172.21.15.78:0/240757943 >> 172.21.15.78:0/240757943 conn(0x7f0ef406c9c0 msgr2=0x7f0ef4072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:04.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 -- 172.21.15.78:0/240757943 shutdown_connections 2023-10-14T09:18:04.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.148+0000 7f0efa0d6640 1 -- 172.21.15.78:0/240757943 wait complete. 2023-10-14T09:18:04.171 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T09:18:04.171 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:04.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2e6bb640 1 Processor -- start 2023-10-14T09:18:04.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2e6bb640 1 -- start start 2023-10-14T09:18:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2e6bb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fab2814ddb0 0x7fab280c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2e6bb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab28153e80 0x7fab2806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2e6bb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fab280c6910 0x7fab280c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2e6bb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab280c64f0 con 0x7fab280c6910 2023-10-14T09:18:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2e6bb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab280c5300 con 0x7fab2814ddb0 2023-10-14T09:18:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2e6bb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2806c470 con 0x7fab28153e80 2023-10-14T09:18:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2cc58640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fab280c6910 0x7fab280c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2cc58640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fab280c6910 0x7fab280c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60704/0 (socket says 172.21.15.78:60704) 2023-10-14T09:18:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2cc58640 1 -- 172.21.15.78:0/3528865271 learned_addr learned my addr 172.21.15.78:0/3528865271 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab27fff640 1 --2- 172.21.15.78:0/3528865271 >> v2:172.21.15.157:3300/0 conn(0x7fab2814ddb0 0x7fab280c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab277fe640 1 --2- 172.21.15.78:0/3528865271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab28153e80 0x7fab2806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2cc58640 1 -- 172.21.15.78:0/3528865271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab28153e80 msgr2=0x7fab2806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:04.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2cc58640 1 --2- 172.21.15.78:0/3528865271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab28153e80 0x7fab2806bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2cc58640 1 -- 172.21.15.78:0/3528865271 >> v2:172.21.15.157:3300/0 conn(0x7fab2814ddb0 msgr2=0x7fab280c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2cc58640 1 --2- 172.21.15.78:0/3528865271 >> v2:172.21.15.157:3300/0 conn(0x7fab2814ddb0 0x7fab280c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.308+0000 7fab2cc58640 1 -- 172.21.15.78:0/3528865271 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2806c750 con 0x7fab280c6910 2023-10-14T09:18:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab2cc58640 1 --2- 172.21.15.78:0/3528865271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab280c6910 0x7fab280c3fe0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab280a8d80 tx=0x7fab2001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cfedbe20c348e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab26ffd640 1 -- 172.21.15.78:0/3528865271 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab200a5700 con 0x7fab280c6910 2023-10-14T09:18:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab26ffd640 1 -- 172.21.15.78:0/3528865271 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab200a5860 con 0x7fab280c6910 2023-10-14T09:18:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab26ffd640 1 -- 172.21.15.78:0/3528865271 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab200a5bf0 con 0x7fab280c6910 2023-10-14T09:18:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3528865271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab280c6910 msgr2=0x7fab280c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab2e6bb640 1 --2- 172.21.15.78:0/3528865271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab280c6910 0x7fab280c3fe0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab280a8d80 tx=0x7fab2001c880 comp rx=0 tx=0).stop 2023-10-14T09:18:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3528865271 shutdown_connections 2023-10-14T09:18:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab2e6bb640 1 --2- 172.21.15.78:0/3528865271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab280c6910 0x7fab280c3fe0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab2e6bb640 1 --2- 172.21.15.78:0/3528865271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab28153e80 0x7fab2806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab2e6bb640 1 --2- 172.21.15.78:0/3528865271 >> v2:172.21.15.157:3300/0 conn(0x7fab2814ddb0 0x7fab280c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3528865271 >> 172.21.15.78:0/3528865271 conn(0x7fab280ab1f0 msgr2=0x7fab280ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3528865271 shutdown_connections 2023-10-14T09:18:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.312+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3528865271 wait complete. 2023-10-14T09:18:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2e6bb640 1 Processor -- start 2023-10-14T09:18:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2e6bb640 1 -- start start 2023-10-14T09:18:04.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2e6bb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab280c6910 0x7fab281ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2e6bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2814ddb0 0x7fab2814a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2e6bb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab28153e80 0x7fab280c0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2e6bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2814a1a0 con 0x7fab2814ddb0 2023-10-14T09:18:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2e6bb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab28149870 con 0x7fab28153e80 2023-10-14T09:18:04.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2e6bb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab28149b50 con 0x7fab280c6910 2023-10-14T09:18:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2814ddb0 0x7fab2814a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2814ddb0 0x7fab2814a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60706/0 (socket says 172.21.15.78:60706) 2023-10-14T09:18:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab277fe640 1 -- 172.21.15.78:0/3742502250 learned_addr learned my addr 172.21.15.78:0/3742502250 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab27fff640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab280c6910 0x7fab281ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2cc58640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab28153e80 0x7fab280c0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab277fe640 1 -- 172.21.15.78:0/3742502250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab280c6910 msgr2=0x7fab281ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab277fe640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab280c6910 0x7fab281ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab277fe640 1 -- 172.21.15.78:0/3742502250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab28153e80 msgr2=0x7fab280c0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab277fe640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab28153e80 0x7fab280c0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab277fe640 1 -- 172.21.15.78:0/3742502250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab20009b30 con 0x7fab2814ddb0 2023-10-14T09:18:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2cc58640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab28153e80 0x7fab280c0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab277fe640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2814ddb0 0x7fab2814a630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00c7f0 tx=0x7fab1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab24ff9640 1 -- 172.21.15.78:0/3742502250 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c004220 con 0x7fab2814ddb0 2023-10-14T09:18:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab24ff9640 1 -- 172.21.15.78:0/3742502250 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c004380 con 0x7fab2814ddb0 2023-10-14T09:18:04.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3742502250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab28149e30 con 0x7fab2814ddb0 2023-10-14T09:18:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab24ff9640 1 -- 172.21.15.78:0/3742502250 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c003840 con 0x7fab2814ddb0 2023-10-14T09:18:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3742502250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab280c0ed0 con 0x7fab2814ddb0 2023-10-14T09:18:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.316+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3742502250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2814a350 con 0x7fab2814ddb0 2023-10-14T09:18:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.320+0000 7fab24ff9640 1 -- 172.21.15.78:0/3742502250 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fab1c003bb0 con 0x7fab2814ddb0 2023-10-14T09:18:04.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.320+0000 7fab24ff9640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fab140664d0 0x7fab14068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.320+0000 7fab24ff9640 1 -- 172.21.15.78:0/3742502250 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab1c083df0 con 0x7fab2814ddb0 2023-10-14T09:18:04.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.320+0000 7fab27fff640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fab140664d0 0x7fab14068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.320+0000 7fab27fff640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fab140664d0 0x7fab14068990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab1800c870 tx=0x7fab18008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:04.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.324+0000 7fab24ff9640 1 -- 172.21.15.78:0/3742502250 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fab2814a350 con 0x7fab2814ddb0 2023-10-14T09:18:04.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3742502250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab28149fc0 con 0x7fab2814ddb0 2023-10-14T09:18:04.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab24ff9640 1 -- 172.21.15.78:0/3742502250 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fab1c01e090 con 0x7fab2814ddb0 2023-10-14T09:18:04.507 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:04.507 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1987032053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1987032053},{"type":"v1","addr":"172.21.15.157:6834","nonce":1987032053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/20028755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":20028755},{"type":"v1","addr":"172.21.15.78:6836","nonce":20028755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3671283338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3671283338},{"type":"v1","addr":"172.21.15.78:6837","nonce":3671283338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:17:25.006130+0000","modified":"2023-10-14T09:17:28.036173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/3774780175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3774780175},{"type":"v1","addr":"172.21.15.157:6835","nonce":3774780175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:18:04.507 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-10-14T09:18:04.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3742502250 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fab140664d0 msgr2=0x7fab14068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fab140664d0 0x7fab14068990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab1800c870 tx=0x7fab18008040 comp rx=0 tx=0).stop 2023-10-14T09:18:04.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3742502250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2814ddb0 msgr2=0x7fab2814a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2814ddb0 0x7fab2814a630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00c7f0 tx=0x7fab1c00ccb0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3742502250 shutdown_connections 2023-10-14T09:18:04.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab28153e80 0x7fab280c0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab2814ddb0 0x7fab2814a630 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fab140664d0 0x7fab14068990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 --2- 172.21.15.78:0/3742502250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fab280c6910 0x7fab281ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3742502250 >> 172.21.15.78:0/3742502250 conn(0x7fab280ab1f0 msgr2=0x7fab280c8850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3742502250 shutdown_connections 2023-10-14T09:18:04.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.504+0000 7fab2e6bb640 1 -- 172.21.15.78:0/3742502250 wait complete. 2023-10-14T09:18:04.527 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:04.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.664+0000 7fe362217640 1 Processor -- start 2023-10-14T09:18:04.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.664+0000 7fe362217640 1 -- start start 2023-10-14T09:18:04.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.664+0000 7fe362217640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe35c14e0f0 0x7fe35c152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.664+0000 7fe362217640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe35c14ed10 0x7fe35c14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe362217640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c1531d0 con 0x7fe35c14f700 2023-10-14T09:18:04.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe362217640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35c153e50 con 0x7fe35c14e0f0 2023-10-14T09:18:04.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe362217640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35c1534b0 con 0x7fe35c14ed10 2023-10-14T09:18:04.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe35c14e0f0 0x7fe35c152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe35c14e0f0 0x7fe35c152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60716/0 (socket says 172.21.15.78:60716) 2023-10-14T09:18:04.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35b7fe640 1 -- 172.21.15.78:0/1601492537 learned_addr learned my addr 172.21.15.78:0/1601492537 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:04.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35affd640 1 --2- 172.21.15.78:0/1601492537 >> v2:172.21.15.157:3300/0 conn(0x7fe35c14ed10 0x7fe35c14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35b7fe640 1 -- 172.21.15.78:0/1601492537 >> v2:172.21.15.157:3300/0 conn(0x7fe35c14ed10 msgr2=0x7fe35c14f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:04.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35b7fe640 1 --2- 172.21.15.78:0/1601492537 >> v2:172.21.15.157:3300/0 conn(0x7fe35c14ed10 0x7fe35c14f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35b7fe640 1 -- 172.21.15.78:0/1601492537 >> v1:172.21.15.157:6789/0 conn(0x7fe35c14f700 legacy=0x7fe35c150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:04.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35b7fe640 1 -- 172.21.15.78:0/1601492537 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c153790 con 0x7fe35c14e0f0 2023-10-14T09:18:04.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35b7fe640 1 --2- 172.21.15.78:0/1601492537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c14e0f0 0x7fe35c152960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe35c151bd0 tx=0x7fe34c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f11adf8674e5cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:04.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35a7fc640 1 -- 172.21.15.78:0/1601492537 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c0ab600 con 0x7fe35c14e0f0 2023-10-14T09:18:04.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35a7fc640 1 -- 172.21.15.78:0/1601492537 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c0a7050 con 0x7fe35c14e0f0 2023-10-14T09:18:04.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.668+0000 7fe35a7fc640 1 -- 172.21.15.78:0/1601492537 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c0ab980 con 0x7fe35c14e0f0 2023-10-14T09:18:04.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 -- 172.21.15.78:0/1601492537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c14e0f0 msgr2=0x7fe35c152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 --2- 172.21.15.78:0/1601492537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c14e0f0 0x7fe35c152960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe35c151bd0 tx=0x7fe34c01c430 comp rx=0 tx=0).stop 2023-10-14T09:18:04.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 -- 172.21.15.78:0/1601492537 shutdown_connections 2023-10-14T09:18:04.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 --2- 172.21.15.78:0/1601492537 >> v2:172.21.15.157:3300/0 conn(0x7fe35c14ed10 0x7fe35c14f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 --2- 172.21.15.78:0/1601492537 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c14e0f0 0x7fe35c152960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 -- 172.21.15.78:0/1601492537 >> 172.21.15.78:0/1601492537 conn(0x7fe35c0c1cc0 msgr2=0x7fe35c0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:04.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 -- 172.21.15.78:0/1601492537 shutdown_connections 2023-10-14T09:18:04.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 -- 172.21.15.78:0/1601492537 wait complete. 2023-10-14T09:18:04.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 Processor -- start 2023-10-14T09:18:04.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 -- start start 2023-10-14T09:18:04.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c14e0f0 0x7fe35c146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe35c14ed10 0x7fe35c140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe35c14f700 0x7fe35c140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c15c030 con 0x7fe35c14e0f0 2023-10-14T09:18:04.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c06d180 con 0x7fe35c14ed10 2023-10-14T09:18:04.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe362217640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c06cea0 con 0x7fe35c14f700 2023-10-14T09:18:04.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe35b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c14e0f0 0x7fe35c146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe35b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c14e0f0 0x7fe35c146070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60724/0 (socket says 172.21.15.78:60724) 2023-10-14T09:18:04.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe35b7fe640 1 -- 172.21.15.78:0/265405178 learned_addr learned my addr 172.21.15.78:0/265405178 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:04.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe35affd640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe35c14ed10 0x7fe35c140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe35bfff640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe35c14f700 0x7fe35c140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe35b7fe640 1 -- 172.21.15.78:0/265405178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe35c14f700 msgr2=0x7fe35c140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe35b7fe640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe35c14f700 0x7fe35c140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe35b7fe640 1 -- 172.21.15.78:0/265405178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe35c14ed10 msgr2=0x7fe35c140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe35b7fe640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe35c14ed10 0x7fe35c140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.672+0000 7fe35b7fe640 1 -- 172.21.15.78:0/265405178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c0094d0 con 0x7fe35c14e0f0 2023-10-14T09:18:04.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.676+0000 7fe35b7fe640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c14e0f0 0x7fe35c146070 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0ae040 tx=0x7fe34c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:04.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.676+0000 7fe343fff640 1 -- 172.21.15.78:0/265405178 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c0b6620 con 0x7fe35c14e0f0 2023-10-14T09:18:04.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.676+0000 7fe343fff640 1 -- 172.21.15.78:0/265405178 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c0b67a0 con 0x7fe35c14e0f0 2023-10-14T09:18:04.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.676+0000 7fe343fff640 1 -- 172.21.15.78:0/265405178 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c0b6b50 con 0x7fe35c14e0f0 2023-10-14T09:18:04.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.676+0000 7fe362217640 1 -- 172.21.15.78:0/265405178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35c06c680 con 0x7fe35c14e0f0 2023-10-14T09:18:04.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.676+0000 7fe362217640 1 -- 172.21.15.78:0/265405178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35c142a20 con 0x7fe35c14e0f0 2023-10-14T09:18:04.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.676+0000 7fe3427fc640 1 -- 172.21.15.78:0/265405178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe334005260 con 0x7fe35c14e0f0 2023-10-14T09:18:04.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.676+0000 7fe343fff640 1 -- 172.21.15.78:0/265405178 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe34c0b2040 con 0x7fe35c14e0f0 2023-10-14T09:18:04.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.676+0000 7fe343fff640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe3480664a0 0x7fe348068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:04.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.676+0000 7fe343fff640 1 -- 172.21.15.78:0/265405178 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe34c11e370 con 0x7fe35c14e0f0 2023-10-14T09:18:04.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.676+0000 7fe35affd640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe3480664a0 0x7fe348068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:04.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.680+0000 7fe35affd640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe3480664a0 0x7fe348068960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe35c06c5b0 tx=0x7fe350008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:04.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.680+0000 7fe343fff640 1 -- 172.21.15.78:0/265405178 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe34c0eb7e0 con 0x7fe35c14e0f0 2023-10-14T09:18:04.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.864+0000 7fe3427fc640 1 -- 172.21.15.78:0/265405178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe334005a90 con 0x7fe35c14e0f0 2023-10-14T09:18:04.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.864+0000 7fe343fff640 1 -- 172.21.15.78:0/265405178 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fe34c0eee00 con 0x7fe35c14e0f0 2023-10-14T09:18:04.868 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:04.868 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6834/1987032053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":1987032053},{"type":"v1","addr":"172.21.15.157:6834","nonce":1987032053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/20028755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":20028755},{"type":"v1","addr":"172.21.15.78:6836","nonce":20028755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3671283338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":3671283338},{"type":"v1","addr":"172.21.15.78:6837","nonce":3671283338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:17:25.006130+0000","modified":"2023-10-14T09:17:28.036173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.157:6835/3774780175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6833","nonce":3774780175},{"type":"v1","addr":"172.21.15.157:6835","nonce":3774780175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:18:04.870 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 8 2023-10-14T09:18:04.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 -- 172.21.15.78:0/265405178 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe3480664a0 msgr2=0x7fe348068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe3480664a0 0x7fe348068960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe35c06c5b0 tx=0x7fe350008040 comp rx=0 tx=0).stop 2023-10-14T09:18:04.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 -- 172.21.15.78:0/265405178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c14e0f0 msgr2=0x7fe35c146070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:04.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c14e0f0 0x7fe35c146070 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0ae040 tx=0x7fe34c0191d0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 -- 172.21.15.78:0/265405178 shutdown_connections 2023-10-14T09:18:04.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe3480664a0 0x7fe348068960 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe35c14f700 0x7fe35c140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe35c14ed10 0x7fe35c140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 --2- 172.21.15.78:0/265405178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe35c14e0f0 0x7fe35c146070 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:04.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 -- 172.21.15.78:0/265405178 >> 172.21.15.78:0/265405178 conn(0x7fe35c0c1cc0 msgr2=0x7fe35c15ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:04.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 -- 172.21.15.78:0/265405178 shutdown_connections 2023-10-14T09:18:04.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:04.868+0000 7fe3427fc640 1 -- 172.21.15.78:0/265405178 wait complete. 2023-10-14T09:18:04.889 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:18:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee0e817640 1 Processor -- start 2023-10-14T09:18:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee0e817640 1 -- start start 2023-10-14T09:18:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee0e817640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fee080c7780 0x7fee080c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee0e817640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee080c7b90 con 0x7fee08153e80 2023-10-14T09:18:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee0e817640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee080c7020 con 0x7fee0814ddb0 2023-10-14T09:18:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee0e817640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee080c64f0 con 0x7fee080c7780 2023-10-14T09:18:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee077fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fee08153e80 0x7fee080c6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50112/0 (socket says 172.21.15.78:50112) 2023-10-14T09:18:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee077fe640 1 -- 172.21.15.78:0/4116267205 learned_addr learned my addr 172.21.15.78:0/4116267205 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee0cdb4640 1 --2- 172.21.15.78:0/4116267205 >> v2:172.21.15.157:3300/0 conn(0x7fee080c7780 0x7fee080c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723978048 0 0) 0x7fedfc001120 con 0x7fee08153e80 2023-10-14T09:18:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedf0003530 con 0x7fee08153e80 2023-10-14T09:18:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1965454934 0 0) 0x7fedf0003530 con 0x7fee08153e80 2023-10-14T09:18:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 >> v2:172.21.15.157:3300/0 conn(0x7fee080c7780 msgr2=0x7fee080c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 --2- 172.21.15.78:0/4116267205 >> v2:172.21.15.157:3300/0 conn(0x7fee080c7780 0x7fee080c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 >> v1:172.21.15.157:6789/0 conn(0x7fee0814ddb0 legacy=0x7fee0806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0806c470 con 0x7fee08153e80 2023-10-14T09:18:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7fedfc001810 con 0x7fee08153e80 2023-10-14T09:18:05.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 >> v1:172.21.15.78:6789/0 conn(0x7fee08153e80 legacy=0x7fee080c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 --2- 172.21.15.78:0/4116267205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 0x7fedf0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 --2- 172.21.15.78:0/4116267205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedf00047d0 0x7fedf0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 --2- 172.21.15.78:0/4116267205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedf00052b0 0x7fedf000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee080c64f0 con 0x7fedf0003980 2023-10-14T09:18:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf000c180 con 0x7fedf00047d0 2023-10-14T09:18:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf000c340 con 0x7fedf00052b0 2023-10-14T09:18:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee07fff640 1 --2- 172.21.15.78:0/4116267205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 0x7fedf0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee077fe640 1 --2- 172.21.15.78:0/4116267205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedf00047d0 0x7fedf0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee0cdb4640 1 --2- 172.21.15.78:0/4116267205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedf00052b0 0x7fedf000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee07fff640 1 -- 172.21.15.78:0/4116267205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedf00052b0 msgr2=0x7fedf000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:05.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee07fff640 1 --2- 172.21.15.78:0/4116267205 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedf00052b0 0x7fedf000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee07fff640 1 -- 172.21.15.78:0/4116267205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedf00047d0 msgr2=0x7fedf0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:05.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee07fff640 1 --2- 172.21.15.78:0/4116267205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedf00047d0 0x7fedf0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee07fff640 1 -- 172.21.15.78:0/4116267205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf0003530 con 0x7fedf0003980 2023-10-14T09:18:05.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.024+0000 7fee0cdb4640 1 -- 172.21.15.78:0/4116267205 reap_dead start 2023-10-14T09:18:05.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.028+0000 7fee07fff640 1 --2- 172.21.15.78:0/4116267205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 0x7fedf0003da0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fedf8001750 tx=0x7fedf801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59230bc6b35e723 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:05.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.028+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf80052d0 con 0x7fedf0003980 2023-10-14T09:18:05.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.028+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf80a7050 con 0x7fedf0003980 2023-10-14T09:18:05.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.028+0000 7fee06ffd640 1 -- 172.21.15.78:0/4116267205 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf8003600 con 0x7fedf0003980 2023-10-14T09:18:05.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.028+0000 7fee0e817640 1 -- 172.21.15.78:0/4116267205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 msgr2=0x7fedf0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.028+0000 7fee0e817640 1 --2- 172.21.15.78:0/4116267205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 0x7fedf0003da0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fedf8001750 tx=0x7fedf801c380 comp rx=0 tx=0).stop 2023-10-14T09:18:05.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.028+0000 7fee0e817640 1 -- 172.21.15.78:0/4116267205 shutdown_connections 2023-10-14T09:18:05.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.028+0000 7fee0e817640 1 --2- 172.21.15.78:0/4116267205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 0x7fedf0003da0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.028+0000 7fee0e817640 1 -- 172.21.15.78:0/4116267205 >> 172.21.15.78:0/4116267205 conn(0x7fee080ab1f0 msgr2=0x7fee080ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:05.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.028+0000 7fee0e817640 1 -- 172.21.15.78:0/4116267205 shutdown_connections 2023-10-14T09:18:05.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.028+0000 7fee0e817640 1 -- 172.21.15.78:0/4116267205 wait complete. 2023-10-14T09:18:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee0e817640 1 Processor -- start 2023-10-14T09:18:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee0e817640 1 -- start start 2023-10-14T09:18:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee0e817640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 0x7fee08155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee0e817640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee081573c0 0x7fee0814f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee0e817640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee08156090 0x7fee0814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee0e817640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee08156fa0 con 0x7fedf0003980 2023-10-14T09:18:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee0e817640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0814fea0 con 0x7fee081573c0 2023-10-14T09:18:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee0e817640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee08150c80 con 0x7fee08156090 2023-10-14T09:18:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee07fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 0x7fee08155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee07fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 0x7fee08155b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60750/0 (socket says 172.21.15.78:60750) 2023-10-14T09:18:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee07fff640 1 -- 172.21.15.78:0/731849668 learned_addr learned my addr 172.21.15.78:0/731849668 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee077fe640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee081573c0 0x7fee0814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee0cdb4640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee08156090 0x7fee0814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee07fff640 1 -- 172.21.15.78:0/731849668 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee08156090 msgr2=0x7fee0814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee07fff640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee08156090 0x7fee0814f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee07fff640 1 -- 172.21.15.78:0/731849668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee081573c0 msgr2=0x7fee0814f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee07fff640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee081573c0 0x7fee0814f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee07fff640 1 -- 172.21.15.78:0/731849668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee081581a0 con 0x7fedf0003980 2023-10-14T09:18:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee077fe640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee081573c0 0x7fee0814f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.032+0000 7fee07fff640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 0x7fee08155b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fedf8005040 tx=0x7fedf0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:05.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.036+0000 7fee04ff9640 1 -- 172.21.15.78:0/731849668 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf80072f0 con 0x7fedf0003980 2023-10-14T09:18:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.036+0000 7fee04ff9640 1 -- 172.21.15.78:0/731849668 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf8007450 con 0x7fedf0003980 2023-10-14T09:18:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.036+0000 7fee04ff9640 1 -- 172.21.15.78:0/731849668 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf80067e0 con 0x7fedf0003980 2023-10-14T09:18:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.036+0000 7fee0e817640 1 -- 172.21.15.78:0/731849668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee08151440 con 0x7fedf0003980 2023-10-14T09:18:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.036+0000 7fee0e817640 1 -- 172.21.15.78:0/731849668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee08151a00 con 0x7fedf0003980 2023-10-14T09:18:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.036+0000 7fee0e817640 1 -- 172.21.15.78:0/731849668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee08074180 con 0x7fedf0003980 2023-10-14T09:18:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.036+0000 7fee04ff9640 1 -- 172.21.15.78:0/731849668 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fedf8006940 con 0x7fedf0003980 2023-10-14T09:18:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.036+0000 7fee04ff9640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fedf40664d0 0x7fedf4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.036+0000 7fee04ff9640 1 -- 172.21.15.78:0/731849668 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedf811dfa0 con 0x7fedf0003980 2023-10-14T09:18:05.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.036+0000 7fee077fe640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fedf40664d0 0x7fedf4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.036+0000 7fee077fe640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fedf40664d0 0x7fedf4068990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fee080aa730 tx=0x7fedfc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.040+0000 7fee04ff9640 1 -- 172.21.15.78:0/731849668 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fedf80eb410 con 0x7fedf0003980 2023-10-14T09:18:05.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.196+0000 7fee0e817640 1 -- 172.21.15.78:0/731849668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee080c7560 con 0x7fedf0003980 2023-10-14T09:18:05.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.196+0000 7fee04ff9640 1 -- 172.21.15.78:0/731849668 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fedf80eea30 con 0x7fedf0003980 2023-10-14T09:18:05.201 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:05.202 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":20,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:17:26.049067+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T09:17:23.221895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T09:17:24.005188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:18:05.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 -- 172.21.15.78:0/731849668 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fedf40664d0 msgr2=0x7fedf4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fedf40664d0 0x7fedf4068990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fee080aa730 tx=0x7fedfc009040 comp rx=0 tx=0).stop 2023-10-14T09:18:05.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 -- 172.21.15.78:0/731849668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 msgr2=0x7fee08155b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 0x7fee08155b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fedf8005040 tx=0x7fedf0005800 comp rx=0 tx=0).stop 2023-10-14T09:18:05.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 -- 172.21.15.78:0/731849668 shutdown_connections 2023-10-14T09:18:05.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fedf40664d0 0x7fedf4068990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fee08156090 0x7fee0814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee081573c0 0x7fee0814f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 --2- 172.21.15.78:0/731849668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedf0003980 0x7fee08155b50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 -- 172.21.15.78:0/731849668 >> 172.21.15.78:0/731849668 conn(0x7fee080ab1f0 msgr2=0x7fee080c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:05.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 -- 172.21.15.78:0/731849668 shutdown_connections 2023-10-14T09:18:05.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.200+0000 7fee0e817640 1 -- 172.21.15.78:0/731849668 wait complete. 2023-10-14T09:18:05.222 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T09:18:05.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.360+0000 7f22bc2c9640 1 Processor -- start 2023-10-14T09:18:05.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.360+0000 7f22bc2c9640 1 -- start start 2023-10-14T09:18:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.360+0000 7f22bc2c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22b414e0f0 0x7f22b4152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.360+0000 7f22bc2c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f22b4150a90 0x7f22b4150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.360+0000 7f22bc2c9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b41531d0 con 0x7f22b414ed10 2023-10-14T09:18:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.360+0000 7f22bc2c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b4153e50 con 0x7f22b4150a90 2023-10-14T09:18:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.360+0000 7f22bc2c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41534b0 con 0x7f22b414e0f0 2023-10-14T09:18:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.360+0000 7f22ba866640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f22b4150a90 0x7f22b4150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.360+0000 7f22ba866640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f22b4150a90 0x7f22b4150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60762/0 (socket says 172.21.15.78:60762) 2023-10-14T09:18:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.360+0000 7f22ba866640 1 -- 172.21.15.78:0/1225958635 learned_addr learned my addr 172.21.15.78:0/1225958635 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.360+0000 7f22ba065640 1 --2- 172.21.15.78:0/1225958635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22b414e0f0 0x7f22b4152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.364+0000 7f22ba866640 1 -- 172.21.15.78:0/1225958635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22b414e0f0 msgr2=0x7f22b4152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.364+0000 7f22ba866640 1 --2- 172.21.15.78:0/1225958635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22b414e0f0 0x7f22b4152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.364+0000 7f22ba866640 1 -- 172.21.15.78:0/1225958635 >> v1:172.21.15.157:6789/0 conn(0x7f22b414ed10 legacy=0x7f22b414f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:05.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.364+0000 7f22ba866640 1 -- 172.21.15.78:0/1225958635 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b4153790 con 0x7f22b4150a90 2023-10-14T09:18:05.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.364+0000 7f22ba866640 1 --2- 172.21.15.78:0/1225958635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22b4150a90 0x7f22b4150ec0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009e50 tx=0x7f22ac01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f24ddd15e6674c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.364+0000 7f22b9063640 1 -- 172.21.15.78:0/1225958635 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0a56d0 con 0x7f22b4150a90 2023-10-14T09:18:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.364+0000 7f22b9063640 1 -- 172.21.15.78:0/1225958635 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac0a5830 con 0x7f22b4150a90 2023-10-14T09:18:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.364+0000 7f22b9063640 1 -- 172.21.15.78:0/1225958635 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0a5bc0 con 0x7f22b4150a90 2023-10-14T09:18:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.364+0000 7f22bc2c9640 1 -- 172.21.15.78:0/1225958635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22b4150a90 msgr2=0x7f22b4150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.364+0000 7f22bc2c9640 1 --2- 172.21.15.78:0/1225958635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22b4150a90 0x7f22b4150ec0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009e50 tx=0x7f22ac01c940 comp rx=0 tx=0).stop 2023-10-14T09:18:05.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 -- 172.21.15.78:0/1225958635 shutdown_connections 2023-10-14T09:18:05.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 --2- 172.21.15.78:0/1225958635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22b4150a90 0x7f22b4150ec0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 --2- 172.21.15.78:0/1225958635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22b414e0f0 0x7f22b4152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 -- 172.21.15.78:0/1225958635 >> 172.21.15.78:0/1225958635 conn(0x7f22b40c1cc0 msgr2=0x7f22b40c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:05.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 -- 172.21.15.78:0/1225958635 shutdown_connections 2023-10-14T09:18:05.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 -- 172.21.15.78:0/1225958635 wait complete. 2023-10-14T09:18:05.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 Processor -- start 2023-10-14T09:18:05.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 -- start start 2023-10-14T09:18:05.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22b414e0f0 0x7f22b406ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22b414ed10 0x7f22b4148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22b4150a90 0x7f22b414bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41ec080 con 0x7f22b414ed10 2023-10-14T09:18:05.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41ec290 con 0x7f22b414e0f0 2023-10-14T09:18:05.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41ec570 con 0x7f22b4150a90 2023-10-14T09:18:05.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22b9864640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22b414ed10 0x7f22b4148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22b9864640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22b414ed10 0x7f22b4148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60774/0 (socket says 172.21.15.78:60774) 2023-10-14T09:18:05.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22b9864640 1 -- 172.21.15.78:0/3953313215 learned_addr learned my addr 172.21.15.78:0/3953313215 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:05.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22ba065640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22b414e0f0 0x7f22b406ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22ba866640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22b4150a90 0x7f22b414bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22b9864640 1 -- 172.21.15.78:0/3953313215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22b4150a90 msgr2=0x7f22b414bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22b9864640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22b4150a90 0x7f22b414bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22b9864640 1 -- 172.21.15.78:0/3953313215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22b414e0f0 msgr2=0x7f22b406ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22b9864640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22b414e0f0 0x7f22b406ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22b9864640 1 -- 172.21.15.78:0/3953313215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac009b30 con 0x7f22b414ed10 2023-10-14T09:18:05.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22b9864640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22b414ed10 0x7f22b4148a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f22a400b410 tx=0x7f22a400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:05.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22aaffd640 1 -- 172.21.15.78:0/3953313215 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4004020 con 0x7f22b414ed10 2023-10-14T09:18:05.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22aaffd640 1 -- 172.21.15.78:0/3953313215 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a4004180 con 0x7f22b414ed10 2023-10-14T09:18:05.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22aaffd640 1 -- 172.21.15.78:0/3953313215 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4011630 con 0x7f22b414ed10 2023-10-14T09:18:05.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.368+0000 7f22bc2c9640 1 -- 172.21.15.78:0/3953313215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b41ec850 con 0x7f22b414ed10 2023-10-14T09:18:05.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.372+0000 7f22bc2c9640 1 -- 172.21.15.78:0/3953313215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b41ece10 con 0x7f22b414ed10 2023-10-14T09:18:05.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.372+0000 7f22bc2c9640 1 -- 172.21.15.78:0/3953313215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b4074180 con 0x7f22b414ed10 2023-10-14T09:18:05.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.372+0000 7f22aaffd640 1 -- 172.21.15.78:0/3953313215 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f22a4011790 con 0x7f22b414ed10 2023-10-14T09:18:05.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.372+0000 7f22aaffd640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22980664a0 0x7f2298068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.372+0000 7f22aaffd640 1 -- 172.21.15.78:0/3953313215 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22a4083b80 con 0x7f22b414ed10 2023-10-14T09:18:05.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.372+0000 7f22ba065640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22980664a0 0x7f2298068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.372+0000 7f22ba065640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22980664a0 0x7f2298068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f22b00079c0 tx=0x7f22b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:05.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.376+0000 7f22aaffd640 1 -- 172.21.15.78:0/3953313215 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f22a4051010 con 0x7f22b414ed10 2023-10-14T09:18:05.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.556+0000 7f22bc2c9640 1 -- 172.21.15.78:0/3953313215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f22b40c0230 con 0x7f22b414ed10 2023-10-14T09:18:05.560 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-10-14T09:18:05.556+0000 7ff57b4e6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T09:18:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.560+0000 7f22aaffd640 1 -- 172.21.15.78:0/3953313215 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f22a4015090 con 0x7f22b414ed10 2023-10-14T09:18:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T09:18:05.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.560+0000 7f22bc2c9640 1 -- 172.21.15.78:0/3953313215 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22980664a0 msgr2=0x7f2298068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.560+0000 7f22bc2c9640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22980664a0 0x7f2298068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f22b00079c0 tx=0x7f22b0008040 comp rx=0 tx=0).stop 2023-10-14T09:18:05.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.560+0000 7f22bc2c9640 1 -- 172.21.15.78:0/3953313215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22b414ed10 msgr2=0x7f22b4148a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.560+0000 7f22bc2c9640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22b414ed10 0x7f22b4148a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f22a400b410 tx=0x7f22a400b8d0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.564+0000 7f22bc2c9640 1 -- 172.21.15.78:0/3953313215 shutdown_connections 2023-10-14T09:18:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.564+0000 7f22bc2c9640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22980664a0 0x7f2298068960 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.564+0000 7f22bc2c9640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f22b4150a90 0x7f22b414bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.564+0000 7f22bc2c9640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22b414ed10 0x7f22b4148a00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.564+0000 7f22bc2c9640 1 --2- 172.21.15.78:0/3953313215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22b414e0f0 0x7f22b406ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.564+0000 7f22bc2c9640 1 -- 172.21.15.78:0/3953313215 >> 172.21.15.78:0/3953313215 conn(0x7f22b40c1cc0 msgr2=0x7f22b414f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.564+0000 7f22bc2c9640 1 -- 172.21.15.78:0/3953313215 shutdown_connections 2023-10-14T09:18:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.564+0000 7f22bc2c9640 1 -- 172.21.15.78:0/3953313215 wait complete. 2023-10-14T09:18:05.574 INFO:tasks.ceph.mds.b.smithi157.stderr: -1665> 2023-10-14T09:17:29.607+0000 7fb283dc3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T09:18:05.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T09:18:05.619 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2023-10-14T09:18:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc68b535640 1 Processor -- start 2023-10-14T09:18:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc68b535640 1 -- start start 2023-10-14T09:18:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc68b535640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6841514c0 0x7fc6840bfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc68b535640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68406c510 0x7fc6840c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc68b535640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6840bacf0 con 0x7fc6840c0680 2023-10-14T09:18:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc68b535640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6840bafd0 con 0x7fc6841514c0 2023-10-14T09:18:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc68b535640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840bbb30 con 0x7fc68406c510 2023-10-14T09:18:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc6892d1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6841514c0 0x7fc6840bfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc6892d1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6841514c0 0x7fc6840bfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60786/0 (socket says 172.21.15.78:60786) 2023-10-14T09:18:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc6892d1640 1 -- 172.21.15.78:0/220224835 learned_addr learned my addr 172.21.15.78:0/220224835 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc6892d1640 1 -- 172.21.15.78:0/220224835 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68406c510 msgr2=0x7fc6840c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc688ad0640 1 --2- 172.21.15.78:0/220224835 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68406c510 0x7fc6840c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc6892d1640 1 --2- 172.21.15.78:0/220224835 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68406c510 0x7fc6840c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc6892d1640 1 -- 172.21.15.78:0/220224835 >> v1:172.21.15.157:6789/0 conn(0x7fc6840c0680 legacy=0x7fc684157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.724+0000 7fc6892d1640 1 -- 172.21.15.78:0/220224835 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6840bbe10 con 0x7fc6841514c0 2023-10-14T09:18:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc688ad0640 1 --2- 172.21.15.78:0/220224835 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68406c510 0x7fc6840c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:05.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc6892d1640 1 --2- 172.21.15.78:0/220224835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6841514c0 0x7fc6840bfc00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc680009870 tx=0x7fc68001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e79b8ed38d27512 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:05.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc67bfff640 1 -- 172.21.15.78:0/220224835 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6800ab600 con 0x7fc6841514c0 2023-10-14T09:18:05.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc67bfff640 1 -- 172.21.15.78:0/220224835 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6800a7050 con 0x7fc6841514c0 2023-10-14T09:18:05.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc67bfff640 1 -- 172.21.15.78:0/220224835 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6800ab980 con 0x7fc6841514c0 2023-10-14T09:18:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc68b535640 1 -- 172.21.15.78:0/220224835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6841514c0 msgr2=0x7fc6840bfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc68b535640 1 --2- 172.21.15.78:0/220224835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6841514c0 0x7fc6840bfc00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc680009870 tx=0x7fc68001c4a0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc68b535640 1 -- 172.21.15.78:0/220224835 shutdown_connections 2023-10-14T09:18:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc68b535640 1 --2- 172.21.15.78:0/220224835 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc68406c510 0x7fc6840c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc68b535640 1 --2- 172.21.15.78:0/220224835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6841514c0 0x7fc6840bfc00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc68b535640 1 -- 172.21.15.78:0/220224835 >> 172.21.15.78:0/220224835 conn(0x7fc6840c1d00 msgr2=0x7fc6840c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:05.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc68b535640 1 -- 172.21.15.78:0/220224835 shutdown_connections 2023-10-14T09:18:05.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.728+0000 7fc68b535640 1 -- 172.21.15.78:0/220224835 wait complete. 2023-10-14T09:18:05.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc68b535640 1 Processor -- start 2023-10-14T09:18:05.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc68b535640 1 -- start start 2023-10-14T09:18:05.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc68b535640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc68406c510 0x7fc684070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc68b535640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6840c0680 0x7fc6841eba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc68b535640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6841514c0 0x7fc6841ebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc68b535640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc684154570 con 0x7fc68406c510 2023-10-14T09:18:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc68b535640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6841ec510 con 0x7fc6841514c0 2023-10-14T09:18:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc68b535640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc684153f60 con 0x7fc6840c0680 2023-10-14T09:18:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc6892d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc68406c510 0x7fc684070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc6892d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc68406c510 0x7fc684070fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60798/0 (socket says 172.21.15.78:60798) 2023-10-14T09:18:05.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc6892d1640 1 -- 172.21.15.78:0/4019855535 learned_addr learned my addr 172.21.15.78:0/4019855535 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc688ad0640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6840c0680 0x7fc6841eba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc689ad2640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6841514c0 0x7fc6841ebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc6892d1640 1 -- 172.21.15.78:0/4019855535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6840c0680 msgr2=0x7fc6841eba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc6892d1640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6840c0680 0x7fc6841eba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc6892d1640 1 -- 172.21.15.78:0/4019855535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6841514c0 msgr2=0x7fc6841ebfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:05.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc6892d1640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6841514c0 0x7fc6841ebfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:05.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc6892d1640 1 -- 172.21.15.78:0/4019855535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800094d0 con 0x7fc68406c510 2023-10-14T09:18:05.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc689ad2640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6841514c0 0x7fc6841ebfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:05.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc6892d1640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc68406c510 0x7fc684070fc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc6800ae040 tx=0x7fc6800192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:05.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc679ffb640 1 -- 172.21.15.78:0/4019855535 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6800b4640 con 0x7fc68406c510 2023-10-14T09:18:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc679ffb640 1 -- 172.21.15.78:0/4019855535 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6800b47a0 con 0x7fc68406c510 2023-10-14T09:18:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc68b535640 1 -- 172.21.15.78:0/4019855535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6840aac70 con 0x7fc68406c510 2023-10-14T09:18:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc679ffb640 1 -- 172.21.15.78:0/4019855535 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6800b4b30 con 0x7fc68406c510 2023-10-14T09:18:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.732+0000 7fc68b535640 1 -- 172.21.15.78:0/4019855535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc684154200 con 0x7fc68406c510 2023-10-14T09:18:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.736+0000 7fc68b535640 1 -- 172.21.15.78:0/4019855535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc684074110 con 0x7fc68406c510 2023-10-14T09:18:05.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.736+0000 7fc679ffb640 1 -- 172.21.15.78:0/4019855535 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc6800b2070 con 0x7fc68406c510 2023-10-14T09:18:05.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.736+0000 7fc679ffb640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6680664a0 0x7fc668068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.736+0000 7fc679ffb640 1 -- 172.21.15.78:0/4019855535 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fc68011de00 con 0x7fc68406c510 2023-10-14T09:18:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.736+0000 7fc688ad0640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6680664a0 0x7fc668068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.736+0000 7fc688ad0640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6680664a0 0x7fc668068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc684071b00 tx=0x7fc674008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.740+0000 7fc679ffb640 1 -- 172.21.15.78:0/4019855535 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc6800eb2c0 con 0x7fc68406c510 2023-10-14T09:18:05.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:05.920+0000 7fc68b535640 1 -- 172.21.15.78:0/4019855535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc68415e420 con 0x7fc68406c510 2023-10-14T09:18:06.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.560+0000 7fc679ffb640 1 -- 172.21.15.78:0/4019855535 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc6800ee8e0 con 0x7fc68406c510 2023-10-14T09:18:06.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 -- 172.21.15.78:0/4019855535 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6680664a0 msgr2=0x7fc668068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:06.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6680664a0 0x7fc668068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc684071b00 tx=0x7fc674008040 comp rx=0 tx=0).stop 2023-10-14T09:18:06.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 -- 172.21.15.78:0/4019855535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc68406c510 msgr2=0x7fc684070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:06.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc68406c510 0x7fc684070fc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc6800ae040 tx=0x7fc6800192a0 comp rx=0 tx=0).stop 2023-10-14T09:18:06.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 -- 172.21.15.78:0/4019855535 shutdown_connections 2023-10-14T09:18:06.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6841514c0 0x7fc6841ebfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:06.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6680664a0 0x7fc668068960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:06.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6840c0680 0x7fc6841eba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:06.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 --2- 172.21.15.78:0/4019855535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc68406c510 0x7fc684070fc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:06.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 -- 172.21.15.78:0/4019855535 >> 172.21.15.78:0/4019855535 conn(0x7fc6840c1d00 msgr2=0x7fc6840bfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:06.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 -- 172.21.15.78:0/4019855535 shutdown_connections 2023-10-14T09:18:06.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.564+0000 7fc68b535640 1 -- 172.21.15.78:0/4019855535 wait complete. 2023-10-14T09:18:06.594 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T09:18:06.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2324194640 1 Processor -- start 2023-10-14T09:18:06.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2324194640 1 -- start start 2023-10-14T09:18:06.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2324194640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f231c0c0450 0x7f231c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:06.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2324194640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f231c06d750 0x7f231c0c0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:06.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2324194640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c06bcc0 con 0x7f231c0c1230 2023-10-14T09:18:06.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2324194640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c06c340 con 0x7f231c0c0450 2023-10-14T09:18:06.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2324194640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c06ce70 con 0x7f231c06d750 2023-10-14T09:18:06.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2321f30640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f231c0c0450 0x7f231c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:06.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f232172f640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f231c0c1230 0x7f231c06c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50126/0 (socket says 172.21.15.78:50126) 2023-10-14T09:18:06.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f232172f640 1 -- 172.21.15.78:0/943562847 learned_addr learned my addr 172.21.15.78:0/943562847 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:06.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2320f2e640 1 -- 172.21.15.78:0/943562847 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516973124 0 0) 0x7f231c06bcc0 con 0x7f231c0c1230 2023-10-14T09:18:06.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2320f2e640 1 -- 172.21.15.78:0/943562847 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2308003530 con 0x7f231c0c1230 2023-10-14T09:18:06.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2322731640 1 --2- 172.21.15.78:0/943562847 >> v2:172.21.15.157:3300/0 conn(0x7f231c06d750 0x7f231c0c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:06.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2321f30640 1 -- 172.21.15.78:0/943562847 >> v2:172.21.15.157:3300/0 conn(0x7f231c06d750 msgr2=0x7f231c0c0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:06.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2321f30640 1 --2- 172.21.15.78:0/943562847 >> v2:172.21.15.157:3300/0 conn(0x7f231c06d750 0x7f231c0c0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:06.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2321f30640 1 -- 172.21.15.78:0/943562847 >> v1:172.21.15.78:6789/0 conn(0x7f231c0c1230 legacy=0x7f231c06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:06.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2321f30640 1 -- 172.21.15.78:0/943562847 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c150dd0 con 0x7f231c0c0450 2023-10-14T09:18:06.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.736+0000 7f2322731640 1 --2- 172.21.15.78:0/943562847 >> v2:172.21.15.157:3300/0 conn(0x7f231c06d750 0x7f231c0c0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:06.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2321f30640 1 --2- 172.21.15.78:0/943562847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f231c0c0450 0x7f231c06fc10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f231c06fba0 tx=0x7f231801e270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2bbc99e62ab46f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:06.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2320f2e640 1 -- 172.21.15.78:0/943562847 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180a6770 con 0x7f231c0c0450 2023-10-14T09:18:06.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2320f2e640 1 -- 172.21.15.78:0/943562847 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23180a68d0 con 0x7f231c0c0450 2023-10-14T09:18:06.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2320f2e640 1 -- 172.21.15.78:0/943562847 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180a6c60 con 0x7f231c0c0450 2023-10-14T09:18:06.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2324194640 1 -- 172.21.15.78:0/943562847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f231c0c0450 msgr2=0x7f231c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:06.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2324194640 1 --2- 172.21.15.78:0/943562847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f231c0c0450 0x7f231c06fc10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f231c06fba0 tx=0x7f231801e270 comp rx=0 tx=0).stop 2023-10-14T09:18:06.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2324194640 1 -- 172.21.15.78:0/943562847 shutdown_connections 2023-10-14T09:18:06.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2324194640 1 --2- 172.21.15.78:0/943562847 >> v2:172.21.15.157:3300/0 conn(0x7f231c06d750 0x7f231c0c0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:06.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2324194640 1 --2- 172.21.15.78:0/943562847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f231c0c0450 0x7f231c06fc10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:06.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2324194640 1 -- 172.21.15.78:0/943562847 >> 172.21.15.78:0/943562847 conn(0x7f231c0c1cc0 msgr2=0x7f231c0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:06.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2324194640 1 -- 172.21.15.78:0/943562847 shutdown_connections 2023-10-14T09:18:06.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.740+0000 7f2324194640 1 -- 172.21.15.78:0/943562847 wait complete. 2023-10-14T09:18:06.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2324194640 1 Processor -- start 2023-10-14T09:18:06.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2324194640 1 -- start start 2023-10-14T09:18:06.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2324194640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f231c06d750 0x7f231c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:06.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2324194640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f231c0c0450 0x7f231c142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:06.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2324194640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f231c0c1230 0x7f231c140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:06.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2324194640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c1e9a40 con 0x7f231c06d750 2023-10-14T09:18:06.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2324194640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c151540 con 0x7f231c0c0450 2023-10-14T09:18:06.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2324194640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c153b70 con 0x7f231c0c1230 2023-10-14T09:18:06.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2321f30640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f231c06d750 0x7f231c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:06.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2321f30640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f231c06d750 0x7f231c1593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60824/0 (socket says 172.21.15.78:60824) 2023-10-14T09:18:06.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2321f30640 1 -- 172.21.15.78:0/3237304107 learned_addr learned my addr 172.21.15.78:0/3237304107 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:06.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f232172f640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f231c0c0450 0x7f231c142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:06.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2322731640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f231c0c1230 0x7f231c140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:06.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2321f30640 1 -- 172.21.15.78:0/3237304107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f231c0c1230 msgr2=0x7f231c140a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:06.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2321f30640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f231c0c1230 0x7f231c140a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:06.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2321f30640 1 -- 172.21.15.78:0/3237304107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f231c0c0450 msgr2=0x7f231c142e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:06.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2321f30640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f231c0c0450 0x7f231c142e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:06.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2321f30640 1 -- 172.21.15.78:0/3237304107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231800a5c0 con 0x7f231c06d750 2023-10-14T09:18:06.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f232172f640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f231c0c0450 0x7f231c142e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:06.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2322731640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f231c0c1230 0x7f231c140a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:06.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2321f30640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f231c06d750 0x7f231c1593d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f231801a420 tx=0x7f231801a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f23127fc640 1 -- 172.21.15.78:0/3237304107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180b9660 con 0x7f231c06d750 2023-10-14T09:18:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f23127fc640 1 -- 172.21.15.78:0/3237304107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23180b97c0 con 0x7f231c06d750 2023-10-14T09:18:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f23127fc640 1 -- 172.21.15.78:0/3237304107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180b9b70 con 0x7f231c06d750 2023-10-14T09:18:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2324194640 1 -- 172.21.15.78:0/3237304107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c151da0 con 0x7f231c06d750 2023-10-14T09:18:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2324194640 1 -- 172.21.15.78:0/3237304107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c1544e0 con 0x7f231c06d750 2023-10-14T09:18:06.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.744+0000 7f2324194640 1 -- 172.21.15.78:0/3237304107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231c074110 con 0x7f231c06d750 2023-10-14T09:18:06.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.748+0000 7f23127fc640 1 -- 172.21.15.78:0/3237304107 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f23180ae440 con 0x7f231c06d750 2023-10-14T09:18:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.748+0000 7f23127fc640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f23000664a0 0x7f2300068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.748+0000 7f23127fc640 1 -- 172.21.15.78:0/3237304107 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f231811e260 con 0x7f231c06d750 2023-10-14T09:18:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.748+0000 7f232172f640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f23000664a0 0x7f2300068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.748+0000 7f232172f640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f23000664a0 0x7f2300068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f231c0bf500 tx=0x7f230c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:06.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.752+0000 7f23127fc640 1 -- 172.21.15.78:0/3237304107 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f23180eb570 con 0x7f231c06d750 2023-10-14T09:18:06.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:06.904+0000 7f2324194640 1 -- 172.21.15.78:0/3237304107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f231c0c45e0 con 0x7f231c06d750 2023-10-14T09:18:07.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.568+0000 7f23127fc640 1 -- 172.21.15.78:0/3237304107 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f23180eeb90 con 0x7f231c06d750 2023-10-14T09:18:07.573 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-10-14T09:18:07.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 -- 172.21.15.78:0/3237304107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f23000664a0 msgr2=0x7f2300068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:07.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f23000664a0 0x7f2300068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f231c0bf500 tx=0x7f230c009040 comp rx=0 tx=0).stop 2023-10-14T09:18:07.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 -- 172.21.15.78:0/3237304107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f231c06d750 msgr2=0x7f231c1593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:07.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f231c06d750 0x7f231c1593d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f231801a420 tx=0x7f231801a5b0 comp rx=0 tx=0).stop 2023-10-14T09:18:07.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 -- 172.21.15.78:0/3237304107 shutdown_connections 2023-10-14T09:18:07.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f23000664a0 0x7f2300068960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:07.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f231c0c1230 0x7f231c140a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:07.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f231c0c0450 0x7f231c142e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:07.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 --2- 172.21.15.78:0/3237304107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f231c06d750 0x7f231c1593d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:07.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 -- 172.21.15.78:0/3237304107 >> 172.21.15.78:0/3237304107 conn(0x7f231c0c1cc0 msgr2=0x7f231c1420f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:07.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 -- 172.21.15.78:0/3237304107 shutdown_connections 2023-10-14T09:18:07.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.572+0000 7f2324194640 1 -- 172.21.15.78:0/3237304107 wait complete. 2023-10-14T09:18:07.599 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T09:18:07.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.736+0000 7f8996765640 1 Processor -- start 2023-10-14T09:18:07.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.736+0000 7f8996765640 1 -- start start 2023-10-14T09:18:07.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.740+0000 7f8996765640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89900c1230 0x7f899006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:07.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.740+0000 7f8996765640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899006bcc0 con 0x7f899006d750 2023-10-14T09:18:07.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.740+0000 7f8996765640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8990150dd0 con 0x7f89900c0450 2023-10-14T09:18:07.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.740+0000 7f8996765640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899006c340 con 0x7f89900c1230 2023-10-14T09:18:07.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.740+0000 7f898f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89900c1230 0x7f899006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:07.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.740+0000 7f8994d02640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f899006d750 0x7f899015aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41950/0 (socket says 172.21.15.78:41950) 2023-10-14T09:18:07.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.740+0000 7f8994d02640 1 -- 172.21.15.78:0/2107021471 learned_addr learned my addr 172.21.15.78:0/2107021471 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:07.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.740+0000 7f898f7fe640 1 -- 172.21.15.78:0/2107021471 >> v1:172.21.15.157:6789/0 conn(0x7f89900c0450 legacy=0x7f899006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:07.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.740+0000 7f898f7fe640 1 -- 172.21.15.78:0/2107021471 >> v1:172.21.15.78:6789/0 conn(0x7f899006d750 legacy=0x7f899015aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:07.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.740+0000 7f898f7fe640 1 -- 172.21.15.78:0/2107021471 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899006bf60 con 0x7f89900c1230 2023-10-14T09:18:07.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.740+0000 7f898effd640 1 -- 172.21.15.78:0/2107021471 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816062510 0 0) 0x7f899006bcc0 con 0x7f899006d750 2023-10-14T09:18:07.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f898f7fe640 1 --2- 172.21.15.78:0/2107021471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89900c1230 0x7f899006fc10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f89840097c0 tx=0x7f898401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ecdf3140b04a02 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:07.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f898effd640 1 -- 172.21.15.78:0/2107021471 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89840ab600 con 0x7f89900c1230 2023-10-14T09:18:07.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f898effd640 1 -- 172.21.15.78:0/2107021471 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89840a7050 con 0x7f89900c1230 2023-10-14T09:18:07.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f898effd640 1 -- 172.21.15.78:0/2107021471 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89840ab980 con 0x7f89900c1230 2023-10-14T09:18:07.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 -- 172.21.15.78:0/2107021471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89900c1230 msgr2=0x7f899006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:07.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 --2- 172.21.15.78:0/2107021471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89900c1230 0x7f899006fc10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f89840097c0 tx=0x7f898401c480 comp rx=0 tx=0).stop 2023-10-14T09:18:07.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 -- 172.21.15.78:0/2107021471 shutdown_connections 2023-10-14T09:18:07.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 --2- 172.21.15.78:0/2107021471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89900c1230 0x7f899006fc10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:07.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 -- 172.21.15.78:0/2107021471 >> 172.21.15.78:0/2107021471 conn(0x7f89900c1cc0 msgr2=0x7f89900c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:07.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 -- 172.21.15.78:0/2107021471 shutdown_connections 2023-10-14T09:18:07.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 -- 172.21.15.78:0/2107021471 wait complete. 2023-10-14T09:18:07.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 Processor -- start 2023-10-14T09:18:07.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 -- start start 2023-10-14T09:18:07.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899006d750 0x7f8990147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:07.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89900c0450 0x7f89901469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:07.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f89900c1230 0x7f899013ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:07.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89901eaca0 con 0x7f899006d750 2023-10-14T09:18:07.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89901ea720 con 0x7f89900c0450 2023-10-14T09:18:07.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.744+0000 7f8996765640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89901ea9c0 con 0x7f89900c1230 2023-10-14T09:18:07.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899006d750 0x7f8990147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:07.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899006d750 0x7f8990147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43694/0 (socket says 172.21.15.78:43694) 2023-10-14T09:18:07.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898ffff640 1 -- 172.21.15.78:0/285031276 learned_addr learned my addr 172.21.15.78:0/285031276 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:07.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898f7fe640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89900c0450 0x7f89901469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:07.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f8994d02640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f89900c1230 0x7f899013ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:07.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898ffff640 1 -- 172.21.15.78:0/285031276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f89900c1230 msgr2=0x7f899013ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:07.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898ffff640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f89900c1230 0x7f899013ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:07.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898ffff640 1 -- 172.21.15.78:0/285031276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89900c0450 msgr2=0x7f89901469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:07.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898ffff640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89900c0450 0x7f89901469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:07.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898ffff640 1 -- 172.21.15.78:0/285031276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8984009420 con 0x7f899006d750 2023-10-14T09:18:07.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898ffff640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899006d750 0x7f8990147d00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f898000c500 tx=0x7f898000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:07.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898cff9640 1 -- 172.21.15.78:0/285031276 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980005220 con 0x7f899006d750 2023-10-14T09:18:07.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898cff9640 1 -- 172.21.15.78:0/285031276 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8980005380 con 0x7f899006d750 2023-10-14T09:18:07.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898cff9640 1 -- 172.21.15.78:0/285031276 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980007270 con 0x7f899006d750 2023-10-14T09:18:07.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f8996765640 1 -- 172.21.15.78:0/285031276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89901413e0 con 0x7f899006d750 2023-10-14T09:18:07.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f8996765640 1 -- 172.21.15.78:0/285031276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89901419a0 con 0x7f899006d750 2023-10-14T09:18:07.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f8996765640 1 -- 172.21.15.78:0/285031276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8990141240 con 0x7f899006d750 2023-10-14T09:18:07.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898cff9640 1 -- 172.21.15.78:0/285031276 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f89800073d0 con 0x7f899006d750 2023-10-14T09:18:07.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.748+0000 7f898cff9640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f897c0664a0 0x7f897c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:07.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.752+0000 7f898cff9640 1 -- 172.21.15.78:0/285031276 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f89800836a0 con 0x7f899006d750 2023-10-14T09:18:07.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.752+0000 7f898f7fe640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f897c0664a0 0x7f897c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:07.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.752+0000 7f898f7fe640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f897c0664a0 0x7f897c068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f89840ad000 tx=0x7f89840a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:07.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.756+0000 7f898cff9640 1 -- 172.21.15.78:0/285031276 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8990141240 con 0x7f899006d750 2023-10-14T09:18:07.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:07.908+0000 7f8996765640 1 -- 172.21.15.78:0/285031276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8990141240 con 0x7f899006d750 2023-10-14T09:18:08.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.572+0000 7f898cff9640 1 -- 172.21.15.78:0/285031276 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8990141240 con 0x7f899006d750 2023-10-14T09:18:08.575 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-10-14T09:18:08.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 -- 172.21.15.78:0/285031276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f897c0664a0 msgr2=0x7f897c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:08.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f897c0664a0 0x7f897c068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f89840ad000 tx=0x7f89840a6000 comp rx=0 tx=0).stop 2023-10-14T09:18:08.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 -- 172.21.15.78:0/285031276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899006d750 msgr2=0x7f8990147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:08.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899006d750 0x7f8990147d00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f898000c500 tx=0x7f898000c9c0 comp rx=0 tx=0).stop 2023-10-14T09:18:08.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 -- 172.21.15.78:0/285031276 shutdown_connections 2023-10-14T09:18:08.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f897c0664a0 0x7f897c068960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:08.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f89900c1230 0x7f899013ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:08.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89900c0450 0x7f89901469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:08.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 --2- 172.21.15.78:0/285031276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f899006d750 0x7f8990147d00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:08.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 -- 172.21.15.78:0/285031276 >> 172.21.15.78:0/285031276 conn(0x7f89900c1cc0 msgr2=0x7f89900c46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:08.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 -- 172.21.15.78:0/285031276 shutdown_connections 2023-10-14T09:18:08.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.576+0000 7f8996765640 1 -- 172.21.15.78:0/285031276 wait complete. 2023-10-14T09:18:08.610 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T09:18:08.611 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T09:18:08.611 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T09:18:08.611 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:18:08.612 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T09:18:08.612 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T09:18:08.612 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T09:18:08.612 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:18:08.613 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T09:18:08.613 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T09:18:08.613 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T09:18:08.613 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:18:08.614 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T09:18:08.614 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T09:18:08.614 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T09:18:08.615 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:18:08.626 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T09:18:08.626 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T09:18:08.628 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T09:18:08.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T09:18:08.630 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T09:18:08.630 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T09:18:08.631 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T09:18:08.632 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T09:18:08.671 INFO:tasks.ceph.mds.a:Started 2023-10-14T09:18:08.672 DEBUG:teuthology.parallel:result is None 2023-10-14T09:18:08.674 INFO:tasks.ceph.mds.c:Started 2023-10-14T09:18:08.675 DEBUG:teuthology.parallel:result is None 2023-10-14T09:18:08.681 INFO:tasks.ceph.mds.b:Started 2023-10-14T09:18:08.682 DEBUG:teuthology.parallel:result is None 2023-10-14T09:18:08.685 INFO:tasks.ceph.mds.d:Started 2023-10-14T09:18:08.685 DEBUG:teuthology.parallel:result is None 2023-10-14T09:18:08.686 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T09:18:08.759 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-10-14T09:18:08.762 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-10-14T09:18:08.784 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2023-10-14T09:18:08.785 INFO:tasks.ceph.mds.d.smithi157.stdout:starting mds.d at 2023-10-14T09:18:08.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.828+0000 7f5a807d0640 1 Processor -- start 2023-10-14T09:18:08.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.828+0000 7f5a807d0640 1 -- start start 2023-10-14T09:18:08.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.828+0000 7f5a807d0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5a780c1e20 0x7f5a780c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:08.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.828+0000 7f5a807d0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5a781541a0 0x7f5a78154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:08.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.828+0000 7f5a807d0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a78153d50 con 0x7f5a781513c0 2023-10-14T09:18:08.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.828+0000 7f5a807d0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7806f7b0 con 0x7f5a780c1e20 2023-10-14T09:18:08.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.828+0000 7f5a807d0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a78158100 con 0x7f5a781541a0 2023-10-14T09:18:08.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.828+0000 7f5a7dd6b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5a780c1e20 0x7f5a780c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:08.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7dd6b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5a780c1e20 0x7f5a780c3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43720/0 (socket says 172.21.15.78:43720) 2023-10-14T09:18:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7dd6b640 1 -- 172.21.15.78:0/4004803346 learned_addr learned my addr 172.21.15.78:0/4004803346 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7ed6d640 1 --2- 172.21.15.78:0/4004803346 >> v2:172.21.15.157:3300/0 conn(0x7f5a781541a0 0x7f5a78154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7dd6b640 1 -- 172.21.15.78:0/4004803346 >> v2:172.21.15.157:3300/0 conn(0x7f5a781541a0 msgr2=0x7f5a78154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7dd6b640 1 --2- 172.21.15.78:0/4004803346 >> v2:172.21.15.157:3300/0 conn(0x7f5a781541a0 0x7f5a78154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:08.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7dd6b640 1 -- 172.21.15.78:0/4004803346 >> v1:172.21.15.157:6789/0 conn(0x7f5a781513c0 legacy=0x7f5a780c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:08.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7dd6b640 1 -- 172.21.15.78:0/4004803346 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7806f9c0 con 0x7f5a780c1e20 2023-10-14T09:18:08.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7ed6d640 1 --2- 172.21.15.78:0/4004803346 >> v2:172.21.15.157:3300/0 conn(0x7f5a781541a0 0x7f5a78154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:08.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7dd6b640 1 --2- 172.21.15.78:0/4004803346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a780c1e20 0x7f5a780c3650 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5a780c1a80 tx=0x7f5a6801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb3ee171cdaf698 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:08.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7d56a640 1 -- 172.21.15.78:0/4004803346 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680ab610 con 0x7f5a780c1e20 2023-10-14T09:18:08.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7d56a640 1 -- 172.21.15.78:0/4004803346 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a680ab770 con 0x7f5a780c1e20 2023-10-14T09:18:08.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.832+0000 7f5a7d56a640 1 -- 172.21.15.78:0/4004803346 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680abb00 con 0x7f5a780c1e20 2023-10-14T09:18:08.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 -- 172.21.15.78:0/4004803346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a780c1e20 msgr2=0x7f5a780c3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 --2- 172.21.15.78:0/4004803346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a780c1e20 0x7f5a780c3650 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5a780c1a80 tx=0x7f5a6801c500 comp rx=0 tx=0).stop 2023-10-14T09:18:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 -- 172.21.15.78:0/4004803346 shutdown_connections 2023-10-14T09:18:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 --2- 172.21.15.78:0/4004803346 >> v2:172.21.15.157:3300/0 conn(0x7f5a781541a0 0x7f5a78154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 --2- 172.21.15.78:0/4004803346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a780c1e20 0x7f5a780c3650 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:08.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 -- 172.21.15.78:0/4004803346 >> 172.21.15.78:0/4004803346 conn(0x7f5a7806a060 msgr2=0x7f5a7806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 -- 172.21.15.78:0/4004803346 shutdown_connections 2023-10-14T09:18:08.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 -- 172.21.15.78:0/4004803346 wait complete. 2023-10-14T09:18:08.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 Processor -- start 2023-10-14T09:18:08.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 -- start start 2023-10-14T09:18:08.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c1e20 0x7f5a780bf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:08.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a781513c0 0x7f5a781ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:08.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a781541a0 0x7f5a78156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:08.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780a63e0 con 0x7f5a781513c0 2023-10-14T09:18:08.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a78156400 con 0x7f5a781541a0 2023-10-14T09:18:08.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a807d0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780bf680 con 0x7f5a780c1e20 2023-10-14T09:18:08.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7dd6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a781513c0 0x7f5a781ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:08.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7dd6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a781513c0 0x7f5a781ef4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43734/0 (socket says 172.21.15.78:43734) 2023-10-14T09:18:08.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7dd6b640 1 -- 172.21.15.78:0/2776352510 learned_addr learned my addr 172.21.15.78:0/2776352510 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:08.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7e56c640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c1e20 0x7f5a780bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:08.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7ed6d640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a781541a0 0x7f5a78156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:08.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7dd6b640 1 -- 172.21.15.78:0/2776352510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c1e20 msgr2=0x7f5a780bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:08.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7dd6b640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c1e20 0x7f5a780bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:08.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7dd6b640 1 -- 172.21.15.78:0/2776352510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a781541a0 msgr2=0x7f5a78156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:08.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7dd6b640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a781541a0 0x7f5a78156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:08.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7dd6b640 1 -- 172.21.15.78:0/2776352510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680094d0 con 0x7f5a781513c0 2023-10-14T09:18:08.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7e56c640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c1e20 0x7f5a780bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:08.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7ed6d640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a781541a0 0x7f5a78156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:08.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.836+0000 7f5a7dd6b640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a781513c0 0x7f5a781ef4c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5a68019110 tx=0x7f5a6801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:08.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.840+0000 7f5a6effd640 1 -- 172.21.15.78:0/2776352510 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680ab610 con 0x7f5a781513c0 2023-10-14T09:18:08.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.840+0000 7f5a6effd640 1 -- 172.21.15.78:0/2776352510 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a680b4800 con 0x7f5a781513c0 2023-10-14T09:18:08.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.840+0000 7f5a6effd640 1 -- 172.21.15.78:0/2776352510 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680b4b90 con 0x7f5a781513c0 2023-10-14T09:18:08.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.840+0000 7f5a807d0640 1 -- 172.21.15.78:0/2776352510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a780bfa90 con 0x7f5a781513c0 2023-10-14T09:18:08.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.840+0000 7f5a807d0640 1 -- 172.21.15.78:0/2776352510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a780a65d0 con 0x7f5a781513c0 2023-10-14T09:18:08.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.840+0000 7f5a807d0640 1 -- 172.21.15.78:0/2776352510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a78156570 con 0x7f5a781513c0 2023-10-14T09:18:08.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.840+0000 7f5a6effd640 1 -- 172.21.15.78:0/2776352510 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5a680b4cf0 con 0x7f5a781513c0 2023-10-14T09:18:08.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.840+0000 7f5a6effd640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5a5c0664a0 0x7f5a5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:08.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.840+0000 7f5a6effd640 1 -- 172.21.15.78:0/2776352510 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5a6811e680 con 0x7f5a781513c0 2023-10-14T09:18:08.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.840+0000 7f5a7e56c640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5a5c0664a0 0x7f5a5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:08.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.840+0000 7f5a7e56c640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5a5c0664a0 0x7f5a5c068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5a780734d0 tx=0x7f5a74009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:08.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:08.844+0000 7f5a6effd640 1 -- 172.21.15.78:0/2776352510 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5a78156570 con 0x7f5a781513c0 2023-10-14T09:18:09.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.024+0000 7f5a807d0640 1 -- 172.21.15.78:0/2776352510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5a78156570 con 0x7f5a781513c0 2023-10-14T09:18:09.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.584+0000 7f5a6effd640 1 -- 172.21.15.78:0/2776352510 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5a78156570 con 0x7f5a781513c0 2023-10-14T09:18:09.587 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-10-14T09:18:09.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 -- 172.21.15.78:0/2776352510 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5a5c0664a0 msgr2=0x7f5a5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:09.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5a5c0664a0 0x7f5a5c068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5a780734d0 tx=0x7f5a74009040 comp rx=0 tx=0).stop 2023-10-14T09:18:09.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 -- 172.21.15.78:0/2776352510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a781513c0 msgr2=0x7f5a781ef4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:09.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a781513c0 0x7f5a781ef4c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5a68019110 tx=0x7f5a6801ad40 comp rx=0 tx=0).stop 2023-10-14T09:18:09.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 -- 172.21.15.78:0/2776352510 shutdown_connections 2023-10-14T09:18:09.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a781541a0 0x7f5a78156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:09.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a781513c0 0x7f5a781ef4c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:09.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5a5c0664a0 0x7f5a5c068960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:09.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 --2- 172.21.15.78:0/2776352510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5a780c1e20 0x7f5a780bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:09.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 -- 172.21.15.78:0/2776352510 >> 172.21.15.78:0/2776352510 conn(0x7f5a7806a060 msgr2=0x7f5a780a6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:09.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 -- 172.21.15.78:0/2776352510 shutdown_connections 2023-10-14T09:18:09.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.588+0000 7f5a807d0640 1 -- 172.21.15.78:0/2776352510 wait complete. 2023-10-14T09:18:09.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T09:18:09.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d43c5640 1 Processor -- start 2023-10-14T09:18:09.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d43c5640 1 -- start start 2023-10-14T09:18:09.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d43c5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8cc153e80 0x7fb8cc0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:09.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d43c5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8cc0c6910 0x7fb8cc0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:09.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d43c5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc06c470 con 0x7fb8cc14ddb0 2023-10-14T09:18:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d43c5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c64f0 con 0x7fb8cc0c6910 2023-10-14T09:18:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d43c5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c5300 con 0x7fb8cc153e80 2023-10-14T09:18:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d2962640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8cc0c6910 0x7fb8cc0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d2962640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8cc0c6910 0x7fb8cc0c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43736/0 (socket says 172.21.15.78:43736) 2023-10-14T09:18:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d2962640 1 -- 172.21.15.78:0/4223257102 learned_addr learned my addr 172.21.15.78:0/4223257102 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:09.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d1960640 1 --2- 172.21.15.78:0/4223257102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8cc153e80 0x7fb8cc0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:09.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d2962640 1 -- 172.21.15.78:0/4223257102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8cc153e80 msgr2=0x7fb8cc0c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:09.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d2962640 1 --2- 172.21.15.78:0/4223257102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8cc153e80 0x7fb8cc0c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:09.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d2962640 1 -- 172.21.15.78:0/4223257102 >> v1:172.21.15.157:6789/0 conn(0x7fb8cc14ddb0 legacy=0x7fb8cc06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:09.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.748+0000 7fb8d2962640 1 -- 172.21.15.78:0/4223257102 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc06c750 con 0x7fb8cc0c6910 2023-10-14T09:18:09.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d2962640 1 --2- 172.21.15.78:0/4223257102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8cc0c6910 0x7fb8cc0c3fe0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009e50 tx=0x7fb8c401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a842f8dcea2570 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:09.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d115f640 1 -- 172.21.15.78:0/4223257102 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40a56a0 con 0x7fb8cc0c6910 2023-10-14T09:18:09.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d115f640 1 -- 172.21.15.78:0/4223257102 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c40a5800 con 0x7fb8cc0c6910 2023-10-14T09:18:09.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d115f640 1 -- 172.21.15.78:0/4223257102 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40a5b90 con 0x7fb8cc0c6910 2023-10-14T09:18:09.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d43c5640 1 -- 172.21.15.78:0/4223257102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8cc0c6910 msgr2=0x7fb8cc0c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:09.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d43c5640 1 --2- 172.21.15.78:0/4223257102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8cc0c6910 0x7fb8cc0c3fe0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009e50 tx=0x7fb8c401c8f0 comp rx=0 tx=0).stop 2023-10-14T09:18:09.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d43c5640 1 -- 172.21.15.78:0/4223257102 shutdown_connections 2023-10-14T09:18:09.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d43c5640 1 --2- 172.21.15.78:0/4223257102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8cc0c6910 0x7fb8cc0c3fe0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:09.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d43c5640 1 --2- 172.21.15.78:0/4223257102 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8cc153e80 0x7fb8cc0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:09.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d43c5640 1 -- 172.21.15.78:0/4223257102 >> 172.21.15.78:0/4223257102 conn(0x7fb8cc0ab1f0 msgr2=0x7fb8cc0ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:09.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d43c5640 1 -- 172.21.15.78:0/4223257102 shutdown_connections 2023-10-14T09:18:09.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.752+0000 7fb8d43c5640 1 -- 172.21.15.78:0/4223257102 wait complete. 2023-10-14T09:18:09.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d43c5640 1 Processor -- start 2023-10-14T09:18:09.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d43c5640 1 -- start start 2023-10-14T09:18:09.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d43c5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8cc0c6910 0x7fb8cc1ec690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:09.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d43c5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8cc14ddb0 0x7fb8cc0c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:09.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d43c5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8cc153e80 0x7fb8cc0bf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:09.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d43c5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0bd5a0 con 0x7fb8cc153e80 2023-10-14T09:18:09.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d43c5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc1efd80 con 0x7fb8cc14ddb0 2023-10-14T09:18:09.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d43c5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc1f0060 con 0x7fb8cc0c6910 2023-10-14T09:18:09.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d2962640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8cc153e80 0x7fb8cc0bf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:09.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d2962640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8cc153e80 0x7fb8cc0bf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43738/0 (socket says 172.21.15.78:43738) 2023-10-14T09:18:09.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d2962640 1 -- 172.21.15.78:0/2532929380 learned_addr learned my addr 172.21.15.78:0/2532929380 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:09.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d2161640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8cc0c6910 0x7fb8cc1ec690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:09.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d1960640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8cc14ddb0 0x7fb8cc0c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:09.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d2962640 1 -- 172.21.15.78:0/2532929380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8cc0c6910 msgr2=0x7fb8cc1ec690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:09.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d2962640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8cc0c6910 0x7fb8cc1ec690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:09.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d2962640 1 -- 172.21.15.78:0/2532929380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8cc14ddb0 msgr2=0x7fb8cc0c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:09.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d2962640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8cc14ddb0 0x7fb8cc0c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:09.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d2962640 1 -- 172.21.15.78:0/2532929380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c4009b30 con 0x7fb8cc153e80 2023-10-14T09:18:09.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d2962640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8cc153e80 0x7fb8cc0bf740 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb8c401a520 tx=0x7fb8c4019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8c2ffd640 1 -- 172.21.15.78:0/2532929380 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40b8670 con 0x7fb8cc153e80 2023-10-14T09:18:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8c2ffd640 1 -- 172.21.15.78:0/2532929380 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c40b87d0 con 0x7fb8cc153e80 2023-10-14T09:18:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d43c5640 1 -- 172.21.15.78:0/2532929380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc1f0340 con 0x7fb8cc153e80 2023-10-14T09:18:09.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8c2ffd640 1 -- 172.21.15.78:0/2532929380 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40b8b40 con 0x7fb8cc153e80 2023-10-14T09:18:09.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.756+0000 7fb8d43c5640 1 -- 172.21.15.78:0/2532929380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc1f0900 con 0x7fb8cc153e80 2023-10-14T09:18:09.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.760+0000 7fb8d43c5640 1 -- 172.21.15.78:0/2532929380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc074180 con 0x7fb8cc153e80 2023-10-14T09:18:09.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.760+0000 7fb8c2ffd640 1 -- 172.21.15.78:0/2532929380 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb8c40b8ca0 con 0x7fb8cc153e80 2023-10-14T09:18:09.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.760+0000 7fb8c2ffd640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb8b00664a0 0x7fb8b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:09.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.760+0000 7fb8c2ffd640 1 -- 172.21.15.78:0/2532929380 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb8c411ee50 con 0x7fb8cc153e80 2023-10-14T09:18:09.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.760+0000 7fb8d2161640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb8b00664a0 0x7fb8b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:09.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.760+0000 7fb8d2161640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb8b00664a0 0x7fb8b0068960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8007fd0 tx=0x7fb8c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:09.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.764+0000 7fb8c2ffd640 1 -- 172.21.15.78:0/2532929380 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb8c40ec610 con 0x7fb8cc153e80 2023-10-14T09:18:09.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.964+0000 7fb8d43c5640 1 -- 172.21.15.78:0/2532929380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb8cc0c7d20 con 0x7fb8cc153e80 2023-10-14T09:18:09.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.964+0000 7fb8c2ffd640 1 -- 172.21.15.78:0/2532929380 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6065 (secure 0 0 0) 0x7fb8c4009510 con 0x7fb8cc153e80 2023-10-14T09:18:09.970 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:09.970 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:18:09.970 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-10-14T09:18:09.971 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.971 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-10-14T09:18:09.971 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBrXCplhsLmKRAAh8xCTPA/y4J2P6Wrtjhsmg==", 2023-10-14T09:18:09.971 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.971 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-10-14T09:18:09.972 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-10-14T09:18:09.972 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-10-14T09:18:09.972 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.972 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.972 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.973 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.973 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-10-14T09:18:09.973 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBrXCplguQMNhAAmOv7zgsuTno4plE11cCfHw==", 2023-10-14T09:18:09.973 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.973 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-10-14T09:18:09.974 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-10-14T09:18:09.974 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-10-14T09:18:09.974 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.974 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.974 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.975 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.975 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-10-14T09:18:09.975 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBrXCplyQgYMRAAUINKmFCk+Z/ZuXWS4jy6pA==", 2023-10-14T09:18:09.975 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.975 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-10-14T09:18:09.976 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-10-14T09:18:09.976 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-10-14T09:18:09.976 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.976 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.976 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.977 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.977 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-10-14T09:18:09.977 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBsXCpl0Ke9ARAA+K+1Mg8wTPbUaCqaw29UcA==", 2023-10-14T09:18:09.977 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.977 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-10-14T09:18:09.978 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-10-14T09:18:09.978 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-10-14T09:18:09.978 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.978 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.978 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.979 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.979 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-10-14T09:18:09.979 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBvXCplRbUIERAAxIwLnriE5yazQuG99AspDA==", 2023-10-14T09:18:09.979 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.979 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-10-14T09:18:09.980 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-10-14T09:18:09.980 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.980 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.980 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.981 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.981 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-10-14T09:18:09.981 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQByXCplCwR5FxAAPSn4N/Xk7EqzAIbGdqAqDw==", 2023-10-14T09:18:09.981 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.982 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-10-14T09:18:09.982 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-10-14T09:18:09.982 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.982 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.982 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.983 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.983 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-10-14T09:18:09.983 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB1XCplKGweHxAANSlcBJy0zm+39CW/uXeXkw==", 2023-10-14T09:18:09.983 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.983 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-10-14T09:18:09.984 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-10-14T09:18:09.984 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.984 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.984 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.984 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.985 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-10-14T09:18:09.985 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB4XCplj5WWJBAA6XrafZI+Cd1amO+1NXHZTg==", 2023-10-14T09:18:09.985 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.985 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-10-14T09:18:09.985 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-10-14T09:18:09.986 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.986 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.986 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.986 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.986 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-10-14T09:18:09.987 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB9XCplJ2dvBRAAYXKOTsTzJPft95usETS37Q==", 2023-10-14T09:18:09.987 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.987 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-10-14T09:18:09.987 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-10-14T09:18:09.987 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.988 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.988 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.988 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.988 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-10-14T09:18:09.988 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCAXCpl2K8+CxAAHgjM1Ks8gdbubAWxQMIYzg==", 2023-10-14T09:18:09.989 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.989 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-10-14T09:18:09.989 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-10-14T09:18:09.989 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.989 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.989 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.990 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.990 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-10-14T09:18:09.990 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCDXCplmbxJEhAAYJisQ3hmg2kVRDCTQ8E3Dg==", 2023-10-14T09:18:09.990 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.991 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-10-14T09:18:09.991 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-10-14T09:18:09.991 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.991 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.991 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.992 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.992 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-10-14T09:18:09.992 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCGXCpl/IsAGhAA7nfW9Eyjokq/8fh2sPDgLg==", 2023-10-14T09:18:09.992 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.992 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-10-14T09:18:09.993 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-10-14T09:18:09.993 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.993 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.993 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.993 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.993 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-10-14T09:18:09.994 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBsXCplSecJBhAAyIuXUmhDhdaJgqqjjqAa/w==", 2023-10-14T09:18:09.994 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.994 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-10-14T09:18:09.994 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-10-14T09:18:09.995 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-10-14T09:18:09.995 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-10-14T09:18:09.995 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.995 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.995 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.996 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-10-14T09:18:09.996 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBsXCplVQWDCRAA2Pez8tuTqaOfwhvWBep0hg==", 2023-10-14T09:18:09.996 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.996 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-10-14T09:18:09.996 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-10-14T09:18:09.997 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-10-14T09:18:09.997 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-10-14T09:18:09.997 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.997 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.997 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.997 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-10-14T09:18:09.998 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBrXCplutE1DBAAFXsTeyS3a1NfFDlhTqr1rg==", 2023-10-14T09:18:09.998 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:09.998 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-10-14T09:18:09.998 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-10-14T09:18:09.998 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-10-14T09:18:09.999 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:09.999 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:09.999 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:09.999 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:09.999 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mds", 2023-10-14T09:18:10.000 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCMXCplbdOAEBAACQvdvHmd1jZsUtPjVlmdIg==", 2023-10-14T09:18:10.000 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:10.000 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mds" 2023-10-14T09:18:10.000 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:10.000 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:10.000 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:10.001 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mgr", 2023-10-14T09:18:10.001 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCMXCple9+AEBAAt5QpUcu/Rw83UmZaq8Ra+A==", 2023-10-14T09:18:10.001 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:10.001 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-14T09:18:10.002 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:10.002 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:10.002 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:10.002 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-osd", 2023-10-14T09:18:10.002 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCMXCplgeiAEBAAgPzoTY/eEfLnSr49E4klBQ==", 2023-10-14T09:18:10.003 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:10.003 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-osd" 2023-10-14T09:18:10.003 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:10.003 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:10.004 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:10.004 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd", 2023-10-14T09:18:10.004 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCMXCplFPGAEBAADNo8u8eSzEDeODqdXsa5jA==", 2023-10-14T09:18:10.004 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:10.004 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-14T09:18:10.004 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:10.005 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:10.005 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:10.005 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-14T09:18:10.005 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCMXCpl1fmAEBAApulqPI5HdVvyBAp/Hpli5w==", 2023-10-14T09:18:10.006 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:10.006 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-14T09:18:10.006 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:10.006 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:10.006 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:10.007 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rgw", 2023-10-14T09:18:10.007 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCMXCplsgKBEBAA6ygFK6Baepom19g1nD/xRg==", 2023-10-14T09:18:10.007 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:10.007 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-14T09:18:10.007 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:10.008 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:10.008 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:10.008 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-10-14T09:18:10.008 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBrXCplJ22TJBAAa4iVMc6qk+OSZzjVxZK1vQ==", 2023-10-14T09:18:10.008 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:10.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-10-14T09:18:10.009 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-10-14T09:18:10.009 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:10.009 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:10.009 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-10-14T09:18:10.009 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:10.010 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-10-14T09:18:10.010 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBrXCplHo6+IBAAYlZ/yTZ218ZTWrSrdrbMqw==", 2023-10-14T09:18:10.010 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-10-14T09:18:10.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-10-14T09:18:10.010 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-10-14T09:18:10.011 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-10-14T09:18:10.011 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:10.011 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:10.011 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-10-14T09:18:10.012 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:18:10.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 -- 172.21.15.78:0/2532929380 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb8b00664a0 msgr2=0x7fb8b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb8b00664a0 0x7fb8b0068960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8007fd0 tx=0x7fb8c8009040 comp rx=0 tx=0).stop 2023-10-14T09:18:10.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 -- 172.21.15.78:0/2532929380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8cc153e80 msgr2=0x7fb8cc0bf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8cc153e80 0x7fb8cc0bf740 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb8c401a520 tx=0x7fb8c4019690 comp rx=0 tx=0).stop 2023-10-14T09:18:10.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 -- 172.21.15.78:0/2532929380 shutdown_connections 2023-10-14T09:18:10.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8cc153e80 0x7fb8cc0bf740 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8cc14ddb0 0x7fb8cc0c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb8b00664a0 0x7fb8b0068960 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 --2- 172.21.15.78:0/2532929380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb8cc0c6910 0x7fb8cc1ec690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 -- 172.21.15.78:0/2532929380 >> 172.21.15.78:0/2532929380 conn(0x7fb8cc0ab1f0 msgr2=0x7fb8cc0a95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:10.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 -- 172.21.15.78:0/2532929380 shutdown_connections 2023-10-14T09:18:10.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:09.968+0000 7fb8d43c5640 1 -- 172.21.15.78:0/2532929380 wait complete. 2023-10-14T09:18:10.016 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-14T09:18:10.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2e349e640 1 Processor -- start 2023-10-14T09:18:10.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2e349e640 1 -- start start 2023-10-14T09:18:10.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2e349e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa2dc152650 0x7fa2dc1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2e349e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc0a7670 con 0x7fa2dc06dca0 2023-10-14T09:18:10.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2e349e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc13b440 con 0x7fa2dc13b060 2023-10-14T09:18:10.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2e349e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc06db40 con 0x7fa2dc152650 2023-10-14T09:18:10.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2e1a3b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa2dc06dca0 0x7fa2dc155700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41988/0 (socket says 172.21.15.78:41988) 2023-10-14T09:18:10.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2e1a3b640 1 -- 172.21.15.78:0/406978769 learned_addr learned my addr 172.21.15.78:0/406978769 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:10.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2e0a39640 1 --2- 172.21.15.78:0/406978769 >> v2:172.21.15.157:3300/0 conn(0x7fa2dc152650 0x7fa2dc1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442425367 0 0) 0x7fa2dc0a7670 con 0x7fa2dc06dca0 2023-10-14T09:18:10.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2c8003530 con 0x7fa2dc06dca0 2023-10-14T09:18:10.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3381016710 0 0) 0x7fa2c8003530 con 0x7fa2dc06dca0 2023-10-14T09:18:10.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 >> v2:172.21.15.157:3300/0 conn(0x7fa2dc152650 msgr2=0x7fa2dc1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:10.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2d3fff640 1 --2- 172.21.15.78:0/406978769 >> v2:172.21.15.157:3300/0 conn(0x7fa2dc152650 0x7fa2dc1551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.152+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 >> v1:172.21.15.157:6789/0 conn(0x7fa2dc13b060 legacy=0x7fa2dc0ab680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc152b30 con 0x7fa2dc06dca0 2023-10-14T09:18:10.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7fa2d4001a00 con 0x7fa2dc06dca0 2023-10-14T09:18:10.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 >> v1:172.21.15.78:6789/0 conn(0x7fa2dc06dca0 legacy=0x7fa2dc155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2d3fff640 1 --2- 172.21.15.78:0/406978769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c8003980 0x7fa2c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2d3fff640 1 --2- 172.21.15.78:0/406978769 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c80047d0 0x7fa2c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2d3fff640 1 --2- 172.21.15.78:0/406978769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 0x7fa2c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc06db40 con 0x7fa2c8005190 2023-10-14T09:18:10.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c800c130 con 0x7fa2c8003980 2023-10-14T09:18:10.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c800c2f0 con 0x7fa2c80047d0 2023-10-14T09:18:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2e123a640 1 --2- 172.21.15.78:0/406978769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c8003980 0x7fa2c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2e1a3b640 1 --2- 172.21.15.78:0/406978769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 0x7fa2c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2e0a39640 1 --2- 172.21.15.78:0/406978769 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c80047d0 0x7fa2c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2e1a3b640 1 -- 172.21.15.78:0/406978769 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c80047d0 msgr2=0x7fa2c8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:10.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2e1a3b640 1 --2- 172.21.15.78:0/406978769 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2c80047d0 0x7fa2c8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2e1a3b640 1 -- 172.21.15.78:0/406978769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c8003980 msgr2=0x7fa2c8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:10.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2e1a3b640 1 --2- 172.21.15.78:0/406978769 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2c8003980 0x7fa2c8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2e1a3b640 1 -- 172.21.15.78:0/406978769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c8003530 con 0x7fa2c8005190 2023-10-14T09:18:10.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2e1a3b640 1 -- 172.21.15.78:0/406978769 reap_dead start 2023-10-14T09:18:10.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.156+0000 7fa2e1a3b640 1 --2- 172.21.15.78:0/406978769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 0x7fa2c800b990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400a830 tx=0x7fa2d401faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505efdb0d7484134 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:10.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40aa6d0 con 0x7fa2c8005190 2023-10-14T09:18:10.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d40aa870 con 0x7fa2c8005190 2023-10-14T09:18:10.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2d3fff640 1 -- 172.21.15.78:0/406978769 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40aac20 con 0x7fa2c8005190 2023-10-14T09:18:10.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 -- 172.21.15.78:0/406978769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 msgr2=0x7fa2c800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 --2- 172.21.15.78:0/406978769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 0x7fa2c800b990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400a830 tx=0x7fa2d401faa0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 -- 172.21.15.78:0/406978769 shutdown_connections 2023-10-14T09:18:10.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 --2- 172.21.15.78:0/406978769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 0x7fa2c800b990 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 -- 172.21.15.78:0/406978769 >> 172.21.15.78:0/406978769 conn(0x7fa2dc06c9c0 msgr2=0x7fa2dc06cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:10.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 -- 172.21.15.78:0/406978769 shutdown_connections 2023-10-14T09:18:10.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 -- 172.21.15.78:0/406978769 wait complete. 2023-10-14T09:18:10.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 Processor -- start 2023-10-14T09:18:10.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 -- start start 2023-10-14T09:18:10.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 0x7fa2dc154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2dc0bb7a0 0x7fa2dc1ea650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2dc070ea0 0x7fa2dc1e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc1e6b50 con 0x7fa2c8005190 2023-10-14T09:18:10.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0bc870 con 0x7fa2dc0bb7a0 2023-10-14T09:18:10.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e349e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc1eab90 con 0x7fa2dc070ea0 2023-10-14T09:18:10.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e123a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 0x7fa2dc154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e123a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 0x7fa2dc154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43754/0 (socket says 172.21.15.78:43754) 2023-10-14T09:18:10.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e123a640 1 -- 172.21.15.78:0/2963529373 learned_addr learned my addr 172.21.15.78:0/2963529373 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:10.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e1a3b640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2dc070ea0 0x7fa2dc1e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e0a39640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2dc0bb7a0 0x7fa2dc1ea650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.160+0000 7fa2e123a640 1 -- 172.21.15.78:0/2963529373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2dc070ea0 msgr2=0x7fa2dc1e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2e123a640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2dc070ea0 0x7fa2dc1e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2e123a640 1 -- 172.21.15.78:0/2963529373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2dc0bb7a0 msgr2=0x7fa2dc1ea650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2e123a640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2dc0bb7a0 0x7fa2dc1ea650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2e123a640 1 -- 172.21.15.78:0/2963529373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc1e67e0 con 0x7fa2c8005190 2023-10-14T09:18:10.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2e123a640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 0x7fa2dc154640 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800f570 tx=0x7fa2d800fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2d1ffb640 1 -- 172.21.15.78:0/2963529373 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80052e0 con 0x7fa2c8005190 2023-10-14T09:18:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2d1ffb640 1 -- 172.21.15.78:0/2963529373 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d8005440 con 0x7fa2c8005190 2023-10-14T09:18:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2e349e640 1 -- 172.21.15.78:0/2963529373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc0bbd60 con 0x7fa2c8005190 2023-10-14T09:18:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2d1ffb640 1 -- 172.21.15.78:0/2963529373 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8003800 con 0x7fa2c8005190 2023-10-14T09:18:10.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2e349e640 1 -- 172.21.15.78:0/2963529373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc071320 con 0x7fa2c8005190 2023-10-14T09:18:10.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2e349e640 1 -- 172.21.15.78:0/2963529373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc074180 con 0x7fa2c8005190 2023-10-14T09:18:10.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2d1ffb640 1 -- 172.21.15.78:0/2963529373 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa2d8003960 con 0x7fa2c8005190 2023-10-14T09:18:10.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2d1ffb640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2c00664a0 0x7fa2c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2d1ffb640 1 -- 172.21.15.78:0/2963529373 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa2d8083920 con 0x7fa2c8005190 2023-10-14T09:18:10.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.164+0000 7fa2e0a39640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2c00664a0 0x7fa2c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.168+0000 7fa2e0a39640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2c00664a0 0x7fa2c0068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc155df0 tx=0x7fa2cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:10.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.168+0000 7fa2d1ffb640 1 -- 172.21.15.78:0/2963529373 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa2d80510e0 con 0x7fa2c8005190 2023-10-14T09:18:10.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.372+0000 7fa2e349e640 1 -- 172.21.15.78:0/2963529373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fa2dc0714b0 con 0x7fa2c8005190 2023-10-14T09:18:10.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.376+0000 7fa2d1ffb640 1 -- 172.21.15.78:0/2963529373 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa2dc0714b0 con 0x7fa2c8005190 2023-10-14T09:18:10.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 -- 172.21.15.78:0/2963529373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2c00664a0 msgr2=0x7fa2c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2c00664a0 0x7fa2c0068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc155df0 tx=0x7fa2cc008040 comp rx=0 tx=0).stop 2023-10-14T09:18:10.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 -- 172.21.15.78:0/2963529373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 msgr2=0x7fa2dc154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 0x7fa2dc154640 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800f570 tx=0x7fa2d800fa30 comp rx=0 tx=0).stop 2023-10-14T09:18:10.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 -- 172.21.15.78:0/2963529373 shutdown_connections 2023-10-14T09:18:10.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa2c00664a0 0x7fa2c0068960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2dc070ea0 0x7fa2dc1e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2dc0bb7a0 0x7fa2dc1ea650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 --2- 172.21.15.78:0/2963529373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2c8005190 0x7fa2dc154640 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 -- 172.21.15.78:0/2963529373 >> 172.21.15.78:0/2963529373 conn(0x7fa2dc06c9c0 msgr2=0x7fa2dc151300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:10.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 -- 172.21.15.78:0/2963529373 shutdown_connections 2023-10-14T09:18:10.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.380+0000 7fa2e349e640 1 -- 172.21.15.78:0/2963529373 wait complete. 2023-10-14T09:18:10.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-14T09:18:10.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe92cdc640 1 Processor -- start 2023-10-14T09:18:10.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe92cdc640 1 -- start start 2023-10-14T09:18:10.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe92cdc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbe8c1514b0 0x7fbe8c0c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe92cdc640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8c154490 con 0x7fbe8c154920 2023-10-14T09:18:10.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe92cdc640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8c0c5a00 con 0x7fbe8c0c4810 2023-10-14T09:18:10.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe92cdc640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c153c30 con 0x7fbe8c1514b0 2023-10-14T09:18:10.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe914d9640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbe8c154920 0x7fbe8c0c7330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41994/0 (socket says 172.21.15.78:41994) 2023-10-14T09:18:10.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe914d9640 1 -- 172.21.15.78:0/3439144672 learned_addr learned my addr 172.21.15.78:0/3439144672 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:10.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe91cda640 1 --2- 172.21.15.78:0/3439144672 >> v2:172.21.15.157:3300/0 conn(0x7fbe8c1514b0 0x7fbe8c0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399751007 0 0) 0x7fbe8c154490 con 0x7fbe8c154920 2023-10-14T09:18:10.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe78003530 con 0x7fbe8c154920 2023-10-14T09:18:10.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1437745755 0 0) 0x7fbe78003530 con 0x7fbe8c154920 2023-10-14T09:18:10.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 >> v2:172.21.15.157:3300/0 conn(0x7fbe8c1514b0 msgr2=0x7fbe8c0c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:10.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 --2- 172.21.15.78:0/3439144672 >> v2:172.21.15.157:3300/0 conn(0x7fbe8c1514b0 0x7fbe8c0c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 >> v1:172.21.15.157:6789/0 conn(0x7fbe8c0c4810 legacy=0x7fbe8c15e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c153e40 con 0x7fbe8c154920 2023-10-14T09:18:10.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7fbe7c001680 con 0x7fbe8c154920 2023-10-14T09:18:10.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 >> v1:172.21.15.78:6789/0 conn(0x7fbe8c154920 legacy=0x7fbe8c0c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 --2- 172.21.15.78:0/3439144672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe78003a60 0x7fbe78003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 --2- 172.21.15.78:0/3439144672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 0x7fbe78004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 --2- 172.21.15.78:0/3439144672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe78005390 0x7fbe7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c153c30 con 0x7fbe780047d0 2023-10-14T09:18:10.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7800c250 con 0x7fbe78003a60 2023-10-14T09:18:10.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7800c410 con 0x7fbe78005390 2023-10-14T09:18:10.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe914d9640 1 --2- 172.21.15.78:0/3439144672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 0x7fbe78004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.536+0000 7fbe91cda640 1 --2- 172.21.15.78:0/3439144672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe78003a60 0x7fbe78003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe924db640 1 --2- 172.21.15.78:0/3439144672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe78005390 0x7fbe7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe914d9640 1 -- 172.21.15.78:0/3439144672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe78005390 msgr2=0x7fbe7800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:10.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe914d9640 1 --2- 172.21.15.78:0/3439144672 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe78005390 0x7fbe7800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe914d9640 1 -- 172.21.15.78:0/3439144672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe78003a60 msgr2=0x7fbe78003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:10.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe914d9640 1 --2- 172.21.15.78:0/3439144672 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe78003a60 0x7fbe78003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe914d9640 1 -- 172.21.15.78:0/3439144672 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78003530 con 0x7fbe780047d0 2023-10-14T09:18:10.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe924db640 1 -- 172.21.15.78:0/3439144672 reap_dead start 2023-10-14T09:18:10.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe914d9640 1 --2- 172.21.15.78:0/3439144672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 0x7fbe78004c50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00c240 tx=0x7fbe7c01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a996dbbab80eae8e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:10.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0058e0 con 0x7fbe780047d0 2023-10-14T09:18:10.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c005a40 con 0x7fbe780047d0 2023-10-14T09:18:10.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe90cd8640 1 -- 172.21.15.78:0/3439144672 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c005e70 con 0x7fbe780047d0 2023-10-14T09:18:10.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3439144672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 msgr2=0x7fbe78004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe92cdc640 1 --2- 172.21.15.78:0/3439144672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 0x7fbe78004c50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00c240 tx=0x7fbe7c01cbd0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3439144672 shutdown_connections 2023-10-14T09:18:10.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe92cdc640 1 --2- 172.21.15.78:0/3439144672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 0x7fbe78004c50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.540+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3439144672 >> 172.21.15.78:0/3439144672 conn(0x7fbe8c0c9430 msgr2=0x7fbe8c0c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:10.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3439144672 shutdown_connections 2023-10-14T09:18:10.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3439144672 wait complete. 2023-10-14T09:18:10.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 Processor -- start 2023-10-14T09:18:10.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 -- start start 2023-10-14T09:18:10.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 0x7fbe8c156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe8c0ae920 0x7fbe8c0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe8c1ec040 0x7fbe8c1ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c14bd20 con 0x7fbe780047d0 2023-10-14T09:18:10.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c157b60 con 0x7fbe8c0ae920 2023-10-14T09:18:10.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c156fe0 con 0x7fbe8c1ec040 2023-10-14T09:18:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe91cda640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 0x7fbe8c156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe91cda640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 0x7fbe8c156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43768/0 (socket says 172.21.15.78:43768) 2023-10-14T09:18:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe91cda640 1 -- 172.21.15.78:0/3543849084 learned_addr learned my addr 172.21.15.78:0/3543849084 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe91cda640 1 -- 172.21.15.78:0/3543849084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe8c1ec040 msgr2=0x7fbe8c1ec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe91cda640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe8c1ec040 0x7fbe8c1ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe91cda640 1 -- 172.21.15.78:0/3543849084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe8c0ae920 msgr2=0x7fbe8c0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe91cda640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe8c0ae920 0x7fbe8c0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe91cda640 1 -- 172.21.15.78:0/3543849084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c1572c0 con 0x7fbe780047d0 2023-10-14T09:18:10.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe91cda640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 0x7fbe8c156a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbe88011950 tx=0x7fbe88011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:10.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe827fc640 1 -- 172.21.15.78:0/3543849084 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800faf0 con 0x7fbe780047d0 2023-10-14T09:18:10.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe827fc640 1 -- 172.21.15.78:0/3543849084 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800fc50 con 0x7fbe780047d0 2023-10-14T09:18:10.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3543849084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8c1575a0 con 0x7fbe780047d0 2023-10-14T09:18:10.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe827fc640 1 -- 172.21.15.78:0/3543849084 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88014440 con 0x7fbe780047d0 2023-10-14T09:18:10.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.544+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3543849084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8c1eca00 con 0x7fbe780047d0 2023-10-14T09:18:10.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.548+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3543849084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8c0af2e0 con 0x7fbe780047d0 2023-10-14T09:18:10.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.548+0000 7fbe827fc640 1 -- 172.21.15.78:0/3543849084 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbe8801d400 con 0x7fbe780047d0 2023-10-14T09:18:10.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.548+0000 7fbe827fc640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbe700664a0 0x7fbe70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.548+0000 7fbe827fc640 1 -- 172.21.15.78:0/3543849084 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe880843f0 con 0x7fbe780047d0 2023-10-14T09:18:10.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.548+0000 7fbe914d9640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbe700664a0 0x7fbe70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.548+0000 7fbe914d9640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbe700664a0 0x7fbe70068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0ab000 tx=0x7fbe7c001a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:10.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.552+0000 7fbe827fc640 1 -- 172.21.15.78:0/3543849084 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbe88051c70 con 0x7fbe780047d0 2023-10-14T09:18:10.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.760+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3543849084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fbe8c04e9c0 con 0x7fbe780047d0 2023-10-14T09:18:10.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe827fc640 1 -- 172.21.15.78:0/3543849084 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbe88055290 con 0x7fbe780047d0 2023-10-14T09:18:10.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3543849084 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbe700664a0 msgr2=0x7fbe70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbe700664a0 0x7fbe70068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0ab000 tx=0x7fbe7c001a10 comp rx=0 tx=0).stop 2023-10-14T09:18:10.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3543849084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 msgr2=0x7fbe8c156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 0x7fbe8c156a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbe88011950 tx=0x7fbe88011e10 comp rx=0 tx=0).stop 2023-10-14T09:18:10.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3543849084 shutdown_connections 2023-10-14T09:18:10.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbe700664a0 0x7fbe70068960 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbe8c1ec040 0x7fbe8c1ec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe8c0ae920 0x7fbe8c0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 --2- 172.21.15.78:0/3543849084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe780047d0 0x7fbe8c156a00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3543849084 >> 172.21.15.78:0/3543849084 conn(0x7fbe8c0c9430 msgr2=0x7fbe8c152fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:10.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3543849084 shutdown_connections 2023-10-14T09:18:10.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.764+0000 7fbe92cdc640 1 -- 172.21.15.78:0/3543849084 wait complete. 2023-10-14T09:18:10.788 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-14T09:18:10.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85d6846640 1 Processor -- start 2023-10-14T09:18:10.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85d6846640 1 -- start start 2023-10-14T09:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85d6846640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85d013b050 0x7f85d0155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85d6846640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85d00a87c0 0x7f85d006d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85d6846640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d0152a60 con 0x7f85d00a8360 2023-10-14T09:18:10.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85d6846640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d00a9340 con 0x7f85d013b050 2023-10-14T09:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85d6846640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d0155fb0 con 0x7f85d00a87c0 2023-10-14T09:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85cffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85d013b050 0x7f85d0155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85cf7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f85d00a8360 0x7f85d006cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42006/0 (socket says 172.21.15.78:42006) 2023-10-14T09:18:10.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85cf7fe640 1 -- 172.21.15.78:0/3893532765 learned_addr learned my addr 172.21.15.78:0/3893532765 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:10.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85d4de3640 1 --2- 172.21.15.78:0/3893532765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85d00a87c0 0x7f85d006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85cffff640 1 -- 172.21.15.78:0/3893532765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85d00a87c0 msgr2=0x7f85d006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:10.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85cffff640 1 --2- 172.21.15.78:0/3893532765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85d00a87c0 0x7f85d006d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85cffff640 1 -- 172.21.15.78:0/3893532765 >> v1:172.21.15.78:6789/0 conn(0x7f85d00a8360 legacy=0x7f85d006cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85cffff640 1 -- 172.21.15.78:0/3893532765 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d0151e50 con 0x7f85d013b050 2023-10-14T09:18:10.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.924+0000 7f85ceffd640 1 -- 172.21.15.78:0/3893532765 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800079223 0 0) 0x7f85d0152a60 con 0x7f85d00a8360 2023-10-14T09:18:10.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85cffff640 1 --2- 172.21.15.78:0/3893532765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d013b050 0x7f85d0155a70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097c0 tx=0x7f85c001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cfb1a79df469d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:10.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85ceffd640 1 -- 172.21.15.78:0/3893532765 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00ab5f0 con 0x7f85d013b050 2023-10-14T09:18:10.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85ceffd640 1 -- 172.21.15.78:0/3893532765 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c00ab750 con 0x7f85d013b050 2023-10-14T09:18:10.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85ceffd640 1 -- 172.21.15.78:0/3893532765 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00abae0 con 0x7f85d013b050 2023-10-14T09:18:10.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85d6846640 1 -- 172.21.15.78:0/3893532765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d013b050 msgr2=0x7f85d0155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85d6846640 1 --2- 172.21.15.78:0/3893532765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d013b050 0x7f85d0155a70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f85c00097c0 tx=0x7f85c001c3f0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85d6846640 1 -- 172.21.15.78:0/3893532765 shutdown_connections 2023-10-14T09:18:10.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85d6846640 1 --2- 172.21.15.78:0/3893532765 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85d00a87c0 0x7f85d006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85d6846640 1 --2- 172.21.15.78:0/3893532765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d013b050 0x7f85d0155a70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85d6846640 1 -- 172.21.15.78:0/3893532765 >> 172.21.15.78:0/3893532765 conn(0x7f85d00c1cc0 msgr2=0x7f85d00c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:10.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85d6846640 1 -- 172.21.15.78:0/3893532765 shutdown_connections 2023-10-14T09:18:10.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.928+0000 7f85d6846640 1 -- 172.21.15.78:0/3893532765 wait complete. 2023-10-14T09:18:10.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d6846640 1 Processor -- start 2023-10-14T09:18:10.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d6846640 1 -- start start 2023-10-14T09:18:10.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d6846640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85d00a8360 0x7f85d01ebd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d6846640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85d00a87c0 0x7f85d0133b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d6846640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d013b050 0x7f85d01efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d6846640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d0155e00 con 0x7f85d013b050 2023-10-14T09:18:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d6846640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d01ec2d0 con 0x7f85d00a87c0 2023-10-14T09:18:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d6846640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d0155840 con 0x7f85d00a8360 2023-10-14T09:18:10.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d4de3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d013b050 0x7f85d01efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d4de3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d013b050 0x7f85d01efc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43782/0 (socket says 172.21.15.78:43782) 2023-10-14T09:18:10.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d4de3640 1 -- 172.21.15.78:0/2331107113 learned_addr learned my addr 172.21.15.78:0/2331107113 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:10.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85cffff640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85d00a8360 0x7f85d01ebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85cf7fe640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85d00a87c0 0x7f85d0133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d4de3640 1 -- 172.21.15.78:0/2331107113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85d00a8360 msgr2=0x7f85d01ebd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d4de3640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85d00a8360 0x7f85d01ebd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d4de3640 1 -- 172.21.15.78:0/2331107113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85d00a87c0 msgr2=0x7f85d0133b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:10.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d4de3640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85d00a87c0 0x7f85d0133b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:10.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d4de3640 1 -- 172.21.15.78:0/2331107113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0009420 con 0x7f85d013b050 2023-10-14T09:18:10.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d4de3640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d013b050 0x7f85d01efc30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f85c8007e40 tx=0x7f85c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:10.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85ccff9640 1 -- 172.21.15.78:0/2331107113 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8014620 con 0x7f85d013b050 2023-10-14T09:18:10.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85ccff9640 1 -- 172.21.15.78:0/2331107113 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c800ee90 con 0x7f85d013b050 2023-10-14T09:18:10.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85ccff9640 1 -- 172.21.15.78:0/2331107113 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80149e0 con 0x7f85d013b050 2023-10-14T09:18:10.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d6846640 1 -- 172.21.15.78:0/2331107113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d0155b20 con 0x7f85d013b050 2023-10-14T09:18:10.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.932+0000 7f85d6846640 1 -- 172.21.15.78:0/2331107113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d01ef710 con 0x7f85d013b050 2023-10-14T09:18:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.936+0000 7f85d6846640 1 -- 172.21.15.78:0/2331107113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d0074180 con 0x7f85d013b050 2023-10-14T09:18:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.936+0000 7f85ccff9640 1 -- 172.21.15.78:0/2331107113 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f85c8014b40 con 0x7f85d013b050 2023-10-14T09:18:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.936+0000 7f85ccff9640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f85bc0664a0 0x7f85bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.936+0000 7f85ccff9640 1 -- 172.21.15.78:0/2331107113 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f85c8084380 con 0x7f85d013b050 2023-10-14T09:18:10.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.936+0000 7f85cffff640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f85bc0664a0 0x7f85bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:10.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.936+0000 7f85cffff640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f85bc0664a0 0x7f85bc068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f85c00af000 tx=0x7f85c00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:10.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:10.940+0000 7f85ccff9640 1 -- 172.21.15.78:0/2331107113 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f85c8051bf0 con 0x7f85d013b050 2023-10-14T09:18:11.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.140+0000 7f85d6846640 1 -- 172.21.15.78:0/2331107113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f85d00c1800 con 0x7f85d013b050 2023-10-14T09:18:11.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.144+0000 7f85ccff9640 1 -- 172.21.15.78:0/2331107113 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f85c8055210 con 0x7f85d013b050 2023-10-14T09:18:11.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 -- 172.21.15.78:0/2331107113 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f85bc0664a0 msgr2=0x7f85bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f85bc0664a0 0x7f85bc068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f85c00af000 tx=0x7f85c00a7000 comp rx=0 tx=0).stop 2023-10-14T09:18:11.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 -- 172.21.15.78:0/2331107113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d013b050 msgr2=0x7f85d01efc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d013b050 0x7f85d01efc30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f85c8007e40 tx=0x7f85c800e4b0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 -- 172.21.15.78:0/2331107113 shutdown_connections 2023-10-14T09:18:11.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85d013b050 0x7f85d01efc30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85d00a87c0 0x7f85d0133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f85bc0664a0 0x7f85bc068960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 --2- 172.21.15.78:0/2331107113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f85d00a8360 0x7f85d01ebd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 -- 172.21.15.78:0/2331107113 >> 172.21.15.78:0/2331107113 conn(0x7f85d00c1cc0 msgr2=0x7f85d006cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:11.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 -- 172.21.15.78:0/2331107113 shutdown_connections 2023-10-14T09:18:11.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.148+0000 7f85d6846640 1 -- 172.21.15.78:0/2331107113 wait complete. 2023-10-14T09:18:11.169 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-14T09:18:11.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.304+0000 7fece14c9640 1 Processor -- start 2023-10-14T09:18:11.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.304+0000 7fece14c9640 1 -- start start 2023-10-14T09:18:11.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.304+0000 7fece14c9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fecdc153e80 0x7fecdc0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.304+0000 7fece14c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecdc0c6910 0x7fecdc0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.304+0000 7fece14c9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc06c470 con 0x7fecdc14ddb0 2023-10-14T09:18:11.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.304+0000 7fece14c9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecdc0c64f0 con 0x7fecdc153e80 2023-10-14T09:18:11.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.304+0000 7fece14c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0c5300 con 0x7fecdc0c6910 2023-10-14T09:18:11.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.304+0000 7fecd27fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fecdc153e80 0x7fecdc0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.304+0000 7fecd27fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fecdc153e80 0x7fecdc0c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:49762/0 (socket says 172.21.15.78:49762) 2023-10-14T09:18:11.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.304+0000 7fecd27fc640 1 -- 172.21.15.78:0/2696796920 learned_addr learned my addr 172.21.15.78:0/2696796920 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:11.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.304+0000 7fecdb7fe640 1 --2- 172.21.15.78:0/2696796920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecdc0c6910 0x7fecdc0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.308+0000 7fecd27fc640 1 -- 172.21.15.78:0/2696796920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecdc0c6910 msgr2=0x7fecdc0c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.308+0000 7fecd27fc640 1 --2- 172.21.15.78:0/2696796920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecdc0c6910 0x7fecdc0c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.308+0000 7fecd27fc640 1 -- 172.21.15.78:0/2696796920 >> v1:172.21.15.157:6789/0 conn(0x7fecdc14ddb0 legacy=0x7fecdc06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.308+0000 7fecd27fc640 1 -- 172.21.15.78:0/2696796920 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc06c750 con 0x7fecdc153e80 2023-10-14T09:18:11.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.308+0000 7fecda7fc640 1 -- 172.21.15.78:0/2696796920 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994375351 0 0) 0x7fecdc06c470 con 0x7fecdc14ddb0 2023-10-14T09:18:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.308+0000 7fecd27fc640 1 --2- 172.21.15.78:0/2696796920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecdc153e80 0x7fecdc0c7780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009870 tx=0x7fecc401c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5c76d54f89ad0cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:11.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.308+0000 7fecda7fc640 1 -- 172.21.15.78:0/2696796920 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40ac640 con 0x7fecdc153e80 2023-10-14T09:18:11.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.308+0000 7fecda7fc640 1 -- 172.21.15.78:0/2696796920 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc40ac7a0 con 0x7fecdc153e80 2023-10-14T09:18:11.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.308+0000 7fecda7fc640 1 -- 172.21.15.78:0/2696796920 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40acb30 con 0x7fecdc153e80 2023-10-14T09:18:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.308+0000 7fece14c9640 1 -- 172.21.15.78:0/2696796920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecdc153e80 msgr2=0x7fecdc0c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.308+0000 7fece14c9640 1 --2- 172.21.15.78:0/2696796920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecdc153e80 0x7fecdc0c7780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009870 tx=0x7fecc401c420 comp rx=0 tx=0).stop 2023-10-14T09:18:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 -- 172.21.15.78:0/2696796920 shutdown_connections 2023-10-14T09:18:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 --2- 172.21.15.78:0/2696796920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecdc0c6910 0x7fecdc0c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 --2- 172.21.15.78:0/2696796920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecdc153e80 0x7fecdc0c7780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 -- 172.21.15.78:0/2696796920 >> 172.21.15.78:0/2696796920 conn(0x7fecdc0ab1f0 msgr2=0x7fecdc0ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 -- 172.21.15.78:0/2696796920 shutdown_connections 2023-10-14T09:18:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 -- 172.21.15.78:0/2696796920 wait complete. 2023-10-14T09:18:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 Processor -- start 2023-10-14T09:18:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 -- start start 2023-10-14T09:18:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecdc0c6910 0x7fecdc1ece10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc14ddb0 0x7fecdc0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecdc153e80 0x7fecdc1ef830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc15c690 con 0x7fecdc14ddb0 2023-10-14T09:18:11.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1ec980 con 0x7fecdc153e80 2023-10-14T09:18:11.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fece14c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc14e490 con 0x7fecdc0c6910 2023-10-14T09:18:11.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fecd27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc14ddb0 0x7fecdc0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fecd27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc14ddb0 0x7fecdc0c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43798/0 (socket says 172.21.15.78:43798) 2023-10-14T09:18:11.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fecd27fc640 1 -- 172.21.15.78:0/2015495373 learned_addr learned my addr 172.21.15.78:0/2015495373 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:11.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fecdaffd640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecdc0c6910 0x7fecdc1ece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fecdb7fe640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecdc153e80 0x7fecdc1ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fecd27fc640 1 -- 172.21.15.78:0/2015495373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecdc0c6910 msgr2=0x7fecdc1ece10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fecd27fc640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecdc0c6910 0x7fecdc1ece10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fecd27fc640 1 -- 172.21.15.78:0/2015495373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecdc153e80 msgr2=0x7fecdc1ef830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fecd27fc640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecdc153e80 0x7fecdc1ef830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.312+0000 7fecd27fc640 1 -- 172.21.15.78:0/2015495373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc40094d0 con 0x7fecdc14ddb0 2023-10-14T09:18:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.316+0000 7fecd27fc640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc14ddb0 0x7fecdc0c8520 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fecc401a050 tx=0x7fecc40191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.316+0000 7fecd3fff640 1 -- 172.21.15.78:0/2015495373 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40b6640 con 0x7fecdc14ddb0 2023-10-14T09:18:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.316+0000 7fecd3fff640 1 -- 172.21.15.78:0/2015495373 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc40b67a0 con 0x7fecdc14ddb0 2023-10-14T09:18:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.316+0000 7fecd3fff640 1 -- 172.21.15.78:0/2015495373 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40b6b50 con 0x7fecdc14ddb0 2023-10-14T09:18:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.316+0000 7fece14c9640 1 -- 172.21.15.78:0/2015495373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc14e770 con 0x7fecdc14ddb0 2023-10-14T09:18:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.316+0000 7fece14c9640 1 -- 172.21.15.78:0/2015495373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc0c8a60 con 0x7fecdc14ddb0 2023-10-14T09:18:11.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.316+0000 7fece14c9640 1 -- 172.21.15.78:0/2015495373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc1ecb10 con 0x7fecdc14ddb0 2023-10-14T09:18:11.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.316+0000 7fecd3fff640 1 -- 172.21.15.78:0/2015495373 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fecc40b6cb0 con 0x7fecdc14ddb0 2023-10-14T09:18:11.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.316+0000 7fecd3fff640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fecbc0664a0 0x7fecbc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.316+0000 7fecd3fff640 1 -- 172.21.15.78:0/2015495373 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fecc411e310 con 0x7fecdc14ddb0 2023-10-14T09:18:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.316+0000 7fecdaffd640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fecbc0664a0 0x7fecbc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.320+0000 7fecdaffd640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fecbc0664a0 0x7fecbc068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feccc0012f0 tx=0x7feccc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.320+0000 7fecd3fff640 1 -- 172.21.15.78:0/2015495373 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fecc40ebbf0 con 0x7fecdc14ddb0 2023-10-14T09:18:11.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.524+0000 7fece14c9640 1 -- 172.21.15.78:0/2015495373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fecdc074180 con 0x7fecdc14ddb0 2023-10-14T09:18:11.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.524+0000 7fecd3fff640 1 -- 172.21.15.78:0/2015495373 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fecc40ef210 con 0x7fecdc14ddb0 2023-10-14T09:18:11.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 -- 172.21.15.78:0/2015495373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fecbc0664a0 msgr2=0x7fecbc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fecbc0664a0 0x7fecbc068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feccc0012f0 tx=0x7feccc009040 comp rx=0 tx=0).stop 2023-10-14T09:18:11.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 -- 172.21.15.78:0/2015495373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc14ddb0 msgr2=0x7fecdc0c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc14ddb0 0x7fecdc0c8520 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fecc401a050 tx=0x7fecc40191c0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 -- 172.21.15.78:0/2015495373 shutdown_connections 2023-10-14T09:18:11.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fecdc153e80 0x7fecdc1ef830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc14ddb0 0x7fecdc0c8520 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fecbc0664a0 0x7fecbc068960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 --2- 172.21.15.78:0/2015495373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fecdc0c6910 0x7fecdc1ece10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 -- 172.21.15.78:0/2015495373 >> 172.21.15.78:0/2015495373 conn(0x7fecdc0ab1f0 msgr2=0x7fecdc0bfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:11.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 -- 172.21.15.78:0/2015495373 shutdown_connections 2023-10-14T09:18:11.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.528+0000 7fece14c9640 1 -- 172.21.15.78:0/2015495373 wait complete. 2023-10-14T09:18:11.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-14T09:18:11.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.688+0000 7f65c2f65640 1 Processor -- start 2023-10-14T09:18:11.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.688+0000 7f65c2f65640 1 -- start start 2023-10-14T09:18:11.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.688+0000 7f65c2f65640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65bc0be570 0x7f65bc1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.688+0000 7f65c2f65640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f65bc157370 0x7f65bc0be950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.688+0000 7f65c2f65640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc1578e0 con 0x7f65bc071120 2023-10-14T09:18:11.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.688+0000 7f65c2f65640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc06ffd0 con 0x7f65bc157370 2023-10-14T09:18:11.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.688+0000 7f65c2f65640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc157bc0 con 0x7f65bc0be570 2023-10-14T09:18:11.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.692+0000 7f65b3fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f65bc157370 0x7f65bc0be950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.692+0000 7f65c0d01640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65bc0be570 0x7f65bc1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.692+0000 7f65c1502640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f65bc071120 0x7f65bc0715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:37444/0 (socket says 172.21.15.78:37444) 2023-10-14T09:18:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.692+0000 7f65c1502640 1 -- 172.21.15.78:0/2845902591 learned_addr learned my addr 172.21.15.78:0/2845902591 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:11.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.692+0000 7f65b3fff640 1 -- 172.21.15.78:0/2845902591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65bc0be570 msgr2=0x7f65bc1549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.692+0000 7f65b3fff640 1 --2- 172.21.15.78:0/2845902591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65bc0be570 0x7f65bc1549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.692+0000 7f65b3fff640 1 -- 172.21.15.78:0/2845902591 >> v1:172.21.15.157:6789/0 conn(0x7f65bc071120 legacy=0x7f65bc0715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.692+0000 7f65b3fff640 1 -- 172.21.15.78:0/2845902591 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc157ea0 con 0x7f65bc157370 2023-10-14T09:18:11.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.692+0000 7f65c0d01640 1 --2- 172.21.15.78:0/2845902591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65bc0be570 0x7f65bc1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:18:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.692+0000 7f65b3fff640 1 --2- 172.21.15.78:0/2845902591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc157370 0x7f65bc0be950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0097c0 tx=0x7f65ac01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=654fde1827be2b1a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65b37fe640 1 -- 172.21.15.78:0/2845902591 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0ab610 con 0x7f65bc157370 2023-10-14T09:18:11.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65b37fe640 1 -- 172.21.15.78:0/2845902591 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac0ab770 con 0x7f65bc157370 2023-10-14T09:18:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65b37fe640 1 -- 172.21.15.78:0/2845902591 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0abb00 con 0x7f65bc157370 2023-10-14T09:18:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 -- 172.21.15.78:0/2845902591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc157370 msgr2=0x7f65bc0be950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 --2- 172.21.15.78:0/2845902591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc157370 0x7f65bc0be950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0097c0 tx=0x7f65ac01c450 comp rx=0 tx=0).stop 2023-10-14T09:18:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 -- 172.21.15.78:0/2845902591 shutdown_connections 2023-10-14T09:18:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 --2- 172.21.15.78:0/2845902591 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc157370 0x7f65bc0be950 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 --2- 172.21.15.78:0/2845902591 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65bc0be570 0x7f65bc1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 -- 172.21.15.78:0/2845902591 >> 172.21.15.78:0/2845902591 conn(0x7f65bc0c1cc0 msgr2=0x7f65bc0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 -- 172.21.15.78:0/2845902591 shutdown_connections 2023-10-14T09:18:11.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 -- 172.21.15.78:0/2845902591 wait complete. 2023-10-14T09:18:11.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 Processor -- start 2023-10-14T09:18:11.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 -- start start 2023-10-14T09:18:11.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65bc071120 0x7f65bc1ed850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc0be570 0x7f65bc1ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc157370 0x7f65bc135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0aab50 con 0x7f65bc157370 2023-10-14T09:18:11.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc1ed3a0 con 0x7f65bc0be570 2023-10-14T09:18:11.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c2f65640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0c2e10 con 0x7f65bc071120 2023-10-14T09:18:11.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.696+0000 7f65c1502640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc157370 0x7f65bc135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c1502640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc157370 0x7f65bc135ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43810/0 (socket says 172.21.15.78:43810) 2023-10-14T09:18:11.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65b3fff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc0be570 0x7f65bc1ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c1502640 1 -- 172.21.15.78:0/2198018547 learned_addr learned my addr 172.21.15.78:0/2198018547 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:11.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c0d01640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65bc071120 0x7f65bc1ed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c1502640 1 -- 172.21.15.78:0/2198018547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65bc071120 msgr2=0x7f65bc1ed850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c1502640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65bc071120 0x7f65bc1ed850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c1502640 1 -- 172.21.15.78:0/2198018547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc0be570 msgr2=0x7f65bc1ece60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c1502640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc0be570 0x7f65bc1ece60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c1502640 1 -- 172.21.15.78:0/2198018547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b8009420 con 0x7f65bc157370 2023-10-14T09:18:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c1502640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc157370 0x7f65bc135ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f65b400cbc0 tx=0x7f65b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65b17fa640 1 -- 172.21.15.78:0/2198018547 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400ace0 con 0x7f65bc157370 2023-10-14T09:18:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65b17fa640 1 -- 172.21.15.78:0/2198018547 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b400ae40 con 0x7f65bc157370 2023-10-14T09:18:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65b17fa640 1 -- 172.21.15.78:0/2198018547 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4012600 con 0x7f65bc157370 2023-10-14T09:18:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c2f65640 1 -- 172.21.15.78:0/2198018547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac009420 con 0x7f65bc157370 2023-10-14T09:18:11.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c2f65640 1 -- 172.21.15.78:0/2198018547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc0c4e70 con 0x7f65bc157370 2023-10-14T09:18:11.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65c2f65640 1 -- 172.21.15.78:0/2198018547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc074180 con 0x7f65bc157370 2023-10-14T09:18:11.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65b17fa640 1 -- 172.21.15.78:0/2198018547 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f65b4007070 con 0x7f65bc157370 2023-10-14T09:18:11.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65b17fa640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65a80664a0 0x7f65a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:11.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.700+0000 7f65b17fa640 1 -- 172.21.15.78:0/2198018547 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f65b4083960 con 0x7f65bc157370 2023-10-14T09:18:11.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.704+0000 7f65c0d01640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65a80664a0 0x7f65a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:11.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.704+0000 7f65c0d01640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65a80664a0 0x7f65a8068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009cf0 tx=0x7f65b8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:11.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.704+0000 7f65b17fa640 1 -- 172.21.15.78:0/2198018547 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f65b40511d0 con 0x7f65bc157370 2023-10-14T09:18:11.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.908+0000 7f65c2f65640 1 -- 172.21.15.78:0/2198018547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f65bc15e030 con 0x7f65bc157370 2023-10-14T09:18:11.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65b17fa640 1 -- 172.21.15.78:0/2198018547 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f65b40170a0 con 0x7f65bc157370 2023-10-14T09:18:11.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 -- 172.21.15.78:0/2198018547 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65a80664a0 msgr2=0x7f65a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65a80664a0 0x7f65a8068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009cf0 tx=0x7f65b8009190 comp rx=0 tx=0).stop 2023-10-14T09:18:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 -- 172.21.15.78:0/2198018547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc157370 msgr2=0x7f65bc135ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc157370 0x7f65bc135ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f65b400cbc0 tx=0x7f65b400a430 comp rx=0 tx=0).stop 2023-10-14T09:18:11.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 -- 172.21.15.78:0/2198018547 shutdown_connections 2023-10-14T09:18:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65bc157370 0x7f65bc135ad0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f65bc0be570 0x7f65bc1ece60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f65a80664a0 0x7f65a8068960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 --2- 172.21.15.78:0/2198018547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f65bc071120 0x7f65bc1ed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:11.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 -- 172.21.15.78:0/2198018547 >> 172.21.15.78:0/2198018547 conn(0x7f65bc0c1cc0 msgr2=0x7f65bc06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:11.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 -- 172.21.15.78:0/2198018547 shutdown_connections 2023-10-14T09:18:11.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:11.912+0000 7f65c2f65640 1 -- 172.21.15.78:0/2198018547 wait complete. 2023-10-14T09:18:11.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-14T09:18:12.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.068+0000 7fdf1c39d640 1 Processor -- start 2023-10-14T09:18:12.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf1c39d640 1 -- start start 2023-10-14T09:18:12.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf1c39d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdf14151430 0x7fdf141547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf1c39d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf14151810 con 0x7fdf140c4180 2023-10-14T09:18:12.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf1c39d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1406f760 con 0x7fdf140c1eb0 2023-10-14T09:18:12.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf1c39d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf140c27d0 con 0x7fdf14151430 2023-10-14T09:18:12.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf1a139640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdf14151430 0x7fdf141547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf1a93a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdf140c4180 0x7fdf140c4590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42018/0 (socket says 172.21.15.78:42018) 2023-10-14T09:18:12.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf1a93a640 1 -- 172.21.15.78:0/399750866 learned_addr learned my addr 172.21.15.78:0/399750866 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:12.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf1a139640 1 -- 172.21.15.78:0/399750866 >> v1:172.21.15.157:6789/0 conn(0x7fdf140c1eb0 legacy=0x7fdf140c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:12.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf1a139640 1 -- 172.21.15.78:0/399750866 >> v1:172.21.15.78:6789/0 conn(0x7fdf140c4180 legacy=0x7fdf140c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf19137640 1 -- 172.21.15.78:0/399750866 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012912581 0 0) 0x7fdf14151810 con 0x7fdf140c4180 2023-10-14T09:18:12.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.072+0000 7fdf1a139640 1 -- 172.21.15.78:0/399750866 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf14154d20 con 0x7fdf14151430 2023-10-14T09:18:12.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf1a139640 1 --2- 172.21.15.78:0/399750866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf14151430 0x7fdf141547e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdf100097c0 tx=0x7fdf1001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12bb62814dbe27c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:12.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf19137640 1 -- 172.21.15.78:0/399750866 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100ab600 con 0x7fdf14151430 2023-10-14T09:18:12.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf19137640 1 -- 172.21.15.78:0/399750866 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf100a7050 con 0x7fdf14151430 2023-10-14T09:18:12.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf19137640 1 -- 172.21.15.78:0/399750866 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100ab980 con 0x7fdf14151430 2023-10-14T09:18:12.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf1c39d640 1 -- 172.21.15.78:0/399750866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf14151430 msgr2=0x7fdf141547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf1c39d640 1 --2- 172.21.15.78:0/399750866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf14151430 0x7fdf141547e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdf100097c0 tx=0x7fdf1001c330 comp rx=0 tx=0).stop 2023-10-14T09:18:12.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf1c39d640 1 -- 172.21.15.78:0/399750866 shutdown_connections 2023-10-14T09:18:12.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf1c39d640 1 --2- 172.21.15.78:0/399750866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf14151430 0x7fdf141547e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf1c39d640 1 -- 172.21.15.78:0/399750866 >> 172.21.15.78:0/399750866 conn(0x7fdf1406a060 msgr2=0x7fdf1406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:12.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf1c39d640 1 -- 172.21.15.78:0/399750866 shutdown_connections 2023-10-14T09:18:12.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf1c39d640 1 -- 172.21.15.78:0/399750866 wait complete. 2023-10-14T09:18:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf1c39d640 1 Processor -- start 2023-10-14T09:18:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.076+0000 7fdf1c39d640 1 -- start start 2023-10-14T09:18:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf1c39d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf140c1eb0 0x7fdf141ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf1c39d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf140c4180 0x7fdf140c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf1c39d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf14151430 0x7fdf140c12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf1c39d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140bebc0 con 0x7fdf140c4180 2023-10-14T09:18:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf1c39d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140c1820 con 0x7fdf140c1eb0 2023-10-14T09:18:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf1c39d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1414ee70 con 0x7fdf14151430 2023-10-14T09:18:12.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf19938640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf140c4180 0x7fdf140c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf19938640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf140c4180 0x7fdf140c0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43828/0 (socket says 172.21.15.78:43828) 2023-10-14T09:18:12.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf19938640 1 -- 172.21.15.78:0/217380438 learned_addr learned my addr 172.21.15.78:0/217380438 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:12.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf1a139640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf140c1eb0 0x7fdf141ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf1a93a640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf14151430 0x7fdf140c12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf19938640 1 -- 172.21.15.78:0/217380438 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf14151430 msgr2=0x7fdf140c12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf19938640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf14151430 0x7fdf140c12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf19938640 1 -- 172.21.15.78:0/217380438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf140c1eb0 msgr2=0x7fdf141ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf19938640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf140c1eb0 0x7fdf141ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf19938640 1 -- 172.21.15.78:0/217380438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10009420 con 0x7fdf140c4180 2023-10-14T09:18:12.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf19938640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf140c4180 0x7fdf140c0da0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400c3c0 tx=0x7fdf0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:12.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf0affd640 1 -- 172.21.15.78:0/217380438 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf040052d0 con 0x7fdf140c4180 2023-10-14T09:18:12.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf0affd640 1 -- 172.21.15.78:0/217380438 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf04005430 con 0x7fdf140c4180 2023-10-14T09:18:12.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf0affd640 1 -- 172.21.15.78:0/217380438 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04003840 con 0x7fdf140c4180 2023-10-14T09:18:12.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf1c39d640 1 -- 172.21.15.78:0/217380438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf141efc40 con 0x7fdf140c4180 2023-10-14T09:18:12.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf1c39d640 1 -- 172.21.15.78:0/217380438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf140bf0b0 con 0x7fdf140c4180 2023-10-14T09:18:12.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf1c39d640 1 -- 172.21.15.78:0/217380438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf14074180 con 0x7fdf140c4180 2023-10-14T09:18:12.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.080+0000 7fdf0affd640 1 -- 172.21.15.78:0/217380438 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdf040039a0 con 0x7fdf140c4180 2023-10-14T09:18:12.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.084+0000 7fdf0affd640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdef80664a0 0x7fdef8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.084+0000 7fdf0affd640 1 -- 172.21.15.78:0/217380438 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf04082fb0 con 0x7fdf140c4180 2023-10-14T09:18:12.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.084+0000 7fdf1a139640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdef80664a0 0x7fdef8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.084+0000 7fdf1a139640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdef80664a0 0x7fdef8068960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf100ad000 tx=0x7fdf100a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:12.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.088+0000 7fdf0affd640 1 -- 172.21.15.78:0/217380438 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdf04050820 con 0x7fdf140c4180 2023-10-14T09:18:12.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.288+0000 7fdf1c39d640 1 -- 172.21.15.78:0/217380438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fdf140c71e0 con 0x7fdf140c4180 2023-10-14T09:18:12.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.292+0000 7fdf0affd640 1 -- 172.21.15.78:0/217380438 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdf040170a0 con 0x7fdf140c4180 2023-10-14T09:18:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 -- 172.21.15.78:0/217380438 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdef80664a0 msgr2=0x7fdef8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdef80664a0 0x7fdef8068960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf100ad000 tx=0x7fdf100a6000 comp rx=0 tx=0).stop 2023-10-14T09:18:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 -- 172.21.15.78:0/217380438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf140c4180 msgr2=0x7fdf140c0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf140c4180 0x7fdf140c0da0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400c3c0 tx=0x7fdf0400c880 comp rx=0 tx=0).stop 2023-10-14T09:18:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 -- 172.21.15.78:0/217380438 shutdown_connections 2023-10-14T09:18:12.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdef80664a0 0x7fdef8068960 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdf14151430 0x7fdf140c12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf140c4180 0x7fdf140c0da0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 --2- 172.21.15.78:0/217380438 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdf140c1eb0 0x7fdf141ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 -- 172.21.15.78:0/217380438 >> 172.21.15.78:0/217380438 conn(0x7fdf1406a060 msgr2=0x7fdf140c76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:12.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 -- 172.21.15.78:0/217380438 shutdown_connections 2023-10-14T09:18:12.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.296+0000 7fdf1c39d640 1 -- 172.21.15.78:0/217380438 wait complete. 2023-10-14T09:18:12.317 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:18:12.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0de2965640 1 Processor -- start 2023-10-14T09:18:12.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0de2965640 1 -- start start 2023-10-14T09:18:12.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0de2965640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ddc153e80 0x7f0ddc0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0de2965640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc06c470 con 0x7f0ddc14ddb0 2023-10-14T09:18:12.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0de2965640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc06c750 con 0x7f0ddc0c6910 2023-10-14T09:18:12.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0de2965640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc0c64f0 con 0x7f0ddc153e80 2023-10-14T09:18:12.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddbfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0ddc14ddb0 0x7f0ddc06bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42028/0 (socket says 172.21.15.78:42028) 2023-10-14T09:18:12.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddbfff640 1 -- 172.21.15.78:0/1285850813 learned_addr learned my addr 172.21.15.78:0/1285850813 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:12.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddb7fe640 1 --2- 172.21.15.78:0/1285850813 >> v2:172.21.15.157:3300/0 conn(0x7f0ddc153e80 0x7f0ddc0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735249803 0 0) 0x7f0ddc06c470 con 0x7f0ddc14ddb0 2023-10-14T09:18:12.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc4003530 con 0x7f0ddc14ddb0 2023-10-14T09:18:12.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1960039039 0 0) 0x7f0dc4003530 con 0x7f0ddc14ddb0 2023-10-14T09:18:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 >> v2:172.21.15.157:3300/0 conn(0x7f0ddc153e80 msgr2=0x7f0ddc0c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 --2- 172.21.15.78:0/1285850813 >> v2:172.21.15.157:3300/0 conn(0x7f0ddc153e80 0x7f0ddc0c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 >> v1:172.21.15.157:6789/0 conn(0x7f0ddc0c6910 legacy=0x7f0ddc0c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc06ca30 con 0x7f0ddc14ddb0 2023-10-14T09:18:12.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f0dcc001680 con 0x7f0ddc14ddb0 2023-10-14T09:18:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 >> v1:172.21.15.78:6789/0 conn(0x7f0ddc14ddb0 legacy=0x7f0ddc06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc4003980 0x7f0dc4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc40047d0 0x7f0dc4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dc4005190 0x7f0dc400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0c64f0 con 0x7f0dc40047d0 2023-10-14T09:18:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc400c0e0 con 0x7f0dc4003980 2023-10-14T09:18:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.452+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc400c2a0 con 0x7f0dc4005190 2023-10-14T09:18:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddb7fe640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc40047d0 0x7f0dc4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddbfff640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc4003980 0x7f0dc4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0de0f02640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dc4005190 0x7f0dc400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddb7fe640 1 -- 172.21.15.78:0/1285850813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dc4005190 msgr2=0x7f0dc400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddb7fe640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dc4005190 0x7f0dc400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddb7fe640 1 -- 172.21.15.78:0/1285850813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc4003980 msgr2=0x7f0dc4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:12.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddb7fe640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc4003980 0x7f0dc4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddb7fe640 1 -- 172.21.15.78:0/1285850813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc4003530 con 0x7f0dc40047d0 2023-10-14T09:18:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddbfff640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0dc4003980 0x7f0dc4003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:12.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0de0f02640 1 -- 172.21.15.78:0/1285850813 reap_dead start 2023-10-14T09:18:12.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddb7fe640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc40047d0 0x7f0dc4004c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009ae0 tx=0x7f0dd001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f6076d14ec9c50 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:12.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd00a6430 con 0x7f0dc40047d0 2023-10-14T09:18:12.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd00a6590 con 0x7f0dc40047d0 2023-10-14T09:18:12.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0ddaffd640 1 -- 172.21.15.78:0/1285850813 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd00a6940 con 0x7f0dc40047d0 2023-10-14T09:18:12.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0de2965640 1 -- 172.21.15.78:0/1285850813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc40047d0 msgr2=0x7f0dc4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.456+0000 7f0de2965640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc40047d0 0x7f0dc4004c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009ae0 tx=0x7f0dd001ca50 comp rx=0 tx=0).stop 2023-10-14T09:18:12.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 -- 172.21.15.78:0/1285850813 shutdown_connections 2023-10-14T09:18:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 --2- 172.21.15.78:0/1285850813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc40047d0 0x7f0dc4004c50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 -- 172.21.15.78:0/1285850813 >> 172.21.15.78:0/1285850813 conn(0x7f0ddc0ab1f0 msgr2=0x7f0ddc0ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 -- 172.21.15.78:0/1285850813 shutdown_connections 2023-10-14T09:18:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 -- 172.21.15.78:0/1285850813 wait complete. 2023-10-14T09:18:12.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 Processor -- start 2023-10-14T09:18:12.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 -- start start 2023-10-14T09:18:12.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dc40047d0 0x7f0ddc14e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ddc157f60 0x7f0ddc14c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ddc1edc60 0x7f0ddc1ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc14e8e0 con 0x7f0ddc1edc60 2023-10-14T09:18:12.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc14a9f0 con 0x7f0ddc157f60 2023-10-14T09:18:12.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc14af20 con 0x7f0dc40047d0 2023-10-14T09:18:12.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de0f02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ddc1edc60 0x7f0ddc1ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de0f02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ddc1edc60 0x7f0ddc1ee0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43850/0 (socket says 172.21.15.78:43850) 2023-10-14T09:18:12.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de0f02640 1 -- 172.21.15.78:0/2782187899 learned_addr learned my addr 172.21.15.78:0/2782187899 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:12.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0ddb7fe640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ddc157f60 0x7f0ddc14c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0ddbfff640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dc40047d0 0x7f0ddc14e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de0f02640 1 -- 172.21.15.78:0/2782187899 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dc40047d0 msgr2=0x7f0ddc14e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de0f02640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dc40047d0 0x7f0ddc14e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de0f02640 1 -- 172.21.15.78:0/2782187899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ddc157f60 msgr2=0x7f0ddc14c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de0f02640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ddc157f60 0x7f0ddc14c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de0f02640 1 -- 172.21.15.78:0/2782187899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc14ac40 con 0x7f0ddc1edc60 2023-10-14T09:18:12.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0ddbfff640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dc40047d0 0x7f0ddc14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:12.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de0f02640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ddc1edc60 0x7f0ddc1ee0e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc154260 tx=0x7f0dd400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:12.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0dd8ff9640 1 -- 172.21.15.78:0/2782187899 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400eed0 con 0x7f0ddc1edc60 2023-10-14T09:18:12.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0dd8ff9640 1 -- 172.21.15.78:0/2782187899 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd4003980 con 0x7f0ddc1edc60 2023-10-14T09:18:12.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0de2965640 1 -- 172.21.15.78:0/2782187899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc156c90 con 0x7f0ddc1edc60 2023-10-14T09:18:12.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.460+0000 7f0dd8ff9640 1 -- 172.21.15.78:0/2782187899 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4003d50 con 0x7f0ddc1edc60 2023-10-14T09:18:12.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.464+0000 7f0de2965640 1 -- 172.21.15.78:0/2782187899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc157250 con 0x7f0ddc1edc60 2023-10-14T09:18:12.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.464+0000 7f0de2965640 1 -- 172.21.15.78:0/2782187899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc074180 con 0x7f0ddc1edc60 2023-10-14T09:18:12.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.464+0000 7f0dd8ff9640 1 -- 172.21.15.78:0/2782187899 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0dd40050d0 con 0x7f0ddc1edc60 2023-10-14T09:18:12.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.464+0000 7f0dd8ff9640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0dc80664a0 0x7f0dc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.464+0000 7f0dd8ff9640 1 -- 172.21.15.78:0/2782187899 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0dd40837b0 con 0x7f0ddc1edc60 2023-10-14T09:18:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.464+0000 7f0ddbfff640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0dc80664a0 0x7f0dc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.464+0000 7f0ddbfff640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0dc80664a0 0x7f0dc8068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc000fc0 tx=0x7f0dcc00a040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:12.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.468+0000 7f0dd8ff9640 1 -- 172.21.15.78:0/2782187899 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0dd4050f70 con 0x7f0ddc1edc60 2023-10-14T09:18:12.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 -- 172.21.15.78:0/2782187899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ddc0c7560 con 0x7f0ddc1edc60 2023-10-14T09:18:12.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0dd8ff9640 1 -- 172.21.15.78:0/2782187899 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12857 (secure 0 0 0) 0x7f0dd4054590 con 0x7f0ddc1edc60 2023-10-14T09:18:12.623 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:12.623 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":28,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:18:09.594072+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:18:12.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 -- 172.21.15.78:0/2782187899 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0dc80664a0 msgr2=0x7f0dc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0dc80664a0 0x7f0dc8068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc000fc0 tx=0x7f0dcc00a040 comp rx=0 tx=0).stop 2023-10-14T09:18:12.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 -- 172.21.15.78:0/2782187899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ddc1edc60 msgr2=0x7f0ddc1ee0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ddc1edc60 0x7f0ddc1ee0e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc154260 tx=0x7f0dd400eb90 comp rx=0 tx=0).stop 2023-10-14T09:18:12.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 -- 172.21.15.78:0/2782187899 shutdown_connections 2023-10-14T09:18:12.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ddc1edc60 0x7f0ddc1ee0e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ddc157f60 0x7f0ddc14c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f0dc80664a0 0x7f0dc8068960 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 --2- 172.21.15.78:0/2782187899 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0dc40047d0 0x7f0ddc14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 -- 172.21.15.78:0/2782187899 >> 172.21.15.78:0/2782187899 conn(0x7f0ddc0ab1f0 msgr2=0x7f0ddc0c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:12.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 -- 172.21.15.78:0/2782187899 shutdown_connections 2023-10-14T09:18:12.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.620+0000 7f0de2965640 1 -- 172.21.15.78:0/2782187899 wait complete. 2023-10-14T09:18:12.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:18:12.645 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:18:12.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c3446640 1 Processor -- start 2023-10-14T09:18:12.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c3446640 1 -- start start 2023-10-14T09:18:12.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c3446640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc139dc0 0x7ff0bc0718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c3446640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff0bc150f40 0x7ff0bc1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c3446640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc151fd0 con 0x7ff0bc150ac0 2023-10-14T09:18:12.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c3446640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0bc0702c0 con 0x7ff0bc150f40 2023-10-14T09:18:12.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c3446640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc152ea0 con 0x7ff0bc139dc0 2023-10-14T09:18:12.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c11e2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc139dc0 0x7ff0bc0718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c19e3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff0bc150f40 0x7ff0bc1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c11e2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc139dc0 0x7ff0bc0718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:47410/0 (socket says 172.21.15.78:47410) 2023-10-14T09:18:12.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c11e2640 1 -- 172.21.15.78:0/810989970 learned_addr learned my addr 172.21.15.78:0/810989970 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c19e3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff0bc150f40 0x7ff0bc1539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:49828/0 (socket says 172.21.15.78:49828) 2023-10-14T09:18:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c11e2640 1 -- 172.21.15.78:0/810989970 >> v2:172.21.15.157:3300/0 conn(0x7ff0bc150f40 msgr2=0x7ff0bc1539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c11e2640 1 --2- 172.21.15.78:0/810989970 >> v2:172.21.15.157:3300/0 conn(0x7ff0bc150f40 0x7ff0bc1539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c11e2640 1 -- 172.21.15.78:0/810989970 >> v1:172.21.15.157:6789/0 conn(0x7ff0bc150ac0 legacy=0x7ff0bc1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c11e2640 1 -- 172.21.15.78:0/810989970 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc1513d0 con 0x7ff0bc139dc0 2023-10-14T09:18:12.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0b3fff640 1 -- 172.21.15.78:0/810989970 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071575126 0 0) 0x7ff0bc151fd0 con 0x7ff0bc150ac0 2023-10-14T09:18:12.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.784+0000 7ff0c19e3640 1 --2- 172.21.15.78:0/810989970 >> v2:172.21.15.157:3300/0 conn(0x7ff0bc150f40 0x7ff0bc1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:18:12.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0c11e2640 1 --2- 172.21.15.78:0/810989970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc139dc0 0x7ff0bc0718a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800bb10 tx=0x7ff0b801eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae056d86149ffa6d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:12.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0b3fff640 1 -- 172.21.15.78:0/810989970 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b80a7a40 con 0x7ff0bc139dc0 2023-10-14T09:18:12.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0b3fff640 1 -- 172.21.15.78:0/810989970 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b80a7ba0 con 0x7ff0bc139dc0 2023-10-14T09:18:12.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0b3fff640 1 -- 172.21.15.78:0/810989970 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b80af440 con 0x7ff0bc139dc0 2023-10-14T09:18:12.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0c3446640 1 -- 172.21.15.78:0/810989970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc139dc0 msgr2=0x7ff0bc0718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0c3446640 1 --2- 172.21.15.78:0/810989970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc139dc0 0x7ff0bc0718a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800bb10 tx=0x7ff0b801eb80 comp rx=0 tx=0).stop 2023-10-14T09:18:12.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0c3446640 1 -- 172.21.15.78:0/810989970 shutdown_connections 2023-10-14T09:18:12.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0c3446640 1 --2- 172.21.15.78:0/810989970 >> v2:172.21.15.157:3300/0 conn(0x7ff0bc150f40 0x7ff0bc1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0c3446640 1 --2- 172.21.15.78:0/810989970 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc139dc0 0x7ff0bc0718a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0c3446640 1 -- 172.21.15.78:0/810989970 >> 172.21.15.78:0/810989970 conn(0x7ff0bc0c1d00 msgr2=0x7ff0bc0c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:12.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0c3446640 1 -- 172.21.15.78:0/810989970 shutdown_connections 2023-10-14T09:18:12.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.788+0000 7ff0c3446640 1 -- 172.21.15.78:0/810989970 wait complete. 2023-10-14T09:18:12.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c3446640 1 Processor -- start 2023-10-14T09:18:12.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c3446640 1 -- start start 2023-10-14T09:18:12.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c3446640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0bc139dc0 0x7ff0bc0bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c3446640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0bc150ac0 0x7ff0bc136c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c3446640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc150f40 0x7ff0bc0c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c3446640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc1e8330 con 0x7ff0bc150ac0 2023-10-14T09:18:12.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c3446640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc0c32d0 con 0x7ff0bc139dc0 2023-10-14T09:18:12.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c3446640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc1e87f0 con 0x7ff0bc150f40 2023-10-14T09:18:12.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c09e1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0bc150ac0 0x7ff0bc136c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c09e1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0bc150ac0 0x7ff0bc136c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43858/0 (socket says 172.21.15.78:43858) 2023-10-14T09:18:12.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c09e1640 1 -- 172.21.15.78:0/603158592 learned_addr learned my addr 172.21.15.78:0/603158592 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:12.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c19e3640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc150f40 0x7ff0bc0c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c11e2640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0bc139dc0 0x7ff0bc0bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c09e1640 1 -- 172.21.15.78:0/603158592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc150f40 msgr2=0x7ff0bc0c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c09e1640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc150f40 0x7ff0bc0c36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c09e1640 1 -- 172.21.15.78:0/603158592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0bc139dc0 msgr2=0x7ff0bc0bb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c09e1640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0bc139dc0 0x7ff0bc0bb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c09e1640 1 -- 172.21.15.78:0/603158592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b4009a70 con 0x7ff0bc150ac0 2023-10-14T09:18:12.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c09e1640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0bc150ac0 0x7ff0bc136c60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac001ec0 tx=0x7ff0ac00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:12.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0b1ffb640 1 -- 172.21.15.78:0/603158592 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0054e0 con 0x7ff0bc150ac0 2023-10-14T09:18:12.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c3446640 1 -- 172.21.15.78:0/603158592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b800b770 con 0x7ff0bc150ac0 2023-10-14T09:18:12.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0b1ffb640 1 -- 172.21.15.78:0/603158592 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac003600 con 0x7ff0bc150ac0 2023-10-14T09:18:12.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0b1ffb640 1 -- 172.21.15.78:0/603158592 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0039b0 con 0x7ff0bc150ac0 2023-10-14T09:18:12.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.792+0000 7ff0c3446640 1 -- 172.21.15.78:0/603158592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc0c2ef0 con 0x7ff0bc150ac0 2023-10-14T09:18:12.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.796+0000 7ff0c3446640 1 -- 172.21.15.78:0/603158592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc074110 con 0x7ff0bc150ac0 2023-10-14T09:18:12.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.796+0000 7ff0b1ffb640 1 -- 172.21.15.78:0/603158592 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff0ac003b10 con 0x7ff0bc150ac0 2023-10-14T09:18:12.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.796+0000 7ff0b1ffb640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff0a00664d0 0x7ff0a0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:12.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.796+0000 7ff0b1ffb640 1 -- 172.21.15.78:0/603158592 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff0ac082ff0 con 0x7ff0bc150ac0 2023-10-14T09:18:12.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.796+0000 7ff0c11e2640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff0a00664d0 0x7ff0a0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:12.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.796+0000 7ff0c11e2640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff0a00664d0 0x7ff0a0068990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80b1000 tx=0x7ff0b80a9070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:12.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.800+0000 7ff0b1ffb640 1 -- 172.21.15.78:0/603158592 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0ac050840 con 0x7ff0bc150ac0 2023-10-14T09:18:12.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.948+0000 7ff0c3446640 1 -- 172.21.15.78:0/603158592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0bc0c30b0 con 0x7ff0bc150ac0 2023-10-14T09:18:12.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.948+0000 7ff0b1ffb640 1 -- 172.21.15.78:0/603158592 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0ac001130 con 0x7ff0bc150ac0 2023-10-14T09:18:12.952 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:18:12.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 -- 172.21.15.78:0/603158592 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff0a00664d0 msgr2=0x7ff0a0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff0a00664d0 0x7ff0a0068990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80b1000 tx=0x7ff0b80a9070 comp rx=0 tx=0).stop 2023-10-14T09:18:12.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 -- 172.21.15.78:0/603158592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0bc150ac0 msgr2=0x7ff0bc136c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:12.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0bc150ac0 0x7ff0bc136c60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac001ec0 tx=0x7ff0ac00c820 comp rx=0 tx=0).stop 2023-10-14T09:18:12.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 -- 172.21.15.78:0/603158592 shutdown_connections 2023-10-14T09:18:12.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff0a00664d0 0x7ff0a0068990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff0bc150f40 0x7ff0bc0c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0bc150ac0 0x7ff0bc136c60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 --2- 172.21.15.78:0/603158592 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0bc139dc0 0x7ff0bc0bb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:12.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 -- 172.21.15.78:0/603158592 >> 172.21.15.78:0/603158592 conn(0x7ff0bc0c1d00 msgr2=0x7ff0bc14f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:12.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 -- 172.21.15.78:0/603158592 shutdown_connections 2023-10-14T09:18:12.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:12.952+0000 7ff0c3446640 1 -- 172.21.15.78:0/603158592 wait complete. 2023-10-14T09:18:12.973 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T09:18:13.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.108+0000 7f1f1abb8640 1 Processor -- start 2023-10-14T09:18:13.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.108+0000 7f1f1abb8640 1 -- start start 2023-10-14T09:18:13.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f1abb8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1f141513c0 0x7f1f140c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f1abb8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f140c1e20 0x7f1f140c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f1abb8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f140c7d10 0x7f1f141541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f1abb8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1406f7b0 con 0x7f1f140c1e20 2023-10-14T09:18:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f1abb8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f14153d50 con 0x7f1f141513c0 2023-10-14T09:18:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f1abb8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f14158100 con 0x7f1f140c7d10 2023-10-14T09:18:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f0bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f140c1e20 0x7f1f140c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f0bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1f140c1e20 0x7f1f140c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43868/0 (socket says 172.21.15.78:43868) 2023-10-14T09:18:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f0bfff640 1 -- 172.21.15.78:0/56995505 learned_addr learned my addr 172.21.15.78:0/56995505 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:13.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f19155640 1 --2- 172.21.15.78:0/56995505 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f140c7d10 0x7f1f141541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f18954640 1 --2- 172.21.15.78:0/56995505 >> v2:172.21.15.157:3300/0 conn(0x7f1f141513c0 0x7f1f140c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f0bfff640 1 -- 172.21.15.78:0/56995505 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f140c7d10 msgr2=0x7f1f141541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:13.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f0bfff640 1 --2- 172.21.15.78:0/56995505 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f140c7d10 0x7f1f141541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f0bfff640 1 -- 172.21.15.78:0/56995505 >> v2:172.21.15.157:3300/0 conn(0x7f1f141513c0 msgr2=0x7f1f140c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:13.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f0bfff640 1 --2- 172.21.15.78:0/56995505 >> v2:172.21.15.157:3300/0 conn(0x7f1f141513c0 0x7f1f140c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f0bfff640 1 -- 172.21.15.78:0/56995505 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1406f9c0 con 0x7f1f140c1e20 2023-10-14T09:18:13.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f19155640 1 --2- 172.21.15.78:0/56995505 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f140c7d10 0x7f1f141541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:13.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f18954640 1 --2- 172.21.15.78:0/56995505 >> v2:172.21.15.157:3300/0 conn(0x7f1f141513c0 0x7f1f140c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:13.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f0bfff640 1 --2- 172.21.15.78:0/56995505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140c1e20 0x7f1f140c77d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1f140c8230 tx=0x7f1f0401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fed421a836b0a56 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:13.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.112+0000 7f1f0b7fe640 1 -- 172.21.15.78:0/56995505 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040ad640 con 0x7f1f140c1e20 2023-10-14T09:18:13.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f0b7fe640 1 -- 172.21.15.78:0/56995505 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f040ad7a0 con 0x7f1f140c1e20 2023-10-14T09:18:13.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f0b7fe640 1 -- 172.21.15.78:0/56995505 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040adb30 con 0x7f1f140c1e20 2023-10-14T09:18:13.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 -- 172.21.15.78:0/56995505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140c1e20 msgr2=0x7f1f140c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:13.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 --2- 172.21.15.78:0/56995505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140c1e20 0x7f1f140c77d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1f140c8230 tx=0x7f1f0401c4c0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 -- 172.21.15.78:0/56995505 shutdown_connections 2023-10-14T09:18:13.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 --2- 172.21.15.78:0/56995505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f140c1e20 0x7f1f140c77d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 --2- 172.21.15.78:0/56995505 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f140c7d10 0x7f1f141541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 --2- 172.21.15.78:0/56995505 >> v2:172.21.15.157:3300/0 conn(0x7f1f141513c0 0x7f1f140c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 -- 172.21.15.78:0/56995505 >> 172.21.15.78:0/56995505 conn(0x7f1f1406a060 msgr2=0x7f1f1406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:13.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 -- 172.21.15.78:0/56995505 shutdown_connections 2023-10-14T09:18:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 -- 172.21.15.78:0/56995505 wait complete. 2023-10-14T09:18:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 Processor -- start 2023-10-14T09:18:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 -- start start 2023-10-14T09:18:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f140c1e20 0x7f1f14155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f140c7d10 0x7f1f14149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f141513c0 0x7f1f14156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f141557d0 con 0x7f1f141513c0 2023-10-14T09:18:13.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1414f790 con 0x7f1f140c7d10 2023-10-14T09:18:13.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f1abb8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1414fa70 con 0x7f1f140c1e20 2023-10-14T09:18:13.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f19155640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f141513c0 0x7f1f14156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f19155640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f141513c0 0x7f1f14156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43876/0 (socket says 172.21.15.78:43876) 2023-10-14T09:18:13.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f19155640 1 -- 172.21.15.78:0/2927321737 learned_addr learned my addr 172.21.15.78:0/2927321737 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:13.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f18954640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f140c1e20 0x7f1f14155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.116+0000 7f1f0bfff640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f140c7d10 0x7f1f14149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f19155640 1 -- 172.21.15.78:0/2927321737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f140c1e20 msgr2=0x7f1f14155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:13.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f19155640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f140c1e20 0x7f1f14155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f19155640 1 -- 172.21.15.78:0/2927321737 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f140c7d10 msgr2=0x7f1f14149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:13.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f19155640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f140c7d10 0x7f1f14149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f19155640 1 -- 172.21.15.78:0/2927321737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f040094d0 con 0x7f1f141513c0 2023-10-14T09:18:13.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f19155640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f141513c0 0x7f1f14156c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00cef0 tx=0x7f1f0c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:13.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f097fa640 1 -- 172.21.15.78:0/2927321737 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c00d840 con 0x7f1f141513c0 2023-10-14T09:18:13.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f097fa640 1 -- 172.21.15.78:0/2927321737 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c00d9c0 con 0x7f1f141513c0 2023-10-14T09:18:13.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f097fa640 1 -- 172.21.15.78:0/2927321737 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c00dd70 con 0x7f1f141513c0 2023-10-14T09:18:13.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f1abb8640 1 -- 172.21.15.78:0/2927321737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1414fd50 con 0x7f1f141513c0 2023-10-14T09:18:13.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f1abb8640 1 -- 172.21.15.78:0/2927321737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f140a6ba0 con 0x7f1f141513c0 2023-10-14T09:18:13.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f1abb8640 1 -- 172.21.15.78:0/2927321737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f14074180 con 0x7f1f141513c0 2023-10-14T09:18:13.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f097fa640 1 -- 172.21.15.78:0/2927321737 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1f0c01e3b0 con 0x7f1f141513c0 2023-10-14T09:18:13.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f097fa640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f1f000664a0 0x7f1f00068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f097fa640 1 -- 172.21.15.78:0/2927321737 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1f0c0844c0 con 0x7f1f141513c0 2023-10-14T09:18:13.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.120+0000 7f1f18954640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f1f000664a0 0x7f1f00068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.124+0000 7f1f18954640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f1f000664a0 0x7f1f00068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1f10006fd0 tx=0x7f1f10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:13.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.124+0000 7f1f097fa640 1 -- 172.21.15.78:0/2927321737 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1f0c051e70 con 0x7f1f141513c0 2023-10-14T09:18:13.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 -- 172.21.15.78:0/2927321737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1f14150200 con 0x7f1f141513c0 2023-10-14T09:18:13.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f097fa640 1 -- 172.21.15.78:0/2927321737 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1f0c01a090 con 0x7f1f141513c0 2023-10-14T09:18:13.283 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:13.283 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-10-14T09:18:13.283 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-10-14T09:18:13.283 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-10-14T09:18:13.284 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-10-14T09:18:13.284 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-10-14T09:18:13.284 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-10-14T09:18:13.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 -- 172.21.15.78:0/2927321737 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f1f000664a0 msgr2=0x7f1f00068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:13.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f1f000664a0 0x7f1f00068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1f10006fd0 tx=0x7f1f10008040 comp rx=0 tx=0).stop 2023-10-14T09:18:13.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 -- 172.21.15.78:0/2927321737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f141513c0 msgr2=0x7f1f14156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:13.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f141513c0 0x7f1f14156c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00cef0 tx=0x7f1f0c00a710 comp rx=0 tx=0).stop 2023-10-14T09:18:13.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 -- 172.21.15.78:0/2927321737 shutdown_connections 2023-10-14T09:18:13.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f141513c0 0x7f1f14156c30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f140c7d10 0x7f1f14149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f1f000664a0 0x7f1f00068960 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 --2- 172.21.15.78:0/2927321737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1f140c1e20 0x7f1f14155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 -- 172.21.15.78:0/2927321737 >> 172.21.15.78:0/2927321737 conn(0x7f1f1406a060 msgr2=0x7f1f140c5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 -- 172.21.15.78:0/2927321737 shutdown_connections 2023-10-14T09:18:13.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.280+0000 7f1f1abb8640 1 -- 172.21.15.78:0/2927321737 wait complete. 2023-10-14T09:18:13.303 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-14T09:18:13.304 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-14T09:18:13.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f1220c17640 1 Processor -- start 2023-10-14T09:18:13.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f1220c17640 1 -- start start 2023-10-14T09:18:13.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f1220c17640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f121c14e0f0 0x7f121c152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f1220c17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f121c14ed10 0x7f121c14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f1220c17640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121c1531d0 con 0x7f121c14f700 2023-10-14T09:18:13.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f1220c17640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121c153e50 con 0x7f121c14e0f0 2023-10-14T09:18:13.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f1220c17640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c1534b0 con 0x7f121c14ed10 2023-10-14T09:18:13.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f1219d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f121c14ed10 0x7f121c14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f121a59c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f121c14e0f0 0x7f121c152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f121a59c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f121c14e0f0 0x7f121c152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:49862/0 (socket says 172.21.15.78:49862) 2023-10-14T09:18:13.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f121a59c640 1 -- 172.21.15.78:0/3924780250 learned_addr learned my addr 172.21.15.78:0/3924780250 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:13.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f121a59c640 1 -- 172.21.15.78:0/3924780250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f121c14ed10 msgr2=0x7f121c14f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:13.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f121a59c640 1 --2- 172.21.15.78:0/3924780250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f121c14ed10 0x7f121c14f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f121a59c640 1 -- 172.21.15.78:0/3924780250 >> v1:172.21.15.157:6789/0 conn(0x7f121c14f700 legacy=0x7f121c150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:13.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.444+0000 7f121a59c640 1 -- 172.21.15.78:0/3924780250 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c153790 con 0x7f121c14e0f0 2023-10-14T09:18:13.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f121a59c640 1 --2- 172.21.15.78:0/3924780250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f121c14e0f0 0x7f121c152960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f120c009870 tx=0x7f120c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a9a3a923c8e5333 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:13.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f121959a640 1 -- 172.21.15.78:0/3924780250 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c0ad680 con 0x7f121c14e0f0 2023-10-14T09:18:13.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f121959a640 1 -- 172.21.15.78:0/3924780250 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c0ad7e0 con 0x7f121c14e0f0 2023-10-14T09:18:13.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f121959a640 1 -- 172.21.15.78:0/3924780250 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c0adb70 con 0x7f121c14e0f0 2023-10-14T09:18:13.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f1220c17640 1 -- 172.21.15.78:0/3924780250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f121c14e0f0 msgr2=0x7f121c152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:13.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f1220c17640 1 --2- 172.21.15.78:0/3924780250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f121c14e0f0 0x7f121c152960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f120c009870 tx=0x7f120c01c4b0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f1220c17640 1 -- 172.21.15.78:0/3924780250 shutdown_connections 2023-10-14T09:18:13.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f1220c17640 1 --2- 172.21.15.78:0/3924780250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f121c14ed10 0x7f121c14f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f1220c17640 1 --2- 172.21.15.78:0/3924780250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f121c14e0f0 0x7f121c152960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f1220c17640 1 -- 172.21.15.78:0/3924780250 >> 172.21.15.78:0/3924780250 conn(0x7f121c0c1cc0 msgr2=0x7f121c0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f1220c17640 1 -- 172.21.15.78:0/3924780250 shutdown_connections 2023-10-14T09:18:13.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.448+0000 7f1220c17640 1 -- 172.21.15.78:0/3924780250 wait complete. 2023-10-14T09:18:13.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f1220c17640 1 Processor -- start 2023-10-14T09:18:13.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f1220c17640 1 -- start start 2023-10-14T09:18:13.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f1220c17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f121c14e0f0 0x7f121c142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f1220c17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f121c14ed10 0x7f121c144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f1220c17640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f121c14f700 0x7f121c144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f1220c17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c143590 con 0x7f121c14e0f0 2023-10-14T09:18:13.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f1220c17640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0c4060 con 0x7f121c14f700 2023-10-14T09:18:13.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f1220c17640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0c4e10 con 0x7f121c14ed10 2023-10-14T09:18:13.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f121a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f121c14e0f0 0x7f121c142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f121a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f121c14e0f0 0x7f121c142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43886/0 (socket says 172.21.15.78:43886) 2023-10-14T09:18:13.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f121a59c640 1 -- 172.21.15.78:0/121796273 learned_addr learned my addr 172.21.15.78:0/121796273 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:13.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f1219d9b640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f121c14ed10 0x7f121c144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f121ad9d640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f121c14f700 0x7f121c144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f121a59c640 1 -- 172.21.15.78:0/121796273 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f121c14ed10 msgr2=0x7f121c144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:13.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f121a59c640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f121c14ed10 0x7f121c144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f121a59c640 1 -- 172.21.15.78:0/121796273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f121c14f700 msgr2=0x7f121c144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:13.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f121a59c640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f121c14f700 0x7f121c144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:13.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f121a59c640 1 -- 172.21.15.78:0/121796273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c0094d0 con 0x7f121c14e0f0 2023-10-14T09:18:13.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f121a59c640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f121c14e0f0 0x7f121c142c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f120c01a0e0 tx=0x7f120c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:13.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f120affd640 1 -- 172.21.15.78:0/121796273 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c0adde0 con 0x7f121c14e0f0 2023-10-14T09:18:13.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f120affd640 1 -- 172.21.15.78:0/121796273 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c0b8420 con 0x7f121c14e0f0 2023-10-14T09:18:13.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f120affd640 1 -- 172.21.15.78:0/121796273 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c0b87d0 con 0x7f121c14e0f0 2023-10-14T09:18:13.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f1220c17640 1 -- 172.21.15.78:0/121796273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121c1420a0 con 0x7f121c14e0f0 2023-10-14T09:18:13.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.452+0000 7f1220c17640 1 -- 172.21.15.78:0/121796273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121c0c3d80 con 0x7f121c14e0f0 2023-10-14T09:18:13.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.456+0000 7f1220c17640 1 -- 172.21.15.78:0/121796273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121c074110 con 0x7f121c14e0f0 2023-10-14T09:18:13.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.456+0000 7f120affd640 1 -- 172.21.15.78:0/121796273 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f120c0b4040 con 0x7f121c14e0f0 2023-10-14T09:18:13.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.456+0000 7f120affd640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11fc0664a0 0x7f11fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:13.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.456+0000 7f120affd640 1 -- 172.21.15.78:0/121796273 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f120c11ded0 con 0x7f121c14e0f0 2023-10-14T09:18:13.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.456+0000 7f1219d9b640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11fc0664a0 0x7f11fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:13.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.456+0000 7f1219d9b640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11fc0664a0 0x7f11fc068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f121c0a97f0 tx=0x7f1210009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:13.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.460+0000 7f120affd640 1 -- 172.21.15.78:0/121796273 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f120c0eb740 con 0x7f121c14e0f0 2023-10-14T09:18:13.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:13.616+0000 7f1220c17640 1 -- 172.21.15.78:0/121796273 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f121c0c1930 con 0x7f121c14e0f0 2023-10-14T09:18:14.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.612+0000 7f120affd640 1 -- 172.21.15.78:0/121796273 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v29) v1 ==== 148+0+0 (secure 0 0 0) 0x7f120c0eed60 con 0x7f121c14e0f0 2023-10-14T09:18:14.616 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'testcephfs1_metadata' created 2023-10-14T09:18:14.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 -- 172.21.15.78:0/121796273 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11fc0664a0 msgr2=0x7f11fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:14.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11fc0664a0 0x7f11fc068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f121c0a97f0 tx=0x7f1210009190 comp rx=0 tx=0).stop 2023-10-14T09:18:14.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 -- 172.21.15.78:0/121796273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f121c14e0f0 msgr2=0x7f121c142c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:14.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f121c14e0f0 0x7f121c142c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f120c01a0e0 tx=0x7f120c019250 comp rx=0 tx=0).stop 2023-10-14T09:18:14.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 -- 172.21.15.78:0/121796273 shutdown_connections 2023-10-14T09:18:14.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f121c14f700 0x7f121c144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11fc0664a0 0x7f11fc068960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f121c14ed10 0x7f121c144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 --2- 172.21.15.78:0/121796273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f121c14e0f0 0x7f121c142c80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 -- 172.21.15.78:0/121796273 >> 172.21.15.78:0/121796273 conn(0x7f121c0c1cc0 msgr2=0x7f121c15ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 -- 172.21.15.78:0/121796273 shutdown_connections 2023-10-14T09:18:14.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.616+0000 7f1220c17640 1 -- 172.21.15.78:0/121796273 wait complete. 2023-10-14T09:18:14.645 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T09:18:14.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.788+0000 7eff228d6640 1 Processor -- start 2023-10-14T09:18:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.788+0000 7eff228d6640 1 -- start start 2023-10-14T09:18:14.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff228d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff1c139dc0 0x7eff1c071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:14.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff228d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150f40 0x7eff1c1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:14.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff228d6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c151fd0 con 0x7eff1c150ac0 2023-10-14T09:18:14.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff228d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0702c0 con 0x7eff1c139dc0 2023-10-14T09:18:14.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff228d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c153f10 con 0x7eff1c150f40 2023-10-14T09:18:14.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff1bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff1c139dc0 0x7eff1c071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:14.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff1b7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7eff1c150ac0 0x7eff1c1532c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:42030/0 (socket says 172.21.15.78:42030) 2023-10-14T09:18:14.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff1b7fe640 1 -- 172.21.15.78:0/811181813 learned_addr learned my addr 172.21.15.78:0/811181813 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:14.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff20e73640 1 --2- 172.21.15.78:0/811181813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150f40 0x7eff1c1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:14.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff1bfff640 1 -- 172.21.15.78:0/811181813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150f40 msgr2=0x7eff1c1539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:14.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff1bfff640 1 --2- 172.21.15.78:0/811181813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150f40 0x7eff1c1539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:14.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff1bfff640 1 -- 172.21.15.78:0/811181813 >> v1:172.21.15.78:6789/0 conn(0x7eff1c150ac0 legacy=0x7eff1c1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:14.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff1bfff640 1 -- 172.21.15.78:0/811181813 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c1513d0 con 0x7eff1c139dc0 2023-10-14T09:18:14.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff20e73640 1 --2- 172.21.15.78:0/811181813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150f40 0x7eff1c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:14.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.792+0000 7eff1affd640 1 -- 172.21.15.78:0/811181813 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148015106 0 0) 0x7eff1c151fd0 con 0x7eff1c150ac0 2023-10-14T09:18:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff1bfff640 1 --2- 172.21.15.78:0/811181813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c139dc0 0x7eff1c071880 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0097c0 tx=0x7eff0c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf7f4d657f9eb37 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff1affd640 1 -- 172.21.15.78:0/811181813 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0ac620 con 0x7eff1c139dc0 2023-10-14T09:18:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff1affd640 1 -- 172.21.15.78:0/811181813 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c0ac780 con 0x7eff1c139dc0 2023-10-14T09:18:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff1affd640 1 -- 172.21.15.78:0/811181813 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0acb10 con 0x7eff1c139dc0 2023-10-14T09:18:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff228d6640 1 -- 172.21.15.78:0/811181813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c139dc0 msgr2=0x7eff1c071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff228d6640 1 --2- 172.21.15.78:0/811181813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c139dc0 0x7eff1c071880 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0097c0 tx=0x7eff0c01c3c0 comp rx=0 tx=0).stop 2023-10-14T09:18:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff228d6640 1 -- 172.21.15.78:0/811181813 shutdown_connections 2023-10-14T09:18:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff228d6640 1 --2- 172.21.15.78:0/811181813 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150f40 0x7eff1c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff228d6640 1 --2- 172.21.15.78:0/811181813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c139dc0 0x7eff1c071880 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff228d6640 1 -- 172.21.15.78:0/811181813 >> 172.21.15.78:0/811181813 conn(0x7eff1c0c1d00 msgr2=0x7eff1c0c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff228d6640 1 -- 172.21.15.78:0/811181813 shutdown_connections 2023-10-14T09:18:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff228d6640 1 -- 172.21.15.78:0/811181813 wait complete. 2023-10-14T09:18:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff228d6640 1 Processor -- start 2023-10-14T09:18:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.796+0000 7eff228d6640 1 -- start start 2023-10-14T09:18:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff228d6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff1c139dc0 0x7eff1c137da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff228d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150ac0 0x7eff1c0baef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff228d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c150f40 0x7eff1c133470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff228d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c136f30 con 0x7eff1c150f40 2023-10-14T09:18:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff228d6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1366d0 con 0x7eff1c139dc0 2023-10-14T09:18:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff228d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c132f90 con 0x7eff1c150ac0 2023-10-14T09:18:14.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff1b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150ac0 0x7eff1c0baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:14.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff20e73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c150f40 0x7eff1c133470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:14.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff1b7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150ac0 0x7eff1c0baef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:47468/0 (socket says 172.21.15.78:47468) 2023-10-14T09:18:14.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff1b7fe640 1 -- 172.21.15.78:0/1416062638 learned_addr learned my addr 172.21.15.78:0/1416062638 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:14.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff20e73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c150f40 0x7eff1c133470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43906/0 (socket says 172.21.15.78:43906) 2023-10-14T09:18:14.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff1bfff640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff1c139dc0 0x7eff1c137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:14.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff20e73640 1 -- 172.21.15.78:0/1416062638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150ac0 msgr2=0x7eff1c0baef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:14.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff20e73640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150ac0 0x7eff1c0baef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:14.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff20e73640 1 -- 172.21.15.78:0/1416062638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff1c139dc0 msgr2=0x7eff1c137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:14.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff20e73640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff1c139dc0 0x7eff1c137da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:14.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff20e73640 1 -- 172.21.15.78:0/1416062638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c009420 con 0x7eff1c150f40 2023-10-14T09:18:14.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff20e73640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c150f40 0x7eff1c133470 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7eff1400cc90 tx=0x7eff1400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff18ff9640 1 -- 172.21.15.78:0/1416062638 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400cea0 con 0x7eff1c150f40 2023-10-14T09:18:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff18ff9640 1 -- 172.21.15.78:0/1416062638 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1400f6a0 con 0x7eff1c150f40 2023-10-14T09:18:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff228d6640 1 -- 172.21.15.78:0/1416062638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c1382e0 con 0x7eff1c150f40 2023-10-14T09:18:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff18ff9640 1 -- 172.21.15.78:0/1416062638 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400fa50 con 0x7eff1c150f40 2023-10-14T09:18:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff228d6640 1 -- 172.21.15.78:0/1416062638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c136c50 con 0x7eff1c150f40 2023-10-14T09:18:14.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.800+0000 7eff228d6640 1 -- 172.21.15.78:0/1416062638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c133150 con 0x7eff1c150f40 2023-10-14T09:18:14.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.804+0000 7eff18ff9640 1 -- 172.21.15.78:0/1416062638 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7eff1400b040 con 0x7eff1c150f40 2023-10-14T09:18:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.804+0000 7eff18ff9640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7eff080664a0 0x7eff08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.804+0000 7eff18ff9640 1 -- 172.21.15.78:0/1416062638 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5232+0+0 (secure 0 0 0) 0x7eff140845b0 con 0x7eff1c150f40 2023-10-14T09:18:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.804+0000 7eff1bfff640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7eff080664a0 0x7eff08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:14.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.804+0000 7eff1bfff640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7eff080664a0 0x7eff08068960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0ae000 tx=0x7eff0c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:14.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.808+0000 7eff18ff9640 1 -- 172.21.15.78:0/1416062638 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7eff14051d50 con 0x7eff1c150f40 2023-10-14T09:18:14.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:14.956+0000 7eff228d6640 1 -- 172.21.15.78:0/1416062638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7eff1c152a90 con 0x7eff1c150f40 2023-10-14T09:18:15.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.615+0000 7eff18ff9640 1 -- 172.21.15.78:0/1416062638 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v30) v1 ==== 180+0+0 (secure 0 0 0) 0x7eff14055370 con 0x7eff1c150f40 2023-10-14T09:18:15.619 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'testcephfs1_data' created 2023-10-14T09:18:15.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.619+0000 7eff228d6640 1 -- 172.21.15.78:0/1416062638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7eff080664a0 msgr2=0x7eff08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:15.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.619+0000 7eff228d6640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7eff080664a0 0x7eff08068960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0ae000 tx=0x7eff0c008040 comp rx=0 tx=0).stop 2023-10-14T09:18:15.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.619+0000 7eff228d6640 1 -- 172.21.15.78:0/1416062638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c150f40 msgr2=0x7eff1c133470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:15.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.619+0000 7eff228d6640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c150f40 0x7eff1c133470 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7eff1400cc90 tx=0x7eff1400a650 comp rx=0 tx=0).stop 2023-10-14T09:18:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.619+0000 7eff228d6640 1 -- 172.21.15.78:0/1416062638 shutdown_connections 2023-10-14T09:18:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.619+0000 7eff228d6640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c150f40 0x7eff1c133470 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.619+0000 7eff228d6640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7eff080664a0 0x7eff08068960 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:15.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.619+0000 7eff228d6640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff1c150ac0 0x7eff1c0baef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.619+0000 7eff228d6640 1 --2- 172.21.15.78:0/1416062638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff1c139dc0 0x7eff1c137da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:15.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.619+0000 7eff228d6640 1 -- 172.21.15.78:0/1416062638 >> 172.21.15.78:0/1416062638 conn(0x7eff1c0c1d00 msgr2=0x7eff1c14f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:15.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.623+0000 7eff228d6640 1 -- 172.21.15.78:0/1416062638 shutdown_connections 2023-10-14T09:18:15.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.623+0000 7eff228d6640 1 -- 172.21.15.78:0/1416062638 wait complete. 2023-10-14T09:18:15.665 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-14T09:18:15.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d8365640 1 Processor -- start 2023-10-14T09:18:15.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d8365640 1 -- start start 2023-10-14T09:18:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d8365640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d0151480 0x7fc6d006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d8365640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6d006ec80 0x7fc6d0157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d8365640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d00c1f30 con 0x7fc6d006aef0 2023-10-14T09:18:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d8365640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d00c0d60 con 0x7fc6d006ec80 2023-10-14T09:18:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d8365640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00c1cc0 con 0x7fc6d0151480 2023-10-14T09:18:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d6902640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6d006ec80 0x7fc6d0157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d6902640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc6d006ec80 0x7fc6d0157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43914/0 (socket says 172.21.15.78:43914) 2023-10-14T09:18:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d6902640 1 -- 172.21.15.78:0/814504694 learned_addr learned my addr 172.21.15.78:0/814504694 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d6101640 1 --2- 172.21.15.78:0/814504694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d0151480 0x7fc6d006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d6902640 1 -- 172.21.15.78:0/814504694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d0151480 msgr2=0x7fc6d006a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d6902640 1 --2- 172.21.15.78:0/814504694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d0151480 0x7fc6d006a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d6902640 1 -- 172.21.15.78:0/814504694 >> v1:172.21.15.157:6789/0 conn(0x7fc6d006aef0 legacy=0x7fc6d01574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d6902640 1 -- 172.21.15.78:0/814504694 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d00c0710 con 0x7fc6d006ec80 2023-10-14T09:18:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.803+0000 7fc6d6101640 1 --2- 172.21.15.78:0/814504694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d0151480 0x7fc6d006a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d6902640 1 --2- 172.21.15.78:0/814504694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d006ec80 0x7fc6d0157bf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009e50 tx=0x7fc6c801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40f30c1f25ab7ad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d50ff640 1 -- 172.21.15.78:0/814504694 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80a55b0 con 0x7fc6d006ec80 2023-10-14T09:18:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d50ff640 1 -- 172.21.15.78:0/814504694 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c80a5710 con 0x7fc6d006ec80 2023-10-14T09:18:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d50ff640 1 -- 172.21.15.78:0/814504694 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80a5aa0 con 0x7fc6d006ec80 2023-10-14T09:18:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d8365640 1 -- 172.21.15.78:0/814504694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d006ec80 msgr2=0x7fc6d0157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d8365640 1 --2- 172.21.15.78:0/814504694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d006ec80 0x7fc6d0157bf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009e50 tx=0x7fc6c801c8f0 comp rx=0 tx=0).stop 2023-10-14T09:18:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d8365640 1 -- 172.21.15.78:0/814504694 shutdown_connections 2023-10-14T09:18:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d8365640 1 --2- 172.21.15.78:0/814504694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d006ec80 0x7fc6d0157bf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d8365640 1 --2- 172.21.15.78:0/814504694 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d0151480 0x7fc6d006a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d8365640 1 -- 172.21.15.78:0/814504694 >> 172.21.15.78:0/814504694 conn(0x7fc6d0069e90 msgr2=0x7fc6d006a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d8365640 1 -- 172.21.15.78:0/814504694 shutdown_connections 2023-10-14T09:18:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.807+0000 7fc6d8365640 1 -- 172.21.15.78:0/814504694 wait complete. 2023-10-14T09:18:15.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d8365640 1 Processor -- start 2023-10-14T09:18:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d8365640 1 -- start start 2023-10-14T09:18:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d8365640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d006aef0 0x7fc6d006cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d8365640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d006ec80 0x7fc6d006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d8365640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d0151480 0x7fc6d01f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d8365640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00a8950 con 0x7fc6d0151480 2023-10-14T09:18:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d8365640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00a8d40 con 0x7fc6d006ec80 2023-10-14T09:18:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d8365640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00a9020 con 0x7fc6d006aef0 2023-10-14T09:18:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d6902640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d0151480 0x7fc6d01f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d6902640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d0151480 0x7fc6d01f0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43916/0 (socket says 172.21.15.78:43916) 2023-10-14T09:18:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d6902640 1 -- 172.21.15.78:0/393384069 learned_addr learned my addr 172.21.15.78:0/393384069 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:15.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d5900640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d006ec80 0x7fc6d006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:15.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d6101640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d006aef0 0x7fc6d006cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:15.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d6902640 1 -- 172.21.15.78:0/393384069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d006aef0 msgr2=0x7fc6d006cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:15.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d6902640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d006aef0 0x7fc6d006cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:15.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d6902640 1 -- 172.21.15.78:0/393384069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d006ec80 msgr2=0x7fc6d006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:15.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d6902640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d006ec80 0x7fc6d006d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:15.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d6902640 1 -- 172.21.15.78:0/393384069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8009b30 con 0x7fc6d0151480 2023-10-14T09:18:15.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d5900640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d006ec80 0x7fc6d006d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:15.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d6902640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d0151480 0x7fc6d01f0370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80af040 tx=0x7fc6c8019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:15.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6c6ffd640 1 -- 172.21.15.78:0/393384069 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80a55b0 con 0x7fc6d0151480 2023-10-14T09:18:15.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6c6ffd640 1 -- 172.21.15.78:0/393384069 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c80b8670 con 0x7fc6d0151480 2023-10-14T09:18:15.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d8365640 1 -- 172.21.15.78:0/393384069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d00a9300 con 0x7fc6d0151480 2023-10-14T09:18:15.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6c6ffd640 1 -- 172.21.15.78:0/393384069 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80b8a00 con 0x7fc6d0151480 2023-10-14T09:18:15.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d8365640 1 -- 172.21.15.78:0/393384069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d00ab880 con 0x7fc6d0151480 2023-10-14T09:18:15.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.811+0000 7fc6d8365640 1 -- 172.21.15.78:0/393384069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d0074110 con 0x7fc6d0151480 2023-10-14T09:18:15.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.815+0000 7fc6c6ffd640 1 -- 172.21.15.78:0/393384069 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc6c80b8b60 con 0x7fc6d0151480 2023-10-14T09:18:15.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.815+0000 7fc6c6ffd640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6b40664a0 0x7fc6b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:15.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.815+0000 7fc6c6ffd640 1 -- 172.21.15.78:0/393384069 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fc6c811f760 con 0x7fc6d0151480 2023-10-14T09:18:15.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.815+0000 7fc6d6101640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6b40664a0 0x7fc6b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:15.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.815+0000 7fc6d6101640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6b40664a0 0x7fc6b4068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00c900 tx=0x7fc6cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:15.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.819+0000 7fc6c6ffd640 1 -- 172.21.15.78:0/393384069 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc6c80ecd30 con 0x7fc6d0151480 2023-10-14T09:18:16.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:15.995+0000 7fc6d8365640 1 -- 172.21.15.78:0/393384069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7fc6d00ab530 con 0x7fc6d0151480 2023-10-14T09:18:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6c6ffd640 1 -- 172.21.15.78:0/393384069 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 187+0+0 (secure 0 0 0) 0x7fc6c80f0350 con 0x7fc6d0151480 2023-10-14T09:18:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 4 and data pool 5 2023-10-14T09:18:16.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 -- 172.21.15.78:0/393384069 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6b40664a0 msgr2=0x7fc6b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:16.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6b40664a0 0x7fc6b4068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00c900 tx=0x7fc6cc008040 comp rx=0 tx=0).stop 2023-10-14T09:18:16.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 -- 172.21.15.78:0/393384069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d0151480 msgr2=0x7fc6d01f0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:16.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d0151480 0x7fc6d01f0370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80af040 tx=0x7fc6c8019690 comp rx=0 tx=0).stop 2023-10-14T09:18:16.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 -- 172.21.15.78:0/393384069 shutdown_connections 2023-10-14T09:18:16.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d0151480 0x7fc6d01f0370 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6d006ec80 0x7fc6d006d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc6b40664a0 0x7fc6b4068960 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 --2- 172.21.15.78:0/393384069 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6d006aef0 0x7fc6d006cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 -- 172.21.15.78:0/393384069 >> 172.21.15.78:0/393384069 conn(0x7fc6d0069e90 msgr2=0x7fc6d0155760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:16.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 -- 172.21.15.78:0/393384069 shutdown_connections 2023-10-14T09:18:16.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.627+0000 7fc6d8365640 1 -- 172.21.15.78:0/393384069 wait complete. 2023-10-14T09:18:16.664 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:18:16.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.799+0000 7ff846468640 1 Processor -- start 2023-10-14T09:18:16.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.799+0000 7ff846468640 1 -- start start 2023-10-14T09:18:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff846468640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff8400c0450 0x7ff84006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff846468640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8400c1230 0x7ff8400c0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff846468640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84006bcc0 con 0x7ff84006d750 2023-10-14T09:18:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff846468640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84006c340 con 0x7ff8400c0450 2023-10-14T09:18:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff846468640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84006ce70 con 0x7ff8400c1230 2023-10-14T09:18:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff83ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff8400c0450 0x7ff84006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff83ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff8400c0450 0x7ff84006fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58798/0 (socket says 172.21.15.78:58798) 2023-10-14T09:18:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff83ffff640 1 -- 172.21.15.78:0/3694347823 learned_addr learned my addr 172.21.15.78:0/3694347823 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff83f7fe640 1 --2- 172.21.15.78:0/3694347823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8400c1230 0x7ff8400c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff83ffff640 1 -- 172.21.15.78:0/3694347823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8400c1230 msgr2=0x7ff8400c0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff83ffff640 1 --2- 172.21.15.78:0/3694347823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8400c1230 0x7ff8400c0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff83ffff640 1 -- 172.21.15.78:0/3694347823 >> v1:172.21.15.157:6789/0 conn(0x7ff84006d750 legacy=0x7ff84006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.803+0000 7ff83ffff640 1 -- 172.21.15.78:0/3694347823 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840150dd0 con 0x7ff8400c0450 2023-10-14T09:18:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff83ffff640 1 --2- 172.21.15.78:0/3694347823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8400c0450 0x7ff84006fc10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff8300098a0 tx=0x7ff83001cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a06bbb4d83e3c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff83effd640 1 -- 172.21.15.78:0/3694347823 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8300ac410 con 0x7ff8400c0450 2023-10-14T09:18:16.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff83effd640 1 -- 172.21.15.78:0/3694347823 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8300ac570 con 0x7ff8400c0450 2023-10-14T09:18:16.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff83effd640 1 -- 172.21.15.78:0/3694347823 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8300ac900 con 0x7ff8400c0450 2023-10-14T09:18:16.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 -- 172.21.15.78:0/3694347823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8400c0450 msgr2=0x7ff84006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:16.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 --2- 172.21.15.78:0/3694347823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8400c0450 0x7ff84006fc10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff8300098a0 tx=0x7ff83001cf80 comp rx=0 tx=0).stop 2023-10-14T09:18:16.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 -- 172.21.15.78:0/3694347823 shutdown_connections 2023-10-14T09:18:16.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 --2- 172.21.15.78:0/3694347823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8400c1230 0x7ff8400c0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 --2- 172.21.15.78:0/3694347823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8400c0450 0x7ff84006fc10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 -- 172.21.15.78:0/3694347823 >> 172.21.15.78:0/3694347823 conn(0x7ff8400c1cc0 msgr2=0x7ff8400c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:16.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 -- 172.21.15.78:0/3694347823 shutdown_connections 2023-10-14T09:18:16.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 -- 172.21.15.78:0/3694347823 wait complete. 2023-10-14T09:18:16.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 Processor -- start 2023-10-14T09:18:16.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 -- start start 2023-10-14T09:18:16.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff84006d750 0x7ff8400c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:16.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8400c0450 0x7ff840158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:16.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8400c1230 0x7ff84014f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:16.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401ebeb0 con 0x7ff8400c0450 2023-10-14T09:18:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff840145000 con 0x7ff84006d750 2023-10-14T09:18:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.807+0000 7ff846468640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401eccd0 con 0x7ff8400c1230 2023-10-14T09:18:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8400c0450 0x7ff840158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8400c0450 0x7ff840158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58802/0 (socket says 172.21.15.78:58802) 2023-10-14T09:18:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83f7fe640 1 -- 172.21.15.78:0/2166272905 learned_addr learned my addr 172.21.15.78:0/2166272905 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:16.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83ffff640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff84006d750 0x7ff8400c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:16.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff844a05640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8400c1230 0x7ff84014f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:16.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83f7fe640 1 -- 172.21.15.78:0/2166272905 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8400c1230 msgr2=0x7ff84014f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:16.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83f7fe640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8400c1230 0x7ff84014f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83f7fe640 1 -- 172.21.15.78:0/2166272905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff84006d750 msgr2=0x7ff8400c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:16.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83f7fe640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff84006d750 0x7ff8400c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83f7fe640 1 -- 172.21.15.78:0/2166272905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300094d0 con 0x7ff8400c0450 2023-10-14T09:18:16.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83f7fe640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8400c0450 0x7ff840158ec0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff83400a7f0 tx=0x7ff83400acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:16.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83cff9640 1 -- 172.21.15.78:0/2166272905 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400d930 con 0x7ff8400c0450 2023-10-14T09:18:16.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83cff9640 1 -- 172.21.15.78:0/2166272905 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83400da90 con 0x7ff8400c0450 2023-10-14T09:18:16.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83cff9640 1 -- 172.21.15.78:0/2166272905 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400de00 con 0x7ff8400c0450 2023-10-14T09:18:16.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff846468640 1 -- 172.21.15.78:0/2166272905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8401ec0c0 con 0x7ff8400c0450 2023-10-14T09:18:16.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff846468640 1 -- 172.21.15.78:0/2166272905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8401ec680 con 0x7ff8400c0450 2023-10-14T09:18:16.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff846468640 1 -- 172.21.15.78:0/2166272905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff840074180 con 0x7ff8400c0450 2023-10-14T09:18:16.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83cff9640 1 -- 172.21.15.78:0/2166272905 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff8340123f0 con 0x7ff8400c0450 2023-10-14T09:18:16.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83cff9640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff82c0664d0 0x7ff82c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:16.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.811+0000 7ff83cff9640 1 -- 172.21.15.78:0/2166272905 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5729+0+0 (secure 0 0 0) 0x7ff834084160 con 0x7ff8400c0450 2023-10-14T09:18:16.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.815+0000 7ff83ffff640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff82c0664d0 0x7ff82c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:16.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.815+0000 7ff83ffff640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff82c0664d0 0x7ff82c068990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff8300ae000 tx=0x7ff830009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:16.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.815+0000 7ff83cff9640 1 -- 172.21.15.78:0/2166272905 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8340515d0 con 0x7ff8400c0450 2023-10-14T09:18:16.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.967+0000 7ff846468640 1 -- 172.21.15.78:0/2166272905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8400a9010 con 0x7ff8400c0450 2023-10-14T09:18:16.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff83cff9640 1 -- 172.21.15.78:0/2166272905 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16602 (secure 0 0 0) 0x7ff834054bf0 con 0x7ff8400c0450 2023-10-14T09:18:16.973 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:16.974 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":31,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:18:16.001655+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T09:18:13.661984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T09:18:15.003533+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:18:16.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 -- 172.21.15.78:0/2166272905 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff82c0664d0 msgr2=0x7ff82c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:16.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff82c0664d0 0x7ff82c068990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff8300ae000 tx=0x7ff830009040 comp rx=0 tx=0).stop 2023-10-14T09:18:16.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 -- 172.21.15.78:0/2166272905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8400c0450 msgr2=0x7ff840158ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:16.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8400c0450 0x7ff840158ec0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff83400a7f0 tx=0x7ff83400acb0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 -- 172.21.15.78:0/2166272905 shutdown_connections 2023-10-14T09:18:16.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff82c0664d0 0x7ff82c068990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff8400c1230 0x7ff84014f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8400c0450 0x7ff840158ec0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 --2- 172.21.15.78:0/2166272905 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff84006d750 0x7ff8400c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 -- 172.21.15.78:0/2166272905 >> 172.21.15.78:0/2166272905 conn(0x7ff8400c1cc0 msgr2=0x7ff8400a8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 -- 172.21.15.78:0/2166272905 shutdown_connections 2023-10-14T09:18:16.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:16.971+0000 7ff846468640 1 -- 172.21.15.78:0/2166272905 wait complete. 2023-10-14T09:18:16.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:18:17.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2957246640 1 Processor -- start 2023-10-14T09:18:17.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2957246640 1 -- start start 2023-10-14T09:18:17.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2957246640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 0x7f29501549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2957246640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f29500be950 0x7f2950071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2957246640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29500bede0 con 0x7f2950157370 2023-10-14T09:18:17.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2957246640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295006ffd0 con 0x7f29500be950 2023-10-14T09:18:17.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2957246640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29501578e0 con 0x7f29500be570 2023-10-14T09:18:17.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f294ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2950157370 0x7f2950071120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40454/0 (socket says 172.21.15.78:40454) 2023-10-14T09:18:17.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f294ffff640 1 -- 172.21.15.78:0/886614647 learned_addr learned my addr 172.21.15.78:0/886614647 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:17.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2954fe2640 1 --2- 172.21.15.78:0/886614647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 0x7f29501549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f29557e3640 1 --2- 172.21.15.78:0/886614647 >> v2:172.21.15.157:3300/0 conn(0x7f29500be950 0x7f2950071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f294f7fe640 1 -- 172.21.15.78:0/886614647 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231101016 0 0) 0x7f293c001120 con 0x7f2950157370 2023-10-14T09:18:17.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f294f7fe640 1 -- 172.21.15.78:0/886614647 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2940003530 con 0x7f2950157370 2023-10-14T09:18:17.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f294f7fe640 1 -- 172.21.15.78:0/886614647 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 730950560 0 0) 0x7f2940003530 con 0x7f2950157370 2023-10-14T09:18:17.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2954fe2640 1 -- 172.21.15.78:0/886614647 >> v2:172.21.15.157:3300/0 conn(0x7f29500be950 msgr2=0x7f2950071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:17.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2954fe2640 1 --2- 172.21.15.78:0/886614647 >> v2:172.21.15.157:3300/0 conn(0x7f29500be950 0x7f2950071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2954fe2640 1 -- 172.21.15.78:0/886614647 >> v1:172.21.15.78:6789/0 conn(0x7f2950157370 legacy=0x7f2950071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f2954fe2640 1 -- 172.21.15.78:0/886614647 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950157bc0 con 0x7f29500be570 2023-10-14T09:18:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.131+0000 7f29557e3640 1 --2- 172.21.15.78:0/886614647 >> v2:172.21.15.157:3300/0 conn(0x7f29500be950 0x7f2950071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:18:17.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f2954fe2640 1 --2- 172.21.15.78:0/886614647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 0x7f29501549c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29440097c0 tx=0x7f294401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d3f6be2e898d2f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:17.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f294f7fe640 1 -- 172.21.15.78:0/886614647 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c001810 con 0x7f29500be570 2023-10-14T09:18:17.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f294f7fe640 1 -- 172.21.15.78:0/886614647 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29440a7050 con 0x7f29500be570 2023-10-14T09:18:17.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f294f7fe640 1 -- 172.21.15.78:0/886614647 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29440ab620 con 0x7f29500be570 2023-10-14T09:18:17.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f2957246640 1 -- 172.21.15.78:0/886614647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 msgr2=0x7f29501549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:17.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f2957246640 1 --2- 172.21.15.78:0/886614647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 0x7f29501549c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29440097c0 tx=0x7f294401c370 comp rx=0 tx=0).stop 2023-10-14T09:18:17.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f2957246640 1 -- 172.21.15.78:0/886614647 shutdown_connections 2023-10-14T09:18:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f2957246640 1 --2- 172.21.15.78:0/886614647 >> v2:172.21.15.157:3300/0 conn(0x7f29500be950 0x7f2950071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f2957246640 1 --2- 172.21.15.78:0/886614647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 0x7f29501549c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f2957246640 1 -- 172.21.15.78:0/886614647 >> 172.21.15.78:0/886614647 conn(0x7f29500c1cc0 msgr2=0x7f29500c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f2957246640 1 -- 172.21.15.78:0/886614647 shutdown_connections 2023-10-14T09:18:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.135+0000 7f2957246640 1 -- 172.21.15.78:0/886614647 wait complete. 2023-10-14T09:18:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2957246640 1 Processor -- start 2023-10-14T09:18:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2957246640 1 -- start start 2023-10-14T09:18:17.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2957246640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 0x7f2950133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2957246640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29500be950 0x7f2950155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2957246640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2950157370 0x7f2950150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2957246640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29501ef5f0 con 0x7f29500be950 2023-10-14T09:18:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2957246640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29501520b0 con 0x7f2950157370 2023-10-14T09:18:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2957246640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29501564b0 con 0x7f29500be570 2023-10-14T09:18:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29500be950 0x7f2950155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29500be950 0x7f2950155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58810/0 (socket says 172.21.15.78:58810) 2023-10-14T09:18:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294ffff640 1 -- 172.21.15.78:0/1069575726 learned_addr learned my addr 172.21.15.78:0/1069575726 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2954fe2640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 0x7f2950133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f29557e3640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2950157370 0x7f2950150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294ffff640 1 -- 172.21.15.78:0/1069575726 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 msgr2=0x7f2950133ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:17.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294ffff640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 0x7f2950133ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294ffff640 1 -- 172.21.15.78:0/1069575726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2950157370 msgr2=0x7f2950150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294ffff640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2950157370 0x7f2950150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294ffff640 1 -- 172.21.15.78:0/1069575726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2948009a70 con 0x7f29500be950 2023-10-14T09:18:17.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2954fe2640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 0x7f2950133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:17.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f29557e3640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2950157370 0x7f2950150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:17.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294ffff640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29500be950 0x7f2950155170 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f293c00c750 tx=0x7f293c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:17.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294d7fa640 1 -- 172.21.15.78:0/1069575726 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c005af0 con 0x7f29500be950 2023-10-14T09:18:17.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294d7fa640 1 -- 172.21.15.78:0/1069575726 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c005c50 con 0x7f29500be950 2023-10-14T09:18:17.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f294d7fa640 1 -- 172.21.15.78:0/1069575726 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c007070 con 0x7f29500be950 2023-10-14T09:18:17.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2957246640 1 -- 172.21.15.78:0/1069575726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2944009420 con 0x7f29500be950 2023-10-14T09:18:17.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.139+0000 7f2957246640 1 -- 172.21.15.78:0/1069575726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2950151af0 con 0x7f29500be950 2023-10-14T09:18:17.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.143+0000 7f2957246640 1 -- 172.21.15.78:0/1069575726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2950156b80 con 0x7f29500be950 2023-10-14T09:18:17.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.143+0000 7f294d7fa640 1 -- 172.21.15.78:0/1069575726 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f293c0071d0 con 0x7f29500be950 2023-10-14T09:18:17.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.143+0000 7f294d7fa640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f29340664a0 0x7f2934068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.143+0000 7f294d7fa640 1 -- 172.21.15.78:0/1069575726 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f293c083a40 con 0x7f29500be950 2023-10-14T09:18:17.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.143+0000 7f2954fe2640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f29340664a0 0x7f2934068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.143+0000 7f2954fe2640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f29340664a0 0x7f2934068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f29440ad000 tx=0x7f2944008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:17.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.147+0000 7f294d7fa640 1 -- 172.21.15.78:0/1069575726 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2950156b80 con 0x7f29500be950 2023-10-14T09:18:17.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.303+0000 7f2957246640 1 -- 172.21.15.78:0/1069575726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29500bede0 con 0x7f29500be950 2023-10-14T09:18:17.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.303+0000 7f294d7fa640 1 -- 172.21.15.78:0/1069575726 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16589 (secure 0 0 0) 0x7f293c07be60 con 0x7f29500be950 2023-10-14T09:18:17.308 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:17.308 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":32,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:18:17.070566+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T09:18:13.661984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T09:18:15.003533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:18:17.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 -- 172.21.15.78:0/1069575726 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f29340664a0 msgr2=0x7f2934068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:17.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f29340664a0 0x7f2934068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f29440ad000 tx=0x7f2944008040 comp rx=0 tx=0).stop 2023-10-14T09:18:17.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 -- 172.21.15.78:0/1069575726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29500be950 msgr2=0x7f2950155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:17.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29500be950 0x7f2950155170 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f293c00c750 tx=0x7f293c00cc10 comp rx=0 tx=0).stop 2023-10-14T09:18:17.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 -- 172.21.15.78:0/1069575726 shutdown_connections 2023-10-14T09:18:17.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2950157370 0x7f2950150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29500be950 0x7f2950155170 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f29340664a0 0x7f2934068960 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 --2- 172.21.15.78:0/1069575726 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f29500be570 0x7f2950133ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 -- 172.21.15.78:0/1069575726 >> 172.21.15.78:0/1069575726 conn(0x7f29500c1cc0 msgr2=0x7f295006c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:17.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 -- 172.21.15.78:0/1069575726 shutdown_connections 2023-10-14T09:18:17.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.307+0000 7f2957246640 1 -- 172.21.15.78:0/1069575726 wait complete. 2023-10-14T09:18:17.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-14T09:18:17.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.463+0000 7fc251b80640 1 Processor -- start 2023-10-14T09:18:17.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc251b80640 1 -- start start 2023-10-14T09:18:17.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc251b80640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c151310 0x7fc24c0c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc251b80640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc24c0700d0 0x7fc24c0c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc251b80640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24c157d50 con 0x7fc24c0c1e20 2023-10-14T09:18:17.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc251b80640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24c0c3b80 con 0x7fc24c0700d0 2023-10-14T09:18:17.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc251b80640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c158280 con 0x7fc24c151310 2023-10-14T09:18:17.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc243fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc24c0700d0 0x7fc24c0c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc243fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc24c0700d0 0x7fc24c0c4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58816/0 (socket says 172.21.15.78:58816) 2023-10-14T09:18:17.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc243fff640 1 -- 172.21.15.78:0/1387936263 learned_addr learned my addr 172.21.15.78:0/1387936263 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:17.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc24b7fe640 1 --2- 172.21.15.78:0/1387936263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c151310 0x7fc24c0c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc243fff640 1 -- 172.21.15.78:0/1387936263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c151310 msgr2=0x7fc24c0c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:17.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc243fff640 1 --2- 172.21.15.78:0/1387936263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c151310 0x7fc24c0c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc243fff640 1 -- 172.21.15.78:0/1387936263 >> v1:172.21.15.157:6789/0 conn(0x7fc24c0c1e20 legacy=0x7fc24c0c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:17.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc243fff640 1 -- 172.21.15.78:0/1387936263 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c157fa0 con 0x7fc24c0700d0 2023-10-14T09:18:17.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.467+0000 7fc24b7fe640 1 --2- 172.21.15.78:0/1387936263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c151310 0x7fc24c0c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:17.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc243fff640 1 --2- 172.21.15.78:0/1387936263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc24c0700d0 0x7fc24c0c4010 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc234009870 tx=0x7fc23401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8817104f278ceb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:17.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc24affd640 1 -- 172.21.15.78:0/1387936263 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340ab650 con 0x7fc24c0700d0 2023-10-14T09:18:17.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc24affd640 1 -- 172.21.15.78:0/1387936263 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2340ab7b0 con 0x7fc24c0700d0 2023-10-14T09:18:17.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc24affd640 1 -- 172.21.15.78:0/1387936263 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340abb40 con 0x7fc24c0700d0 2023-10-14T09:18:17.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc251b80640 1 -- 172.21.15.78:0/1387936263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc24c0700d0 msgr2=0x7fc24c0c4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:17.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc251b80640 1 --2- 172.21.15.78:0/1387936263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc24c0700d0 0x7fc24c0c4010 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc234009870 tx=0x7fc23401c470 comp rx=0 tx=0).stop 2023-10-14T09:18:17.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc251b80640 1 -- 172.21.15.78:0/1387936263 shutdown_connections 2023-10-14T09:18:17.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc251b80640 1 --2- 172.21.15.78:0/1387936263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc24c0700d0 0x7fc24c0c4010 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc251b80640 1 --2- 172.21.15.78:0/1387936263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c151310 0x7fc24c0c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc251b80640 1 -- 172.21.15.78:0/1387936263 >> 172.21.15.78:0/1387936263 conn(0x7fc24c06a2c0 msgr2=0x7fc24c06a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:17.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc251b80640 1 -- 172.21.15.78:0/1387936263 shutdown_connections 2023-10-14T09:18:17.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc251b80640 1 -- 172.21.15.78:0/1387936263 wait complete. 2023-10-14T09:18:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc251b80640 1 Processor -- start 2023-10-14T09:18:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.471+0000 7fc251b80640 1 -- start start 2023-10-14T09:18:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc251b80640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc24c0c1e20 0x7fc24c0bc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc251b80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc24c151310 0x7fc24c1f0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc251b80640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c0bb110 0x7fc24c14de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc251b80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c1ec790 con 0x7fc24c151310 2023-10-14T09:18:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc251b80640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0bbaf0 con 0x7fc24c0c1e20 2023-10-14T09:18:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc251b80640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c1ec440 con 0x7fc24c0bb110 2023-10-14T09:18:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc243fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc24c151310 0x7fc24c1f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc243fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc24c151310 0x7fc24c1f0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58820/0 (socket says 172.21.15.78:58820) 2023-10-14T09:18:17.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc243fff640 1 -- 172.21.15.78:0/3509486825 learned_addr learned my addr 172.21.15.78:0/3509486825 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:17.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc24b7fe640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc24c0c1e20 0x7fc24c0bc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc24bfff640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c0bb110 0x7fc24c14de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc243fff640 1 -- 172.21.15.78:0/3509486825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c0bb110 msgr2=0x7fc24c14de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:17.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc243fff640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c0bb110 0x7fc24c14de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc243fff640 1 -- 172.21.15.78:0/3509486825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc24c0c1e20 msgr2=0x7fc24c0bc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:17.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc243fff640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc24c0c1e20 0x7fc24c0bc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:17.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc243fff640 1 -- 172.21.15.78:0/3509486825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2340094d0 con 0x7fc24c151310 2023-10-14T09:18:17.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc24b7fe640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc24c0c1e20 0x7fc24c0bc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:17.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc24bfff640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c0bb110 0x7fc24c14de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:17.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc243fff640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc24c151310 0x7fc24c1f0350 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc2340ad040 tx=0x7fc23401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:17.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc248ff9640 1 -- 172.21.15.78:0/3509486825 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340b4800 con 0x7fc24c151310 2023-10-14T09:18:17.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc248ff9640 1 -- 172.21.15.78:0/3509486825 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2340b4980 con 0x7fc24c151310 2023-10-14T09:18:17.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc248ff9640 1 -- 172.21.15.78:0/3509486825 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340b4d30 con 0x7fc24c151310 2023-10-14T09:18:17.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc251b80640 1 -- 172.21.15.78:0/3509486825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24c0bbdb0 con 0x7fc24c151310 2023-10-14T09:18:17.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc251b80640 1 -- 172.21.15.78:0/3509486825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c0ac330 con 0x7fc24c151310 2023-10-14T09:18:17.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc251b80640 1 -- 172.21.15.78:0/3509486825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24c0bbf40 con 0x7fc24c151310 2023-10-14T09:18:17.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.475+0000 7fc248ff9640 1 -- 172.21.15.78:0/3509486825 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc2340c7440 con 0x7fc24c151310 2023-10-14T09:18:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.479+0000 7fc248ff9640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc22c0664d0 0x7fc22c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.479+0000 7fc248ff9640 1 -- 172.21.15.78:0/3509486825 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fc23411eb90 con 0x7fc24c151310 2023-10-14T09:18:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.479+0000 7fc24b7fe640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc22c0664d0 0x7fc22c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.479+0000 7fc24b7fe640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc22c0664d0 0x7fc22c068990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc23c006fd0 tx=0x7fc23c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:17.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.483+0000 7fc248ff9640 1 -- 172.21.15.78:0/3509486825 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2340ec100 con 0x7fc24c151310 2023-10-14T09:18:17.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:17.667+0000 7fc251b80640 1 -- 172.21.15.78:0/3509486825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc24c074110 con 0x7fc24c151310 2023-10-14T09:18:18.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.647+0000 7fc248ff9640 1 -- 172.21.15.78:0/3509486825 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc2340ef720 con 0x7fc24c151310 2023-10-14T09:18:18.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.647+0000 7fc251b80640 1 -- 172.21.15.78:0/3509486825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc22c0664d0 msgr2=0x7fc22c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:18.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.647+0000 7fc251b80640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc22c0664d0 0x7fc22c068990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc23c006fd0 tx=0x7fc23c008040 comp rx=0 tx=0).stop 2023-10-14T09:18:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.647+0000 7fc251b80640 1 -- 172.21.15.78:0/3509486825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc24c151310 msgr2=0x7fc24c1f0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:18.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.647+0000 7fc251b80640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc24c151310 0x7fc24c1f0350 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc2340ad040 tx=0x7fc23401acb0 comp rx=0 tx=0).stop 2023-10-14T09:18:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.647+0000 7fc251b80640 1 -- 172.21.15.78:0/3509486825 shutdown_connections 2023-10-14T09:18:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.647+0000 7fc251b80640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc22c0664d0 0x7fc22c068990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.647+0000 7fc251b80640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc24c0bb110 0x7fc24c14de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.647+0000 7fc251b80640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc24c151310 0x7fc24c1f0350 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:18.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.647+0000 7fc251b80640 1 --2- 172.21.15.78:0/3509486825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc24c0c1e20 0x7fc24c0bc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:18.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.647+0000 7fc251b80640 1 -- 172.21.15.78:0/3509486825 >> 172.21.15.78:0/3509486825 conn(0x7fc24c06a2c0 msgr2=0x7fc24c14b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:18.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.651+0000 7fc251b80640 1 -- 172.21.15.78:0/3509486825 shutdown_connections 2023-10-14T09:18:18.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.651+0000 7fc251b80640 1 -- 172.21.15.78:0/3509486825 wait complete. 2023-10-14T09:18:18.676 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T09:18:18.677 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-14T09:18:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af8301640 1 Processor -- start 2023-10-14T09:18:18.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af8301640 1 -- start start 2023-10-14T09:18:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af8301640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4af0139dc0 0x7f4af00718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af8301640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4af0150ac0 0x7f4af0150f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af8301640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af0151fd0 con 0x7f4af01532c0 2023-10-14T09:18:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af8301640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af00702c0 con 0x7f4af0150ac0 2023-10-14T09:18:18.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af8301640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af0152ea0 con 0x7f4af0139dc0 2023-10-14T09:18:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af589c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4af0150ac0 0x7f4af0150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af589c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4af0150ac0 0x7f4af0150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58836/0 (socket says 172.21.15.78:58836) 2023-10-14T09:18:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af589c640 1 -- 172.21.15.78:0/1590581171 learned_addr learned my addr 172.21.15.78:0/1590581171 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:18.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af609d640 1 --2- 172.21.15.78:0/1590581171 >> v2:172.21.15.157:3300/0 conn(0x7f4af0139dc0 0x7f4af00718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af589c640 1 -- 172.21.15.78:0/1590581171 >> v2:172.21.15.157:3300/0 conn(0x7f4af0139dc0 msgr2=0x7f4af00718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af589c640 1 --2- 172.21.15.78:0/1590581171 >> v2:172.21.15.157:3300/0 conn(0x7f4af0139dc0 0x7f4af00718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af589c640 1 -- 172.21.15.78:0/1590581171 >> v1:172.21.15.157:6789/0 conn(0x7f4af01532c0 legacy=0x7f4af0153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af589c640 1 -- 172.21.15.78:0/1590581171 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af0153e40 con 0x7f4af0150ac0 2023-10-14T09:18:18.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.819+0000 7f4af609d640 1 --2- 172.21.15.78:0/1590581171 >> v2:172.21.15.157:3300/0 conn(0x7f4af0139dc0 0x7f4af00718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:18.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af589c640 1 --2- 172.21.15.78:0/1590581171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4af0150ac0 0x7f4af0150f40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4af00c1730 tx=0x7f4ae001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0022b0d1cab6e33 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:18.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af509b640 1 -- 172.21.15.78:0/1590581171 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00ab600 con 0x7f4af0150ac0 2023-10-14T09:18:18.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af509b640 1 -- 172.21.15.78:0/1590581171 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae00ab760 con 0x7f4af0150ac0 2023-10-14T09:18:18.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af509b640 1 -- 172.21.15.78:0/1590581171 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00abaf0 con 0x7f4af0150ac0 2023-10-14T09:18:18.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af8301640 1 -- 172.21.15.78:0/1590581171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4af0150ac0 msgr2=0x7f4af0150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:18.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af8301640 1 --2- 172.21.15.78:0/1590581171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4af0150ac0 0x7f4af0150f40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4af00c1730 tx=0x7f4ae001c400 comp rx=0 tx=0).stop 2023-10-14T09:18:18.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af8301640 1 -- 172.21.15.78:0/1590581171 shutdown_connections 2023-10-14T09:18:18.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af8301640 1 --2- 172.21.15.78:0/1590581171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4af0150ac0 0x7f4af0150f40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:18.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af8301640 1 --2- 172.21.15.78:0/1590581171 >> v2:172.21.15.157:3300/0 conn(0x7f4af0139dc0 0x7f4af00718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:18.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af8301640 1 -- 172.21.15.78:0/1590581171 >> 172.21.15.78:0/1590581171 conn(0x7f4af00c1d00 msgr2=0x7f4af00c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:18.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af8301640 1 -- 172.21.15.78:0/1590581171 shutdown_connections 2023-10-14T09:18:18.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af8301640 1 -- 172.21.15.78:0/1590581171 wait complete. 2023-10-14T09:18:18.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.823+0000 7f4af8301640 1 Processor -- start 2023-10-14T09:18:18.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af8301640 1 -- start start 2023-10-14T09:18:18.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af8301640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4af0139dc0 0x7f4af00bb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:18.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af8301640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4af0150ac0 0x7f4af00bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:18.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af8301640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4af01532c0 0x7f4af0134050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:18.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af8301640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af01ec650 con 0x7f4af0150ac0 2023-10-14T09:18:18.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af8301640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af01ebd10 con 0x7f4af0139dc0 2023-10-14T09:18:18.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af8301640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af012fa30 con 0x7f4af01532c0 2023-10-14T09:18:18.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af589c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4af0150ac0 0x7f4af00bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:18.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af589c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4af0150ac0 0x7f4af00bbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58848/0 (socket says 172.21.15.78:58848) 2023-10-14T09:18:18.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af589c640 1 -- 172.21.15.78:0/2202911823 learned_addr learned my addr 172.21.15.78:0/2202911823 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:18.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af609d640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4af0139dc0 0x7f4af00bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:18.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af689e640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4af01532c0 0x7f4af0134050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:18.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af589c640 1 -- 172.21.15.78:0/2202911823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4af01532c0 msgr2=0x7f4af0134050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:18.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af589c640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4af01532c0 0x7f4af0134050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:18.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af589c640 1 -- 172.21.15.78:0/2202911823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4af0139dc0 msgr2=0x7f4af00bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:18.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af589c640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4af0139dc0 0x7f4af00bb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:18.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af589c640 1 -- 172.21.15.78:0/2202911823 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00094d0 con 0x7f4af0150ac0 2023-10-14T09:18:18.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af689e640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4af01532c0 0x7f4af0134050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:18.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af609d640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4af0139dc0 0x7f4af00bb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:18.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af589c640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4af0150ac0 0x7f4af00bbd60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ae001a030 tx=0x7f4ae001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:18.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4ae6ffd640 1 -- 172.21.15.78:0/2202911823 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00b4800 con 0x7f4af0150ac0 2023-10-14T09:18:18.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4ae6ffd640 1 -- 172.21.15.78:0/2202911823 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae00b4960 con 0x7f4af0150ac0 2023-10-14T09:18:18.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4ae6ffd640 1 -- 172.21.15.78:0/2202911823 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00b4cf0 con 0x7f4af0150ac0 2023-10-14T09:18:18.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af8301640 1 -- 172.21.15.78:0/2202911823 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af01ebf90 con 0x7f4af0150ac0 2023-10-14T09:18:18.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af8301640 1 -- 172.21.15.78:0/2202911823 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af014c1b0 con 0x7f4af0150ac0 2023-10-14T09:18:18.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4af8301640 1 -- 172.21.15.78:0/2202911823 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af01ec790 con 0x7f4af0150ac0 2023-10-14T09:18:18.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.827+0000 7f4ae6ffd640 1 -- 172.21.15.78:0/2202911823 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4ae00b3380 con 0x7f4af0150ac0 2023-10-14T09:18:18.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.831+0000 7f4ae6ffd640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4ad40664d0 0x7f4ad4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:18.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.831+0000 7f4ae6ffd640 1 -- 172.21.15.78:0/2202911823 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4ae011e2c0 con 0x7f4af0150ac0 2023-10-14T09:18:18.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.831+0000 7f4af609d640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4ad40664d0 0x7f4ad4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:18.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.831+0000 7f4af609d640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4ad40664d0 0x7f4ad4068990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00a9b0 tx=0x7f4aec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:18.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:18.835+0000 7f4ae6ffd640 1 -- 172.21.15.78:0/2202911823 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4af01ec790 con 0x7f4af0150ac0 2023-10-14T09:18:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.015+0000 7f4af8301640 1 -- 172.21.15.78:0/2202911823 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4af01ec790 con 0x7f4af0150ac0 2023-10-14T09:18:19.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.651+0000 7f4ae6ffd640 1 -- 172.21.15.78:0/2202911823 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 127+0+0 (secure 0 0 0) 0x7f4af01ec790 con 0x7f4af0150ac0 2023-10-14T09:18:19.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 -- 172.21.15.78:0/2202911823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4ad40664d0 msgr2=0x7f4ad4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:19.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4ad40664d0 0x7f4ad4068990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00a9b0 tx=0x7f4aec008040 comp rx=0 tx=0).stop 2023-10-14T09:18:19.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 -- 172.21.15.78:0/2202911823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4af0150ac0 msgr2=0x7f4af00bbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:19.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4af0150ac0 0x7f4af00bbd60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4ae001a030 tx=0x7f4ae001ac40 comp rx=0 tx=0).stop 2023-10-14T09:18:19.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 -- 172.21.15.78:0/2202911823 shutdown_connections 2023-10-14T09:18:19.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4ad40664d0 0x7f4ad4068990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:19.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4af01532c0 0x7f4af0134050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:19.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4af0150ac0 0x7f4af00bbd60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:19.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 --2- 172.21.15.78:0/2202911823 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4af0139dc0 0x7f4af00bb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:19.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 -- 172.21.15.78:0/2202911823 >> 172.21.15.78:0/2202911823 conn(0x7f4af00c1d00 msgr2=0x7f4af0071700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:19.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 -- 172.21.15.78:0/2202911823 shutdown_connections 2023-10-14T09:18:19.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.655+0000 7f4af8301640 1 -- 172.21.15.78:0/2202911823 wait complete. 2023-10-14T09:18:19.679 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-14T09:18:19.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f98469d0640 1 Processor -- start 2023-10-14T09:18:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f98469d0640 1 -- start start 2023-10-14T09:18:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f98469d0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f984014ddb0 0x7f98400c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f98469d0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9840153e80 0x7f984006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f98469d0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984006c470 con 0x7f98400c6910 2023-10-14T09:18:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f98469d0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98400c64f0 con 0x7f984014ddb0 2023-10-14T09:18:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f98469d0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98400c5300 con 0x7f9840153e80 2023-10-14T09:18:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f983ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f984014ddb0 0x7f98400c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f9844f6d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f98400c6910 0x7f98400c3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40468/0 (socket says 172.21.15.78:40468) 2023-10-14T09:18:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f983ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f984014ddb0 0x7f98400c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58862/0 (socket says 172.21.15.78:58862) 2023-10-14T09:18:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f9844f6d640 1 -- 172.21.15.78:0/2496499798 learned_addr learned my addr 172.21.15.78:0/2496499798 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f983f7fe640 1 --2- 172.21.15.78:0/2496499798 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9840153e80 0x7f984006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f983ffff640 1 -- 172.21.15.78:0/2496499798 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9840153e80 msgr2=0x7f984006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f983ffff640 1 --2- 172.21.15.78:0/2496499798 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9840153e80 0x7f984006bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f983ffff640 1 -- 172.21.15.78:0/2496499798 >> v1:172.21.15.78:6789/0 conn(0x7f98400c6910 legacy=0x7f98400c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.815+0000 7f983ffff640 1 -- 172.21.15.78:0/2496499798 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984006c750 con 0x7f984014ddb0 2023-10-14T09:18:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f983ffff640 1 --2- 172.21.15.78:0/2496499798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984014ddb0 0x7f98400c7780 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f98300097c0 tx=0x7f983001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3419f8f059e5bfc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f983effd640 1 -- 172.21.15.78:0/2496499798 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98300ab600 con 0x7f984014ddb0 2023-10-14T09:18:19.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f983effd640 1 -- 172.21.15.78:0/2496499798 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98300a7050 con 0x7f984014ddb0 2023-10-14T09:18:19.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f983effd640 1 -- 172.21.15.78:0/2496499798 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98300ab980 con 0x7f984014ddb0 2023-10-14T09:18:19.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f98469d0640 1 -- 172.21.15.78:0/2496499798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984014ddb0 msgr2=0x7f98400c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:19.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f98469d0640 1 --2- 172.21.15.78:0/2496499798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984014ddb0 0x7f98400c7780 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f98300097c0 tx=0x7f983001c330 comp rx=0 tx=0).stop 2023-10-14T09:18:19.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f98469d0640 1 -- 172.21.15.78:0/2496499798 shutdown_connections 2023-10-14T09:18:19.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f98469d0640 1 --2- 172.21.15.78:0/2496499798 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9840153e80 0x7f984006bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:19.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f98469d0640 1 --2- 172.21.15.78:0/2496499798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984014ddb0 0x7f98400c7780 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:19.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f98469d0640 1 -- 172.21.15.78:0/2496499798 >> 172.21.15.78:0/2496499798 conn(0x7f98400ab1f0 msgr2=0x7f98400ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:19.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f98469d0640 1 -- 172.21.15.78:0/2496499798 shutdown_connections 2023-10-14T09:18:19.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f98469d0640 1 -- 172.21.15.78:0/2496499798 wait complete. 2023-10-14T09:18:19.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f98469d0640 1 Processor -- start 2023-10-14T09:18:19.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.819+0000 7f98469d0640 1 -- start start 2023-10-14T09:18:19.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f98469d0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98400c6910 0x7f98401ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:19.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f98469d0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984014ddb0 0x7f984015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f98469d0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9840153e80 0x7f984014ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:19.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f98469d0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98400c25b0 con 0x7f984014ddb0 2023-10-14T09:18:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f98469d0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98400c39c0 con 0x7f9840153e80 2023-10-14T09:18:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f98469d0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9840150650 con 0x7f98400c6910 2023-10-14T09:18:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984014ddb0 0x7f984015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984014ddb0 0x7f984015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58864/0 (socket says 172.21.15.78:58864) 2023-10-14T09:18:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983f7fe640 1 -- 172.21.15.78:0/2015173130 learned_addr learned my addr 172.21.15.78:0/2015173130 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983ffff640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98400c6910 0x7f98401ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f9844f6d640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9840153e80 0x7f984014ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983f7fe640 1 -- 172.21.15.78:0/2015173130 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98400c6910 msgr2=0x7f98401ecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983f7fe640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98400c6910 0x7f98401ecb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:19.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983f7fe640 1 -- 172.21.15.78:0/2015173130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9840153e80 msgr2=0x7f984014ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:19.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983f7fe640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9840153e80 0x7f984014ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:19.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983f7fe640 1 -- 172.21.15.78:0/2015173130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9830009420 con 0x7f984014ddb0 2023-10-14T09:18:19.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f9844f6d640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9840153e80 0x7f984014ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983f7fe640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984014ddb0 0x7f984015dbb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f983400d7d0 tx=0x7f983400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983cff9640 1 -- 172.21.15.78:0/2015173130 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983400b6c0 con 0x7f984014ddb0 2023-10-14T09:18:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983cff9640 1 -- 172.21.15.78:0/2015173130 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983400b820 con 0x7f984014ddb0 2023-10-14T09:18:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983cff9640 1 -- 172.21.15.78:0/2015173130 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983400bbd0 con 0x7f984014ddb0 2023-10-14T09:18:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f98469d0640 1 -- 172.21.15.78:0/2015173130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98400c33b0 con 0x7f984014ddb0 2023-10-14T09:18:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f98469d0640 1 -- 172.21.15.78:0/2015173130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98401ed0d0 con 0x7f984014ddb0 2023-10-14T09:18:19.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f98469d0640 1 -- 172.21.15.78:0/2015173130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9840074180 con 0x7f984014ddb0 2023-10-14T09:18:19.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.823+0000 7f983cff9640 1 -- 172.21.15.78:0/2015173130 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f983400bd30 con 0x7f984014ddb0 2023-10-14T09:18:19.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.827+0000 7f983cff9640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f982c0664a0 0x7f982c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:19.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.827+0000 7f983cff9640 1 -- 172.21.15.78:0/2015173130 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f9834084180 con 0x7f984014ddb0 2023-10-14T09:18:19.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.827+0000 7f983ffff640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f982c0664a0 0x7f982c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:19.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.827+0000 7f983ffff640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f982c0664a0 0x7f982c068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f98300ad000 tx=0x7f9830008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:19.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:19.831+0000 7f983cff9640 1 -- 172.21.15.78:0/2015173130 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f98340515d0 con 0x7f984014ddb0 2023-10-14T09:18:20.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.011+0000 7f98469d0640 1 -- 172.21.15.78:0/2015173130 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98401ed0d0 con 0x7f984014ddb0 2023-10-14T09:18:20.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.011+0000 7f983cff9640 1 -- 172.21.15.78:0/2015173130 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f98401ed0d0 con 0x7f984014ddb0 2023-10-14T09:18:20.017 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:20.017 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:18:20.017 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:18:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 -- 172.21.15.78:0/2015173130 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f982c0664a0 msgr2=0x7f982c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f982c0664a0 0x7f982c068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f98300ad000 tx=0x7f9830008040 comp rx=0 tx=0).stop 2023-10-14T09:18:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 -- 172.21.15.78:0/2015173130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984014ddb0 msgr2=0x7f984015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984014ddb0 0x7f984015dbb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f983400d7d0 tx=0x7f983400dc90 comp rx=0 tx=0).stop 2023-10-14T09:18:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 -- 172.21.15.78:0/2015173130 shutdown_connections 2023-10-14T09:18:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9840153e80 0x7f984014ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984014ddb0 0x7f984015dbb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f982c0664a0 0x7f982c068960 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 --2- 172.21.15.78:0/2015173130 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f98400c6910 0x7f98401ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 -- 172.21.15.78:0/2015173130 >> 172.21.15.78:0/2015173130 conn(0x7f98400ab1f0 msgr2=0x7f98400c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:20.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 -- 172.21.15.78:0/2015173130 shutdown_connections 2023-10-14T09:18:20.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.015+0000 7f98469d0640 1 -- 172.21.15.78:0/2015173130 wait complete. 2023-10-14T09:18:20.038 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:18:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.171+0000 7f18b6eea640 1 Processor -- start 2023-10-14T09:18:20.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.171+0000 7f18b6eea640 1 -- start start 2023-10-14T09:18:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b6eea640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f18b0071f00 0x7f18b00a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b6eea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18b006ab50 0x7f18b0157a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b6eea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b0072390 con 0x7f18b0154a10 2023-10-14T09:18:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b6eea640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b00a7f70 con 0x7f18b0071f00 2023-10-14T09:18:20.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b6eea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b006d580 con 0x7f18b006ab50 2023-10-14T09:18:20.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b4c86640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f18b0154a10 0x7f18b0069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40484/0 (socket says 172.21.15.78:40484) 2023-10-14T09:18:20.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b4c86640 1 -- 172.21.15.78:0/4078511260 learned_addr learned my addr 172.21.15.78:0/4078511260 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b5487640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18b006ab50 0x7f18b0157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18affff640 1 --2- 172.21.15.78:0/4078511260 >> v2:172.21.15.157:3300/0 conn(0x7f18b0071f00 0x7f18b00a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290102492 0 0) 0x7f18b0072390 con 0x7f18b0154a10 2023-10-14T09:18:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a0003530 con 0x7f18b0154a10 2023-10-14T09:18:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1963099429 0 0) 0x7f18a0003530 con 0x7f18b0154a10 2023-10-14T09:18:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18b006ab50 msgr2=0x7f18b0157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18b006ab50 0x7f18b0157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 >> v2:172.21.15.157:3300/0 conn(0x7f18b0071f00 msgr2=0x7f18b00a8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 --2- 172.21.15.78:0/4078511260 >> v2:172.21.15.157:3300/0 conn(0x7f18b0071f00 0x7f18b00a8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b006d860 con 0x7f18b0154a10 2023-10-14T09:18:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f18a4001680 con 0x7f18b0154a10 2023-10-14T09:18:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 >> v1:172.21.15.78:6789/0 conn(0x7f18b0154a10 legacy=0x7f18b0069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18b006ab50 0x7f18a0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18a0003f00 0x7f18a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18a0004d10 0x7f18a0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00a7f70 con 0x7f18a0004d10 2023-10-14T09:18:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b006d580 con 0x7f18a0003f00 2023-10-14T09:18:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a000b9e0 con 0x7f18b006ab50 2023-10-14T09:18:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b5487640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18a0004d10 0x7f18a0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b4c86640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18b006ab50 0x7f18a0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18affff640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18a0003f00 0x7f18a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b5487640 1 -- 172.21.15.78:0/4078511260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18b006ab50 msgr2=0x7f18a0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:20.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b5487640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18b006ab50 0x7f18a0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b5487640 1 -- 172.21.15.78:0/4078511260 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18a0003f00 msgr2=0x7f18a00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:20.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b5487640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18a0003f00 0x7f18a00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.175+0000 7f18b5487640 1 -- 172.21.15.78:0/4078511260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a0003530 con 0x7f18a0004d10 2023-10-14T09:18:20.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18b5487640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18a0004d10 0x7f18a0005190 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009f90 tx=0x7f18a801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f591c8fc961ac16 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:20.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80a5bf0 con 0x7f18a0004d10 2023-10-14T09:18:20.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a800f040 con 0x7f18a0004d10 2023-10-14T09:18:20.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18af7fe640 1 -- 172.21.15.78:0/4078511260 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80ad440 con 0x7f18a0004d10 2023-10-14T09:18:20.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18b6eea640 1 -- 172.21.15.78:0/4078511260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18a0004d10 msgr2=0x7f18a0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18b6eea640 1 --2- 172.21.15.78:0/4078511260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18a0004d10 0x7f18a0005190 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009f90 tx=0x7f18a801cbe0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18b5487640 1 -- 172.21.15.78:0/4078511260 reap_dead start 2023-10-14T09:18:20.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18b6eea640 1 -- 172.21.15.78:0/4078511260 shutdown_connections 2023-10-14T09:18:20.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18b6eea640 1 -- 172.21.15.78:0/4078511260 >> 172.21.15.78:0/4078511260 conn(0x7f18b006c9c0 msgr2=0x7f18b006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:20.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18b6eea640 1 -- 172.21.15.78:0/4078511260 shutdown_connections 2023-10-14T09:18:20.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18b6eea640 1 -- 172.21.15.78:0/4078511260 wait complete. 2023-10-14T09:18:20.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18b6eea640 1 Processor -- start 2023-10-14T09:18:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.179+0000 7f18b6eea640 1 -- start start 2023-10-14T09:18:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b6eea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18a0004d10 0x7f18b0157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b6eea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b013a290 0x7f18b012e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b6eea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b0139d40 0x7f18b012ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b6eea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b013c070 con 0x7f18b0139d40 2023-10-14T09:18:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b6eea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b012f350 con 0x7f18b013a290 2023-10-14T09:18:20.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b6eea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b01ebeb0 con 0x7f18a0004d10 2023-10-14T09:18:20.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b5487640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b0139d40 0x7f18b012ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b5487640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b0139d40 0x7f18b012ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58884/0 (socket says 172.21.15.78:58884) 2023-10-14T09:18:20.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b5487640 1 -- 172.21.15.78:0/1285667924 learned_addr learned my addr 172.21.15.78:0/1285667924 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:20.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b5487640 1 -- 172.21.15.78:0/1285667924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18a0004d10 msgr2=0x7f18b0157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b5487640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18a0004d10 0x7f18b0157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b5487640 1 -- 172.21.15.78:0/1285667924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b013a290 msgr2=0x7f18b012e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b5487640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b013a290 0x7f18b012e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b5487640 1 -- 172.21.15.78:0/1285667924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b01ec190 con 0x7f18b0139d40 2023-10-14T09:18:20.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b5487640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b0139d40 0x7f18b012ee10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009f90 tx=0x7f18a8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:20.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18ad7fa640 1 -- 172.21.15.78:0/1285667924 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80bc070 con 0x7f18b0139d40 2023-10-14T09:18:20.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18ad7fa640 1 -- 172.21.15.78:0/1285667924 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a80ad710 con 0x7f18b0139d40 2023-10-14T09:18:20.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b6eea640 1 -- 172.21.15.78:0/1285667924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b01ec470 con 0x7f18b0139d40 2023-10-14T09:18:20.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18ad7fa640 1 -- 172.21.15.78:0/1285667924 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80adaa0 con 0x7f18b0139d40 2023-10-14T09:18:20.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b6eea640 1 -- 172.21.15.78:0/1285667924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b01eca30 con 0x7f18b0139d40 2023-10-14T09:18:20.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18b6eea640 1 -- 172.21.15.78:0/1285667924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b0074180 con 0x7f18b0139d40 2023-10-14T09:18:20.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.183+0000 7f18ad7fa640 1 -- 172.21.15.78:0/1285667924 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f18a80b4040 con 0x7f18b0139d40 2023-10-14T09:18:20.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.187+0000 7f18ad7fa640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f18940664a0 0x7f1894068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.187+0000 7f18ad7fa640 1 -- 172.21.15.78:0/1285667924 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f18a811e170 con 0x7f18b0139d40 2023-10-14T09:18:20.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.187+0000 7f18b4c86640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f18940664a0 0x7f1894068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.187+0000 7f18b4c86640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f18940664a0 0x7f1894068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f18a4004880 tx=0x7f18a4004810 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:20.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.191+0000 7f18ad7fa640 1 -- 172.21.15.78:0/1285667924 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f18a80eb5c0 con 0x7f18b0139d40 2023-10-14T09:18:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.339+0000 7f18b6eea640 1 -- 172.21.15.78:0/1285667924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18b006ce70 con 0x7f18b0139d40 2023-10-14T09:18:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18ad7fa640 1 -- 172.21.15.78:0/1285667924 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16589 (secure 0 0 0) 0x7f18a80a5e60 con 0x7f18b0139d40 2023-10-14T09:18:20.347 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:20.347 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":32,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:18:17.070566+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T09:18:13.661984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T09:18:15.003533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:18:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 -- 172.21.15.78:0/1285667924 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f18940664a0 msgr2=0x7f1894068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f18940664a0 0x7f1894068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f18a4004880 tx=0x7f18a4004810 comp rx=0 tx=0).stop 2023-10-14T09:18:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 -- 172.21.15.78:0/1285667924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b0139d40 msgr2=0x7f18b012ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b0139d40 0x7f18b012ee10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009f90 tx=0x7f18a8009750 comp rx=0 tx=0).stop 2023-10-14T09:18:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 -- 172.21.15.78:0/1285667924 shutdown_connections 2023-10-14T09:18:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b0139d40 0x7f18b012ee10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18b013a290 0x7f18b012e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f18940664a0 0x7f1894068960 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 --2- 172.21.15.78:0/1285667924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f18a0004d10 0x7f18b0157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 -- 172.21.15.78:0/1285667924 >> 172.21.15.78:0/1285667924 conn(0x7f18b006c9c0 msgr2=0x7f18b0156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 -- 172.21.15.78:0/1285667924 shutdown_connections 2023-10-14T09:18:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.343+0000 7f18b6eea640 1 -- 172.21.15.78:0/1285667924 wait complete. 2023-10-14T09:18:20.367 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T09:18:20.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:18:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.499+0000 7f4fb5691640 1 Processor -- start 2023-10-14T09:18:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.499+0000 7f4fb5691640 1 -- start start 2023-10-14T09:18:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fb5691640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4fb014ddb0 0x7f4fb00c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fb5691640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4fb0153e80 0x7f4fb006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fb5691640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fb00c6910 0x7f4fb00c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fb5691640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb00c64f0 con 0x7f4fb0153e80 2023-10-14T09:18:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fb5691640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb00c5300 con 0x7f4fb014ddb0 2023-10-14T09:18:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fb5691640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb006c470 con 0x7f4fb00c6910 2023-10-14T09:18:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fa7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4fb0153e80 0x7f4fb006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fa7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4fb0153e80 0x7f4fb006bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58892/0 (socket says 172.21.15.78:58892) 2023-10-14T09:18:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fa7fff640 1 -- 172.21.15.78:0/1306301922 learned_addr learned my addr 172.21.15.78:0/1306301922 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4faf7fe640 1 --2- 172.21.15.78:0/1306301922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fb00c6910 0x7f4fb00c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4faeffd640 1 --2- 172.21.15.78:0/1306301922 >> v2:172.21.15.157:3300/0 conn(0x7f4fb014ddb0 0x7f4fb00c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fa7fff640 1 -- 172.21.15.78:0/1306301922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fb00c6910 msgr2=0x7f4fb00c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:20.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fa7fff640 1 --2- 172.21.15.78:0/1306301922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fb00c6910 0x7f4fb00c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fa7fff640 1 -- 172.21.15.78:0/1306301922 >> v2:172.21.15.157:3300/0 conn(0x7f4fb014ddb0 msgr2=0x7f4fb00c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:20.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fa7fff640 1 --2- 172.21.15.78:0/1306301922 >> v2:172.21.15.157:3300/0 conn(0x7f4fb014ddb0 0x7f4fb00c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fa7fff640 1 -- 172.21.15.78:0/1306301922 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb006c750 con 0x7f4fb0153e80 2023-10-14T09:18:20.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fa7fff640 1 --2- 172.21.15.78:0/1306301922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fb0153e80 0x7f4fb006bb70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00a8d80 tx=0x7f4f9801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940b109d74b5c96d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:20.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fae7fc640 1 -- 172.21.15.78:0/1306301922 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980ab600 con 0x7f4fb0153e80 2023-10-14T09:18:20.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fae7fc640 1 -- 172.21.15.78:0/1306301922 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f980a7050 con 0x7f4fb0153e80 2023-10-14T09:18:20.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.503+0000 7f4fae7fc640 1 -- 172.21.15.78:0/1306301922 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980ab980 con 0x7f4fb0153e80 2023-10-14T09:18:20.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 -- 172.21.15.78:0/1306301922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fb0153e80 msgr2=0x7f4fb006bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 --2- 172.21.15.78:0/1306301922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fb0153e80 0x7f4fb006bb70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00a8d80 tx=0x7f4f9801c3b0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 -- 172.21.15.78:0/1306301922 shutdown_connections 2023-10-14T09:18:20.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 --2- 172.21.15.78:0/1306301922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fb0153e80 0x7f4fb006bb70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 --2- 172.21.15.78:0/1306301922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fb00c6910 0x7f4fb00c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 --2- 172.21.15.78:0/1306301922 >> v2:172.21.15.157:3300/0 conn(0x7f4fb014ddb0 0x7f4fb00c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 -- 172.21.15.78:0/1306301922 >> 172.21.15.78:0/1306301922 conn(0x7f4fb00ab1f0 msgr2=0x7f4fb00ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:20.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 -- 172.21.15.78:0/1306301922 shutdown_connections 2023-10-14T09:18:20.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 -- 172.21.15.78:0/1306301922 wait complete. 2023-10-14T09:18:20.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 Processor -- start 2023-10-14T09:18:20.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 -- start start 2023-10-14T09:18:20.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4fb00c6910 0x7f4fb0147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fb014ddb0 0x7f4fb014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fb0153e80 0x7f4fb0152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb014f670 con 0x7f4fb0153e80 2023-10-14T09:18:20.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb01ed500 con 0x7f4fb00c6910 2023-10-14T09:18:20.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fb5691640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb01eda30 con 0x7f4fb014ddb0 2023-10-14T09:18:20.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4faf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fb0153e80 0x7f4fb0152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4faf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fb0153e80 0x7f4fb0152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58906/0 (socket says 172.21.15.78:58906) 2023-10-14T09:18:20.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4faf7fe640 1 -- 172.21.15.78:0/2411987570 learned_addr learned my addr 172.21.15.78:0/2411987570 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:20.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4faeffd640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4fb00c6910 0x7f4fb0147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4fa7fff640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fb014ddb0 0x7f4fb014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4faf7fe640 1 -- 172.21.15.78:0/2411987570 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fb014ddb0 msgr2=0x7f4fb014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4faf7fe640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fb014ddb0 0x7f4fb014b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4faf7fe640 1 -- 172.21.15.78:0/2411987570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4fb00c6910 msgr2=0x7f4fb0147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4faf7fe640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4fb00c6910 0x7f4fb0147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.507+0000 7f4faf7fe640 1 -- 172.21.15.78:0/2411987570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f980094d0 con 0x7f4fb0153e80 2023-10-14T09:18:20.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.511+0000 7f4faf7fe640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fb0153e80 0x7f4fb0152970 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8007e60 tx=0x7f4fa800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:20.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.511+0000 7f4fa77fe640 1 -- 172.21.15.78:0/2411987570 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8014620 con 0x7f4fb0153e80 2023-10-14T09:18:20.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.511+0000 7f4fa77fe640 1 -- 172.21.15.78:0/2411987570 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa800ee90 con 0x7f4fb0153e80 2023-10-14T09:18:20.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.511+0000 7f4fb5691640 1 -- 172.21.15.78:0/2411987570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb0150230 con 0x7f4fb0153e80 2023-10-14T09:18:20.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.511+0000 7f4fa77fe640 1 -- 172.21.15.78:0/2411987570 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80149e0 con 0x7f4fb0153e80 2023-10-14T09:18:20.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.511+0000 7f4fb5691640 1 -- 172.21.15.78:0/2411987570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb014fbe0 con 0x7f4fb0153e80 2023-10-14T09:18:20.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.511+0000 7f4fb5691640 1 -- 172.21.15.78:0/2411987570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb01503c0 con 0x7f4fb0153e80 2023-10-14T09:18:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.511+0000 7f4fa77fe640 1 -- 172.21.15.78:0/2411987570 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4fa8014b40 con 0x7f4fb0153e80 2023-10-14T09:18:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.511+0000 7f4fa77fe640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f900664d0 0x7f4f90068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.511+0000 7f4fa77fe640 1 -- 172.21.15.78:0/2411987570 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f4fa8084650 con 0x7f4fb0153e80 2023-10-14T09:18:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.511+0000 7f4faeffd640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f900664d0 0x7f4f90068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.515+0000 7f4faeffd640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f900664d0 0x7f4f90068990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0151870 tx=0x7f4fa0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:20.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.515+0000 7f4fa77fe640 1 -- 172.21.15.78:0/2411987570 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4fa8051b50 con 0x7f4fb0153e80 2023-10-14T09:18:20.600 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-10-14T09:18:20.595+0000 7f1c5127d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T09:18:20.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.663+0000 7f4fb5691640 1 -- 172.21.15.78:0/2411987570 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fb0067000 con 0x7f4f900664d0 2023-10-14T09:18:20.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.675+0000 7f4fa77fe640 1 -- 172.21.15.78:0/2411987570 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288950 (secure 0 0 0) 0x7f4fa0010990 con 0x7f4f900664d0 2023-10-14T09:18:20.681 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-10-14T09:18:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.675+0000 7f4fb5691640 1 -- 172.21.15.78:0/2411987570 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f900664d0 msgr2=0x7f4f90068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.675+0000 7f4fb5691640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f900664d0 0x7f4f90068990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0151870 tx=0x7f4fa0008040 comp rx=0 tx=0).stop 2023-10-14T09:18:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.675+0000 7f4fb5691640 1 -- 172.21.15.78:0/2411987570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fb0153e80 msgr2=0x7f4fb0152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.675+0000 7f4fb5691640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fb0153e80 0x7f4fb0152970 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8007e60 tx=0x7f4fa800e4b0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.679+0000 7f4fb5691640 1 -- 172.21.15.78:0/2411987570 shutdown_connections 2023-10-14T09:18:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.679+0000 7f4fb5691640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fb0153e80 0x7f4fb0152970 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.679+0000 7f4fb5691640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f4f900664d0 0x7f4f90068990 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.679+0000 7f4fb5691640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4fb014ddb0 0x7f4fb014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.679+0000 7f4fb5691640 1 --2- 172.21.15.78:0/2411987570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4fb00c6910 0x7f4fb0147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.679+0000 7f4fb5691640 1 -- 172.21.15.78:0/2411987570 >> 172.21.15.78:0/2411987570 conn(0x7f4fb00ab1f0 msgr2=0x7f4fb00a9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.679+0000 7f4fb5691640 1 -- 172.21.15.78:0/2411987570 shutdown_connections 2023-10-14T09:18:20.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.679+0000 7f4fb5691640 1 -- 172.21.15.78:0/2411987570 wait complete. 2023-10-14T09:18:20.701 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-10-14T09:18:19.241988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223212,"kb_used_data":2868,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751508,"statfs":{"total":773094113280,"available":772865544192,"internally_reserved":0,"allocated":2936832,"data_stored":2258562,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.624381"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.104346+0000","last_change":"2023-10-14T09:18:16.097097+0000","last_active":"2023-10-14T09:18:16.104346+0000","last_peered":"2023-10-14T09:18:16.104346+0000","last_clean":"2023-10-14T09:18:16.104346+0000","last_became_active":"2023-10-14T09:18:16.096790+0000","last_became_peered":"2023-10-14T09:18:16.096790+0000","last_unstale":"2023-10-14T09:18:16.104346+0000","last_undegraded":"2023-10-14T09:18:16.104346+0000","last_fullsized":"2023-10-14T09:18:16.104346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:35.520331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076126+0000","last_change":"2023-10-14T09:18:16.095858+0000","last_active":"2023-10-14T09:18:17.076126+0000","last_peered":"2023-10-14T09:18:17.076126+0000","last_clean":"2023-10-14T09:18:17.076126+0000","last_became_active":"2023-10-14T09:18:16.095313+0000","last_became_peered":"2023-10-14T09:18:16.095313+0000","last_unstale":"2023-10-14T09:18:17.076126+0000","last_undegraded":"2023-10-14T09:18:17.076126+0000","last_fullsized":"2023-10-14T09:18:17.076126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:44:10.641703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076499+0000","last_change":"2023-10-14T09:18:16.081368+0000","last_active":"2023-10-14T09:18:17.076499+0000","last_peered":"2023-10-14T09:18:17.076499+0000","last_clean":"2023-10-14T09:18:17.076499+0000","last_became_active":"2023-10-14T09:18:16.081094+0000","last_became_peered":"2023-10-14T09:18:16.081094+0000","last_unstale":"2023-10-14T09:18:17.076499+0000","last_undegraded":"2023-10-14T09:18:17.076499+0000","last_fullsized":"2023-10-14T09:18:17.076499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:58.150011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212843+0000","last_change":"2023-10-14T09:18:16.081852+0000","last_active":"2023-10-14T09:18:17.212843+0000","last_peered":"2023-10-14T09:18:17.212843+0000","last_clean":"2023-10-14T09:18:17.212843+0000","last_became_active":"2023-10-14T09:18:16.080395+0000","last_became_peered":"2023-10-14T09:18:16.080395+0000","last_unstale":"2023-10-14T09:18:17.212843+0000","last_undegraded":"2023-10-14T09:18:17.212843+0000","last_fullsized":"2023-10-14T09:18:17.212843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:56.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100265+0000","last_change":"2023-10-14T09:18:16.095464+0000","last_active":"2023-10-14T09:18:16.100265+0000","last_peered":"2023-10-14T09:18:16.100265+0000","last_clean":"2023-10-14T09:18:16.100265+0000","last_became_active":"2023-10-14T09:18:16.095184+0000","last_became_peered":"2023-10-14T09:18:16.095184+0000","last_unstale":"2023-10-14T09:18:16.100265+0000","last_undegraded":"2023-10-14T09:18:16.100265+0000","last_fullsized":"2023-10-14T09:18:16.100265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:04.516670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076138+0000","last_change":"2023-10-14T09:18:16.099298+0000","last_active":"2023-10-14T09:18:17.076138+0000","last_peered":"2023-10-14T09:18:17.076138+0000","last_clean":"2023-10-14T09:18:17.076138+0000","last_became_active":"2023-10-14T09:18:16.099013+0000","last_became_peered":"2023-10-14T09:18:16.099013+0000","last_unstale":"2023-10-14T09:18:17.076138+0000","last_undegraded":"2023-10-14T09:18:17.076138+0000","last_fullsized":"2023-10-14T09:18:17.076138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:02.104346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.105327+0000","last_change":"2023-10-14T09:18:16.102115+0000","last_active":"2023-10-14T09:18:16.105327+0000","last_peered":"2023-10-14T09:18:16.105327+0000","last_clean":"2023-10-14T09:18:16.105327+0000","last_became_active":"2023-10-14T09:18:16.101797+0000","last_became_peered":"2023-10-14T09:18:16.101797+0000","last_unstale":"2023-10-14T09:18:16.105327+0000","last_undegraded":"2023-10-14T09:18:16.105327+0000","last_fullsized":"2023-10-14T09:18:16.105327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:12.073123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103860+0000","last_change":"2023-10-14T09:18:16.097221+0000","last_active":"2023-10-14T09:18:16.103860+0000","last_peered":"2023-10-14T09:18:16.103860+0000","last_clean":"2023-10-14T09:18:16.103860+0000","last_became_active":"2023-10-14T09:18:16.095180+0000","last_became_peered":"2023-10-14T09:18:16.095180+0000","last_unstale":"2023-10-14T09:18:16.103860+0000","last_undegraded":"2023-10-14T09:18:16.103860+0000","last_fullsized":"2023-10-14T09:18:16.103860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:13.191684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077854+0000","last_change":"2023-10-14T09:18:16.084927+0000","last_active":"2023-10-14T09:18:17.077854+0000","last_peered":"2023-10-14T09:18:17.077854+0000","last_clean":"2023-10-14T09:18:17.077854+0000","last_became_active":"2023-10-14T09:18:16.084629+0000","last_became_peered":"2023-10-14T09:18:16.084629+0000","last_unstale":"2023-10-14T09:18:17.077854+0000","last_undegraded":"2023-10-14T09:18:17.077854+0000","last_fullsized":"2023-10-14T09:18:17.077854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:56.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213015+0000","last_change":"2023-10-14T09:18:16.093720+0000","last_active":"2023-10-14T09:18:17.213015+0000","last_peered":"2023-10-14T09:18:17.213015+0000","last_clean":"2023-10-14T09:18:17.213015+0000","last_became_active":"2023-10-14T09:18:16.092225+0000","last_became_peered":"2023-10-14T09:18:16.092225+0000","last_unstale":"2023-10-14T09:18:17.213015+0000","last_undegraded":"2023-10-14T09:18:17.213015+0000","last_fullsized":"2023-10-14T09:18:17.213015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:08:04.840122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.104494+0000","last_change":"2023-10-14T09:18:16.097701+0000","last_active":"2023-10-14T09:18:16.104494+0000","last_peered":"2023-10-14T09:18:16.104494+0000","last_clean":"2023-10-14T09:18:16.104494+0000","last_became_active":"2023-10-14T09:18:16.097422+0000","last_became_peered":"2023-10-14T09:18:16.097422+0000","last_unstale":"2023-10-14T09:18:16.104494+0000","last_undegraded":"2023-10-14T09:18:16.104494+0000","last_fullsized":"2023-10-14T09:18:16.104494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:42.840106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076352+0000","last_change":"2023-10-14T09:18:16.091436+0000","last_active":"2023-10-14T09:18:17.076352+0000","last_peered":"2023-10-14T09:18:17.076352+0000","last_clean":"2023-10-14T09:18:17.076352+0000","last_became_active":"2023-10-14T09:18:16.091165+0000","last_became_peered":"2023-10-14T09:18:16.091165+0000","last_unstale":"2023-10-14T09:18:17.076352+0000","last_undegraded":"2023-10-14T09:18:17.076352+0000","last_fullsized":"2023-10-14T09:18:17.076352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:48:48.009344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.084802+0000","last_change":"2023-10-14T09:18:16.082495+0000","last_active":"2023-10-14T09:18:16.084802+0000","last_peered":"2023-10-14T09:18:16.084802+0000","last_clean":"2023-10-14T09:18:16.084802+0000","last_became_active":"2023-10-14T09:18:16.082240+0000","last_became_peered":"2023-10-14T09:18:16.082240+0000","last_unstale":"2023-10-14T09:18:16.084802+0000","last_undegraded":"2023-10-14T09:18:16.084802+0000","last_fullsized":"2023-10-14T09:18:16.084802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:48.135497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076250+0000","last_change":"2023-10-14T09:18:16.089148+0000","last_active":"2023-10-14T09:18:17.076250+0000","last_peered":"2023-10-14T09:18:17.076250+0000","last_clean":"2023-10-14T09:18:17.076250+0000","last_became_active":"2023-10-14T09:18:16.088775+0000","last_became_peered":"2023-10-14T09:18:16.088775+0000","last_unstale":"2023-10-14T09:18:17.076250+0000","last_undegraded":"2023-10-14T09:18:17.076250+0000","last_fullsized":"2023-10-14T09:18:17.076250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:29.617795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076810+0000","last_change":"2023-10-14T09:18:16.093001+0000","last_active":"2023-10-14T09:18:17.076810+0000","last_peered":"2023-10-14T09:18:17.076810+0000","last_clean":"2023-10-14T09:18:17.076810+0000","last_became_active":"2023-10-14T09:18:16.092713+0000","last_became_peered":"2023-10-14T09:18:16.092713+0000","last_unstale":"2023-10-14T09:18:17.076810+0000","last_undegraded":"2023-10-14T09:18:17.076810+0000","last_fullsized":"2023-10-14T09:18:17.076810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:42.385871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.105294+0000","last_change":"2023-10-14T09:18:16.099921+0000","last_active":"2023-10-14T09:18:16.105294+0000","last_peered":"2023-10-14T09:18:16.105294+0000","last_clean":"2023-10-14T09:18:16.105294+0000","last_became_active":"2023-10-14T09:18:16.099620+0000","last_became_peered":"2023-10-14T09:18:16.099620+0000","last_unstale":"2023-10-14T09:18:16.105294+0000","last_undegraded":"2023-10-14T09:18:16.105294+0000","last_fullsized":"2023-10-14T09:18:16.105294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:16:05.657118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.105319+0000","last_change":"2023-10-14T09:18:16.102107+0000","last_active":"2023-10-14T09:18:16.105319+0000","last_peered":"2023-10-14T09:18:16.105319+0000","last_clean":"2023-10-14T09:18:16.105319+0000","last_became_active":"2023-10-14T09:18:16.101819+0000","last_became_peered":"2023-10-14T09:18:16.101819+0000","last_unstale":"2023-10-14T09:18:16.105319+0000","last_undegraded":"2023-10-14T09:18:16.105319+0000","last_fullsized":"2023-10-14T09:18:16.105319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:56.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076133+0000","last_change":"2023-10-14T09:18:16.089991+0000","last_active":"2023-10-14T09:18:17.076133+0000","last_peered":"2023-10-14T09:18:17.076133+0000","last_clean":"2023-10-14T09:18:17.076133+0000","last_became_active":"2023-10-14T09:18:16.089764+0000","last_became_peered":"2023-10-14T09:18:16.089764+0000","last_unstale":"2023-10-14T09:18:17.076133+0000","last_undegraded":"2023-10-14T09:18:17.076133+0000","last_fullsized":"2023-10-14T09:18:17.076133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:40:37.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075883+0000","last_change":"2023-10-14T09:18:16.093748+0000","last_active":"2023-10-14T09:18:17.075883+0000","last_peered":"2023-10-14T09:18:17.075883+0000","last_clean":"2023-10-14T09:18:17.075883+0000","last_became_active":"2023-10-14T09:18:16.093511+0000","last_became_peered":"2023-10-14T09:18:16.093511+0000","last_unstale":"2023-10-14T09:18:17.075883+0000","last_undegraded":"2023-10-14T09:18:17.075883+0000","last_fullsized":"2023-10-14T09:18:17.075883+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:42.385871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.097322+0000","last_change":"2023-10-14T09:18:16.094566+0000","last_active":"2023-10-14T09:18:16.097322+0000","last_peered":"2023-10-14T09:18:16.097322+0000","last_clean":"2023-10-14T09:18:16.097322+0000","last_became_active":"2023-10-14T09:18:16.094267+0000","last_became_peered":"2023-10-14T09:18:16.094267+0000","last_unstale":"2023-10-14T09:18:16.097322+0000","last_undegraded":"2023-10-14T09:18:16.097322+0000","last_fullsized":"2023-10-14T09:18:16.097322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:37:46.847050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077345+0000","last_change":"2023-10-14T09:18:16.095144+0000","last_active":"2023-10-14T09:18:17.077345+0000","last_peered":"2023-10-14T09:18:17.077345+0000","last_clean":"2023-10-14T09:18:17.077345+0000","last_became_active":"2023-10-14T09:18:16.094798+0000","last_became_peered":"2023-10-14T09:18:16.094798+0000","last_unstale":"2023-10-14T09:18:17.077345+0000","last_undegraded":"2023-10-14T09:18:17.077345+0000","last_fullsized":"2023-10-14T09:18:17.077345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:16:05.657118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077293+0000","last_change":"2023-10-14T09:18:16.091458+0000","last_active":"2023-10-14T09:18:17.077293+0000","last_peered":"2023-10-14T09:18:17.077293+0000","last_clean":"2023-10-14T09:18:17.077293+0000","last_became_active":"2023-10-14T09:18:16.089533+0000","last_became_peered":"2023-10-14T09:18:16.089533+0000","last_unstale":"2023-10-14T09:18:17.077293+0000","last_undegraded":"2023-10-14T09:18:17.077293+0000","last_fullsized":"2023-10-14T09:18:17.077293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:16:40.775027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.108943+0000","last_change":"2023-10-14T09:18:16.102753+0000","last_active":"2023-10-14T09:18:16.108943+0000","last_peered":"2023-10-14T09:18:16.108943+0000","last_clean":"2023-10-14T09:18:16.108943+0000","last_became_active":"2023-10-14T09:18:16.102473+0000","last_became_peered":"2023-10-14T09:18:16.102473+0000","last_unstale":"2023-10-14T09:18:16.108943+0000","last_undegraded":"2023-10-14T09:18:16.108943+0000","last_fullsized":"2023-10-14T09:18:16.108943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:07.615677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076100+0000","last_change":"2023-10-14T09:18:16.082186+0000","last_active":"2023-10-14T09:18:17.076100+0000","last_peered":"2023-10-14T09:18:17.076100+0000","last_clean":"2023-10-14T09:18:17.076100+0000","last_became_active":"2023-10-14T09:18:16.081561+0000","last_became_peered":"2023-10-14T09:18:16.081561+0000","last_unstale":"2023-10-14T09:18:17.076100+0000","last_undegraded":"2023-10-14T09:18:17.076100+0000","last_fullsized":"2023-10-14T09:18:17.076100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:08:04.840122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213100+0000","last_change":"2023-10-14T09:18:16.097740+0000","last_active":"2023-10-14T09:18:17.213100+0000","last_peered":"2023-10-14T09:18:17.213100+0000","last_clean":"2023-10-14T09:18:17.213100+0000","last_became_active":"2023-10-14T09:18:16.097491+0000","last_became_peered":"2023-10-14T09:18:16.097491+0000","last_unstale":"2023-10-14T09:18:17.213100+0000","last_undegraded":"2023-10-14T09:18:17.213100+0000","last_fullsized":"2023-10-14T09:18:17.213100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:42:48.390583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076253+0000","last_change":"2023-10-14T09:18:16.096089+0000","last_active":"2023-10-14T09:18:17.076253+0000","last_peered":"2023-10-14T09:18:17.076253+0000","last_clean":"2023-10-14T09:18:17.076253+0000","last_became_active":"2023-10-14T09:18:16.095627+0000","last_became_peered":"2023-10-14T09:18:16.095627+0000","last_unstale":"2023-10-14T09:18:17.076253+0000","last_undegraded":"2023-10-14T09:18:17.076253+0000","last_fullsized":"2023-10-14T09:18:17.076253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:48:13.538402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213031+0000","last_change":"2023-10-14T09:18:16.085305+0000","last_active":"2023-10-14T09:18:17.213031+0000","last_peered":"2023-10-14T09:18:17.213031+0000","last_clean":"2023-10-14T09:18:17.213031+0000","last_became_active":"2023-10-14T09:18:16.084749+0000","last_became_peered":"2023-10-14T09:18:16.084749+0000","last_unstale":"2023-10-14T09:18:17.213031+0000","last_undegraded":"2023-10-14T09:18:17.213031+0000","last_fullsized":"2023-10-14T09:18:17.213031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:59.090596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076501+0000","last_change":"2023-10-14T09:18:16.092125+0000","last_active":"2023-10-14T09:18:17.076501+0000","last_peered":"2023-10-14T09:18:17.076501+0000","last_clean":"2023-10-14T09:18:17.076501+0000","last_became_active":"2023-10-14T09:18:16.091787+0000","last_became_peered":"2023-10-14T09:18:16.091787+0000","last_unstale":"2023-10-14T09:18:17.076501+0000","last_undegraded":"2023-10-14T09:18:17.076501+0000","last_fullsized":"2023-10-14T09:18:17.076501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:36.911030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077237+0000","last_change":"2023-10-14T09:18:16.095770+0000","last_active":"2023-10-14T09:18:17.077237+0000","last_peered":"2023-10-14T09:18:17.077237+0000","last_clean":"2023-10-14T09:18:17.077237+0000","last_became_active":"2023-10-14T09:18:16.095489+0000","last_became_peered":"2023-10-14T09:18:16.095489+0000","last_unstale":"2023-10-14T09:18:17.077237+0000","last_undegraded":"2023-10-14T09:18:17.077237+0000","last_fullsized":"2023-10-14T09:18:17.077237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:48.724422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103835+0000","last_change":"2023-10-14T09:18:16.097179+0000","last_active":"2023-10-14T09:18:16.103835+0000","last_peered":"2023-10-14T09:18:16.103835+0000","last_clean":"2023-10-14T09:18:16.103835+0000","last_became_active":"2023-10-14T09:18:16.096288+0000","last_became_peered":"2023-10-14T09:18:16.096288+0000","last_unstale":"2023-10-14T09:18:16.103835+0000","last_undegraded":"2023-10-14T09:18:16.103835+0000","last_fullsized":"2023-10-14T09:18:16.103835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:56.229459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100499+0000","last_change":"2023-10-14T09:18:16.091488+0000","last_active":"2023-10-14T09:18:16.100499+0000","last_peered":"2023-10-14T09:18:16.100499+0000","last_clean":"2023-10-14T09:18:16.100499+0000","last_became_active":"2023-10-14T09:18:16.091148+0000","last_became_peered":"2023-10-14T09:18:16.091148+0000","last_unstale":"2023-10-14T09:18:16.100499+0000","last_undegraded":"2023-10-14T09:18:16.100499+0000","last_fullsized":"2023-10-14T09:18:16.100499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:45.334110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103947+0000","last_change":"2023-10-14T09:18:16.098238+0000","last_active":"2023-10-14T09:18:16.103947+0000","last_peered":"2023-10-14T09:18:16.103947+0000","last_clean":"2023-10-14T09:18:16.103947+0000","last_became_active":"2023-10-14T09:18:16.097903+0000","last_became_peered":"2023-10-14T09:18:16.097903+0000","last_unstale":"2023-10-14T09:18:16.103947+0000","last_undegraded":"2023-10-14T09:18:16.103947+0000","last_fullsized":"2023-10-14T09:18:16.103947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:48.724422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.108923+0000","last_change":"2023-10-14T09:18:16.102695+0000","last_active":"2023-10-14T09:18:16.108923+0000","last_peered":"2023-10-14T09:18:16.108923+0000","last_clean":"2023-10-14T09:18:16.108923+0000","last_became_active":"2023-10-14T09:18:16.102419+0000","last_became_peered":"2023-10-14T09:18:16.102419+0000","last_unstale":"2023-10-14T09:18:16.108923+0000","last_undegraded":"2023-10-14T09:18:16.108923+0000","last_fullsized":"2023-10-14T09:18:16.108923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:35.520331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.644159+0000","last_change":"2023-10-14T09:18:15.646487+0000","last_active":"2023-10-14T09:18:16.644159+0000","last_peered":"2023-10-14T09:18:16.644159+0000","last_clean":"2023-10-14T09:18:16.644159+0000","last_became_active":"2023-10-14T09:18:15.646216+0000","last_became_peered":"2023-10-14T09:18:15.646216+0000","last_unstale":"2023-10-14T09:18:16.644159+0000","last_undegraded":"2023-10-14T09:18:16.644159+0000","last_fullsized":"2023-10-14T09:18:16.644159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:54.244172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103264+0000","last_change":"2023-10-14T09:18:16.094519+0000","last_active":"2023-10-14T09:18:16.103264+0000","last_peered":"2023-10-14T09:18:16.103264+0000","last_clean":"2023-10-14T09:18:16.103264+0000","last_became_active":"2023-10-14T09:18:16.094246+0000","last_became_peered":"2023-10-14T09:18:16.094246+0000","last_unstale":"2023-10-14T09:18:16.103264+0000","last_undegraded":"2023-10-14T09:18:16.103264+0000","last_fullsized":"2023-10-14T09:18:16.103264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:07.615677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.646696+0000","last_change":"2023-10-14T09:18:15.644538+0000","last_active":"2023-10-14T09:18:16.646696+0000","last_peered":"2023-10-14T09:18:16.646696+0000","last_clean":"2023-10-14T09:18:16.646696+0000","last_became_active":"2023-10-14T09:18:15.644259+0000","last_became_peered":"2023-10-14T09:18:15.644259+0000","last_unstale":"2023-10-14T09:18:16.646696+0000","last_undegraded":"2023-10-14T09:18:16.646696+0000","last_fullsized":"2023-10-14T09:18:16.646696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:17:55.922842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077805+0000","last_change":"2023-10-14T09:18:16.091773+0000","last_active":"2023-10-14T09:18:17.077805+0000","last_peered":"2023-10-14T09:18:17.077805+0000","last_clean":"2023-10-14T09:18:17.077805+0000","last_became_active":"2023-10-14T09:18:16.091545+0000","last_became_peered":"2023-10-14T09:18:16.091545+0000","last_unstale":"2023-10-14T09:18:17.077805+0000","last_undegraded":"2023-10-14T09:18:17.077805+0000","last_fullsized":"2023-10-14T09:18:17.077805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:36.715992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075782+0000","last_change":"2023-10-14T09:18:15.644414+0000","last_active":"2023-10-14T09:18:17.075782+0000","last_peered":"2023-10-14T09:18:17.075782+0000","last_clean":"2023-10-14T09:18:17.075782+0000","last_became_active":"2023-10-14T09:18:15.643570+0000","last_became_peered":"2023-10-14T09:18:15.643570+0000","last_unstale":"2023-10-14T09:18:17.075782+0000","last_undegraded":"2023-10-14T09:18:17.075782+0000","last_fullsized":"2023-10-14T09:18:17.075782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:57.140667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213051+0000","last_change":"2023-10-14T09:18:16.085530+0000","last_active":"2023-10-14T09:18:17.213051+0000","last_peered":"2023-10-14T09:18:17.213051+0000","last_clean":"2023-10-14T09:18:17.213051+0000","last_became_active":"2023-10-14T09:18:16.085055+0000","last_became_peered":"2023-10-14T09:18:16.085055+0000","last_unstale":"2023-10-14T09:18:17.213051+0000","last_undegraded":"2023-10-14T09:18:17.213051+0000","last_fullsized":"2023-10-14T09:18:17.213051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:48:48.009344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.648910+0000","last_change":"2023-10-14T09:18:15.635078+0000","last_active":"2023-10-14T09:18:16.648910+0000","last_peered":"2023-10-14T09:18:16.648910+0000","last_clean":"2023-10-14T09:18:16.648910+0000","last_became_active":"2023-10-14T09:18:15.634790+0000","last_became_peered":"2023-10-14T09:18:15.634790+0000","last_unstale":"2023-10-14T09:18:16.648910+0000","last_undegraded":"2023-10-14T09:18:16.648910+0000","last_fullsized":"2023-10-14T09:18:16.648910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:41.382756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100687+0000","last_change":"2023-10-14T09:18:16.094185+0000","last_active":"2023-10-14T09:18:16.100687+0000","last_peered":"2023-10-14T09:18:16.100687+0000","last_clean":"2023-10-14T09:18:16.100687+0000","last_became_active":"2023-10-14T09:18:16.093808+0000","last_became_peered":"2023-10-14T09:18:16.093808+0000","last_unstale":"2023-10-14T09:18:16.100687+0000","last_undegraded":"2023-10-14T09:18:16.100687+0000","last_fullsized":"2023-10-14T09:18:16.100687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:30.113496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077431+0000","last_change":"2023-10-14T09:18:15.645012+0000","last_active":"2023-10-14T09:18:17.077431+0000","last_peered":"2023-10-14T09:18:17.077431+0000","last_clean":"2023-10-14T09:18:17.077431+0000","last_became_active":"2023-10-14T09:18:15.644700+0000","last_became_peered":"2023-10-14T09:18:15.644700+0000","last_unstale":"2023-10-14T09:18:17.077431+0000","last_undegraded":"2023-10-14T09:18:17.077431+0000","last_fullsized":"2023-10-14T09:18:17.077431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:33:26.039696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076403+0000","last_change":"2023-10-14T09:18:16.102238+0000","last_active":"2023-10-14T09:18:17.076403+0000","last_peered":"2023-10-14T09:18:17.076403+0000","last_clean":"2023-10-14T09:18:17.076403+0000","last_became_active":"2023-10-14T09:18:16.101381+0000","last_became_peered":"2023-10-14T09:18:16.101381+0000","last_unstale":"2023-10-14T09:18:17.076403+0000","last_undegraded":"2023-10-14T09:18:17.076403+0000","last_fullsized":"2023-10-14T09:18:17.076403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:42:48.390583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077389+0000","last_change":"2023-10-14T09:18:15.647382+0000","last_active":"2023-10-14T09:18:17.077389+0000","last_peered":"2023-10-14T09:18:17.077389+0000","last_clean":"2023-10-14T09:18:17.077389+0000","last_became_active":"2023-10-14T09:18:15.647076+0000","last_became_peered":"2023-10-14T09:18:15.647076+0000","last_unstale":"2023-10-14T09:18:17.077389+0000","last_undegraded":"2023-10-14T09:18:17.077389+0000","last_fullsized":"2023-10-14T09:18:17.077389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:55.220115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076222+0000","last_change":"2023-10-14T09:18:16.095441+0000","last_active":"2023-10-14T09:18:17.076222+0000","last_peered":"2023-10-14T09:18:17.076222+0000","last_clean":"2023-10-14T09:18:17.076222+0000","last_became_active":"2023-10-14T09:18:16.095085+0000","last_became_peered":"2023-10-14T09:18:16.095085+0000","last_unstale":"2023-10-14T09:18:17.076222+0000","last_undegraded":"2023-10-14T09:18:17.076222+0000","last_fullsized":"2023-10-14T09:18:17.076222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:12.073123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076325+0000","last_change":"2023-10-14T09:18:15.641580+0000","last_active":"2023-10-14T09:18:17.076325+0000","last_peered":"2023-10-14T09:18:17.076325+0000","last_clean":"2023-10-14T09:18:17.076325+0000","last_became_active":"2023-10-14T09:18:15.641312+0000","last_became_peered":"2023-10-14T09:18:15.641312+0000","last_unstale":"2023-10-14T09:18:17.076325+0000","last_undegraded":"2023-10-14T09:18:17.076325+0000","last_fullsized":"2023-10-14T09:18:17.076325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:35.706648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212568+0000","last_change":"2023-10-14T09:18:16.079511+0000","last_active":"2023-10-14T09:18:17.212568+0000","last_peered":"2023-10-14T09:18:17.212568+0000","last_clean":"2023-10-14T09:18:17.212568+0000","last_became_active":"2023-10-14T09:18:16.079263+0000","last_became_peered":"2023-10-14T09:18:16.079263+0000","last_unstale":"2023-10-14T09:18:17.212568+0000","last_undegraded":"2023-10-14T09:18:17.212568+0000","last_fullsized":"2023-10-14T09:18:17.212568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:42.840106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076305+0000","last_change":"2023-10-14T09:18:15.641614+0000","last_active":"2023-10-14T09:18:17.076305+0000","last_peered":"2023-10-14T09:18:17.076305+0000","last_clean":"2023-10-14T09:18:17.076305+0000","last_became_active":"2023-10-14T09:18:15.641300+0000","last_became_peered":"2023-10-14T09:18:15.641300+0000","last_unstale":"2023-10-14T09:18:17.076305+0000","last_undegraded":"2023-10-14T09:18:17.076305+0000","last_fullsized":"2023-10-14T09:18:17.076305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:06.606333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076842+0000","last_change":"2023-10-14T09:18:16.092182+0000","last_active":"2023-10-14T09:18:17.076842+0000","last_peered":"2023-10-14T09:18:17.076842+0000","last_clean":"2023-10-14T09:18:17.076842+0000","last_became_active":"2023-10-14T09:18:16.091048+0000","last_became_peered":"2023-10-14T09:18:16.091048+0000","last_unstale":"2023-10-14T09:18:17.076842+0000","last_undegraded":"2023-10-14T09:18:17.076842+0000","last_fullsized":"2023-10-14T09:18:17.076842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:29.382077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076204+0000","last_change":"2023-10-14T09:18:15.648736+0000","last_active":"2023-10-14T09:18:17.076204+0000","last_peered":"2023-10-14T09:18:17.076204+0000","last_clean":"2023-10-14T09:18:17.076204+0000","last_became_active":"2023-10-14T09:18:15.647638+0000","last_became_peered":"2023-10-14T09:18:15.647638+0000","last_unstale":"2023-10-14T09:18:17.076204+0000","last_undegraded":"2023-10-14T09:18:17.076204+0000","last_fullsized":"2023-10-14T09:18:17.076204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:08:14.479468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076197+0000","last_change":"2023-10-14T09:18:16.091742+0000","last_active":"2023-10-14T09:18:17.076197+0000","last_peered":"2023-10-14T09:18:17.076197+0000","last_clean":"2023-10-14T09:18:17.076197+0000","last_became_active":"2023-10-14T09:18:16.091486+0000","last_became_peered":"2023-10-14T09:18:16.091486+0000","last_unstale":"2023-10-14T09:18:17.076197+0000","last_undegraded":"2023-10-14T09:18:17.076197+0000","last_fullsized":"2023-10-14T09:18:17.076197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:19:40.360848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.097447+0000","last_change":"2023-10-14T09:18:15.649031+0000","last_active":"2023-10-14T09:18:16.097447+0000","last_peered":"2023-10-14T09:18:16.097447+0000","last_clean":"2023-10-14T09:18:16.097447+0000","last_became_active":"2023-10-14T09:18:15.648728+0000","last_became_peered":"2023-10-14T09:18:15.648728+0000","last_unstale":"2023-10-14T09:18:16.097447+0000","last_undegraded":"2023-10-14T09:18:16.097447+0000","last_fullsized":"2023-10-14T09:18:16.097447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:55.220115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075976+0000","last_change":"2023-10-14T09:18:16.101940+0000","last_active":"2023-10-14T09:18:17.075976+0000","last_peered":"2023-10-14T09:18:17.075976+0000","last_clean":"2023-10-14T09:18:17.075976+0000","last_became_active":"2023-10-14T09:18:16.101669+0000","last_became_peered":"2023-10-14T09:18:16.101669+0000","last_unstale":"2023-10-14T09:18:17.075976+0000","last_undegraded":"2023-10-14T09:18:17.075976+0000","last_fullsized":"2023-10-14T09:18:17.075976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:02:03.688166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076647+0000","last_change":"2023-10-14T09:18:15.644516+0000","last_active":"2023-10-14T09:18:17.076647+0000","last_peered":"2023-10-14T09:18:17.076647+0000","last_clean":"2023-10-14T09:18:17.076647+0000","last_became_active":"2023-10-14T09:18:15.644038+0000","last_became_peered":"2023-10-14T09:18:15.644038+0000","last_unstale":"2023-10-14T09:18:17.076647+0000","last_undegraded":"2023-10-14T09:18:17.076647+0000","last_fullsized":"2023-10-14T09:18:17.076647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:08:14.479468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076239+0000","last_change":"2023-10-14T09:18:16.083379+0000","last_active":"2023-10-14T09:18:17.076239+0000","last_peered":"2023-10-14T09:18:17.076239+0000","last_clean":"2023-10-14T09:18:17.076239+0000","last_became_active":"2023-10-14T09:18:16.083012+0000","last_became_peered":"2023-10-14T09:18:16.083012+0000","last_unstale":"2023-10-14T09:18:17.076239+0000","last_undegraded":"2023-10-14T09:18:17.076239+0000","last_fullsized":"2023-10-14T09:18:17.076239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:59.090596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076040+0000","last_change":"2023-10-14T09:18:15.643721+0000","last_active":"2023-10-14T09:18:17.076040+0000","last_peered":"2023-10-14T09:18:17.076040+0000","last_clean":"2023-10-14T09:18:17.076040+0000","last_became_active":"2023-10-14T09:18:15.643390+0000","last_became_peered":"2023-10-14T09:18:15.643390+0000","last_unstale":"2023-10-14T09:18:17.076040+0000","last_undegraded":"2023-10-14T09:18:17.076040+0000","last_fullsized":"2023-10-14T09:18:17.076040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:58.081252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212599+0000","last_change":"2023-10-14T09:18:16.079176+0000","last_active":"2023-10-14T09:18:17.212599+0000","last_peered":"2023-10-14T09:18:17.212599+0000","last_clean":"2023-10-14T09:18:17.212599+0000","last_became_active":"2023-10-14T09:18:16.078895+0000","last_became_peered":"2023-10-14T09:18:16.078895+0000","last_unstale":"2023-10-14T09:18:17.212599+0000","last_undegraded":"2023-10-14T09:18:17.212599+0000","last_fullsized":"2023-10-14T09:18:17.212599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:36.715992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077487+0000","last_change":"2023-10-14T09:18:15.641465+0000","last_active":"2023-10-14T09:18:17.077487+0000","last_peered":"2023-10-14T09:18:17.077487+0000","last_clean":"2023-10-14T09:18:17.077487+0000","last_became_active":"2023-10-14T09:18:15.641180+0000","last_became_peered":"2023-10-14T09:18:15.641180+0000","last_unstale":"2023-10-14T09:18:17.077487+0000","last_undegraded":"2023-10-14T09:18:17.077487+0000","last_fullsized":"2023-10-14T09:18:17.077487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:34.510987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075927+0000","last_change":"2023-10-14T09:18:16.098530+0000","last_active":"2023-10-14T09:18:17.075927+0000","last_peered":"2023-10-14T09:18:17.075927+0000","last_clean":"2023-10-14T09:18:17.075927+0000","last_became_active":"2023-10-14T09:18:16.098087+0000","last_became_peered":"2023-10-14T09:18:16.098087+0000","last_unstale":"2023-10-14T09:18:17.075927+0000","last_undegraded":"2023-10-14T09:18:17.075927+0000","last_fullsized":"2023-10-14T09:18:17.075927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:29.382077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212567+0000","last_change":"2023-10-14T09:18:15.632702+0000","last_active":"2023-10-14T09:18:17.212567+0000","last_peered":"2023-10-14T09:18:17.212567+0000","last_clean":"2023-10-14T09:18:17.212567+0000","last_became_active":"2023-10-14T09:18:15.632439+0000","last_became_peered":"2023-10-14T09:18:15.632439+0000","last_unstale":"2023-10-14T09:18:17.212567+0000","last_undegraded":"2023-10-14T09:18:17.212567+0000","last_fullsized":"2023-10-14T09:18:17.212567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:17:55.922842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103908+0000","last_change":"2023-10-14T09:18:16.097833+0000","last_active":"2023-10-14T09:18:16.103908+0000","last_peered":"2023-10-14T09:18:16.103908+0000","last_clean":"2023-10-14T09:18:16.103908+0000","last_became_active":"2023-10-14T09:18:16.097560+0000","last_became_peered":"2023-10-14T09:18:16.097560+0000","last_unstale":"2023-10-14T09:18:16.103908+0000","last_undegraded":"2023-10-14T09:18:16.103908+0000","last_fullsized":"2023-10-14T09:18:16.103908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:16:40.775027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076368+0000","last_change":"2023-10-14T09:18:15.649710+0000","last_active":"2023-10-14T09:18:17.076368+0000","last_peered":"2023-10-14T09:18:17.076368+0000","last_clean":"2023-10-14T09:18:17.076368+0000","last_became_active":"2023-10-14T09:18:15.645572+0000","last_became_peered":"2023-10-14T09:18:15.645572+0000","last_unstale":"2023-10-14T09:18:17.076368+0000","last_undegraded":"2023-10-14T09:18:17.076368+0000","last_fullsized":"2023-10-14T09:18:17.076368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:55.957212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100518+0000","last_change":"2023-10-14T09:18:16.091524+0000","last_active":"2023-10-14T09:18:16.100518+0000","last_peered":"2023-10-14T09:18:16.100518+0000","last_clean":"2023-10-14T09:18:16.100518+0000","last_became_active":"2023-10-14T09:18:16.091187+0000","last_became_peered":"2023-10-14T09:18:16.091187+0000","last_unstale":"2023-10-14T09:18:16.100518+0000","last_undegraded":"2023-10-14T09:18:16.100518+0000","last_fullsized":"2023-10-14T09:18:16.100518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:14.031144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075626+0000","last_change":"2023-10-14T09:18:15.639843+0000","last_active":"2023-10-14T09:18:17.075626+0000","last_peered":"2023-10-14T09:18:17.075626+0000","last_clean":"2023-10-14T09:18:17.075626+0000","last_became_active":"2023-10-14T09:18:15.638599+0000","last_became_peered":"2023-10-14T09:18:15.638599+0000","last_unstale":"2023-10-14T09:18:17.075626+0000","last_undegraded":"2023-10-14T09:18:17.075626+0000","last_fullsized":"2023-10-14T09:18:17.075626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:11.063779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077760+0000","last_change":"2023-10-14T09:18:16.082550+0000","last_active":"2023-10-14T09:18:17.077760+0000","last_peered":"2023-10-14T09:18:17.077760+0000","last_clean":"2023-10-14T09:18:17.077760+0000","last_became_active":"2023-10-14T09:18:16.082125+0000","last_became_peered":"2023-10-14T09:18:16.082125+0000","last_unstale":"2023-10-14T09:18:17.077760+0000","last_undegraded":"2023-10-14T09:18:17.077760+0000","last_fullsized":"2023-10-14T09:18:17.077760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:42.840106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213132+0000","last_change":"2023-10-14T09:18:15.647930+0000","last_active":"2023-10-14T09:18:17.213132+0000","last_peered":"2023-10-14T09:18:17.213132+0000","last_clean":"2023-10-14T09:18:17.213132+0000","last_became_active":"2023-10-14T09:18:15.645974+0000","last_became_peered":"2023-10-14T09:18:15.645974+0000","last_unstale":"2023-10-14T09:18:17.213132+0000","last_undegraded":"2023-10-14T09:18:17.213132+0000","last_fullsized":"2023-10-14T09:18:17.213132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:29.104151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076882+0000","last_change":"2023-10-14T09:18:16.086619+0000","last_active":"2023-10-14T09:18:17.076882+0000","last_peered":"2023-10-14T09:18:17.076882+0000","last_clean":"2023-10-14T09:18:17.076882+0000","last_became_active":"2023-10-14T09:18:16.086211+0000","last_became_peered":"2023-10-14T09:18:16.086211+0000","last_unstale":"2023-10-14T09:18:17.076882+0000","last_undegraded":"2023-10-14T09:18:17.076882+0000","last_fullsized":"2023-10-14T09:18:17.076882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:02:03.688166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077723+0000","last_change":"2023-10-14T09:18:15.639362+0000","last_active":"2023-10-14T09:18:17.077723+0000","last_peered":"2023-10-14T09:18:17.077723+0000","last_clean":"2023-10-14T09:18:17.077723+0000","last_became_active":"2023-10-14T09:18:15.639100+0000","last_became_peered":"2023-10-14T09:18:15.639100+0000","last_unstale":"2023-10-14T09:18:17.077723+0000","last_undegraded":"2023-10-14T09:18:17.077723+0000","last_fullsized":"2023-10-14T09:18:17.077723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:18.822735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212853+0000","last_change":"2023-10-14T09:18:16.084247+0000","last_active":"2023-10-14T09:18:17.212853+0000","last_peered":"2023-10-14T09:18:17.212853+0000","last_clean":"2023-10-14T09:18:17.212853+0000","last_became_active":"2023-10-14T09:18:16.083726+0000","last_became_peered":"2023-10-14T09:18:16.083726+0000","last_unstale":"2023-10-14T09:18:17.212853+0000","last_undegraded":"2023-10-14T09:18:17.212853+0000","last_fullsized":"2023-10-14T09:18:17.212853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:08:15.488812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077741+0000","last_change":"2023-10-14T09:18:15.642588+0000","last_active":"2023-10-14T09:18:17.077741+0000","last_peered":"2023-10-14T09:18:17.077741+0000","last_clean":"2023-10-14T09:18:17.077741+0000","last_became_active":"2023-10-14T09:18:15.642179+0000","last_became_peered":"2023-10-14T09:18:15.642179+0000","last_unstale":"2023-10-14T09:18:17.077741+0000","last_undegraded":"2023-10-14T09:18:17.077741+0000","last_fullsized":"2023-10-14T09:18:17.077741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:29.104151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103864+0000","last_change":"2023-10-14T09:18:16.099176+0000","last_active":"2023-10-14T09:18:16.103864+0000","last_peered":"2023-10-14T09:18:16.103864+0000","last_clean":"2023-10-14T09:18:16.103864+0000","last_became_active":"2023-10-14T09:18:16.098686+0000","last_became_peered":"2023-10-14T09:18:16.098686+0000","last_unstale":"2023-10-14T09:18:16.103864+0000","last_undegraded":"2023-10-14T09:18:16.103864+0000","last_fullsized":"2023-10-14T09:18:16.103864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:59.165445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077773+0000","last_change":"2023-10-14T09:18:15.645124+0000","last_active":"2023-10-14T09:18:17.077773+0000","last_peered":"2023-10-14T09:18:17.077773+0000","last_clean":"2023-10-14T09:18:17.077773+0000","last_became_active":"2023-10-14T09:18:15.644777+0000","last_became_peered":"2023-10-14T09:18:15.644777+0000","last_unstale":"2023-10-14T09:18:17.077773+0000","last_undegraded":"2023-10-14T09:18:17.077773+0000","last_fullsized":"2023-10-14T09:18:17.077773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:54.244172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.091408+0000","last_change":"2023-10-14T09:18:16.086895+0000","last_active":"2023-10-14T09:18:16.091408+0000","last_peered":"2023-10-14T09:18:16.091408+0000","last_clean":"2023-10-14T09:18:16.091408+0000","last_became_active":"2023-10-14T09:18:16.086620+0000","last_became_peered":"2023-10-14T09:18:16.086620+0000","last_unstale":"2023-10-14T09:18:16.091408+0000","last_undegraded":"2023-10-14T09:18:16.091408+0000","last_fullsized":"2023-10-14T09:18:16.091408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:34:14.674399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.648440+0000","last_change":"2023-10-14T09:18:15.638747+0000","last_active":"2023-10-14T09:18:16.648440+0000","last_peered":"2023-10-14T09:18:16.648440+0000","last_clean":"2023-10-14T09:18:16.648440+0000","last_became_active":"2023-10-14T09:18:15.638480+0000","last_became_peered":"2023-10-14T09:18:15.638480+0000","last_unstale":"2023-10-14T09:18:16.648440+0000","last_undegraded":"2023-10-14T09:18:16.648440+0000","last_fullsized":"2023-10-14T09:18:16.648440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:18.822735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.106308+0000","last_change":"2023-10-14T09:18:16.099719+0000","last_active":"2023-10-14T09:18:16.106308+0000","last_peered":"2023-10-14T09:18:16.106308+0000","last_clean":"2023-10-14T09:18:16.106308+0000","last_became_active":"2023-10-14T09:18:16.098342+0000","last_became_peered":"2023-10-14T09:18:16.098342+0000","last_unstale":"2023-10-14T09:18:16.106308+0000","last_undegraded":"2023-10-14T09:18:16.106308+0000","last_fullsized":"2023-10-14T09:18:16.106308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:19:43.739074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.086695+0000","last_change":"2023-10-14T09:18:15.642503+0000","last_active":"2023-10-14T09:18:16.086695+0000","last_peered":"2023-10-14T09:18:16.086695+0000","last_clean":"2023-10-14T09:18:16.086695+0000","last_became_active":"2023-10-14T09:18:15.641903+0000","last_became_peered":"2023-10-14T09:18:15.641903+0000","last_unstale":"2023-10-14T09:18:16.086695+0000","last_undegraded":"2023-10-14T09:18:16.086695+0000","last_fullsized":"2023-10-14T09:18:16.086695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:45.191949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.096342+0000","last_change":"2023-10-14T09:18:16.093366+0000","last_active":"2023-10-14T09:18:16.096342+0000","last_peered":"2023-10-14T09:18:16.096342+0000","last_clean":"2023-10-14T09:18:16.096342+0000","last_became_active":"2023-10-14T09:18:16.093075+0000","last_became_peered":"2023-10-14T09:18:16.093075+0000","last_unstale":"2023-10-14T09:18:16.096342+0000","last_undegraded":"2023-10-14T09:18:16.096342+0000","last_fullsized":"2023-10-14T09:18:16.096342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:17.738984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076749+0000","last_change":"2023-10-14T09:18:15.635106+0000","last_active":"2023-10-14T09:18:17.076749+0000","last_peered":"2023-10-14T09:18:17.076749+0000","last_clean":"2023-10-14T09:18:17.076749+0000","last_became_active":"2023-10-14T09:18:15.634750+0000","last_became_peered":"2023-10-14T09:18:15.634750+0000","last_unstale":"2023-10-14T09:18:17.076749+0000","last_undegraded":"2023-10-14T09:18:17.076749+0000","last_fullsized":"2023-10-14T09:18:17.076749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:45.191949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100720+0000","last_change":"2023-10-14T09:18:16.094958+0000","last_active":"2023-10-14T09:18:16.100720+0000","last_peered":"2023-10-14T09:18:16.100720+0000","last_clean":"2023-10-14T09:18:16.100720+0000","last_became_active":"2023-10-14T09:18:16.094723+0000","last_became_peered":"2023-10-14T09:18:16.094723+0000","last_unstale":"2023-10-14T09:18:16.100720+0000","last_undegraded":"2023-10-14T09:18:16.100720+0000","last_fullsized":"2023-10-14T09:18:16.100720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:19.832080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076216+0000","last_change":"2023-10-14T09:18:15.645045+0000","last_active":"2023-10-14T09:18:17.076216+0000","last_peered":"2023-10-14T09:18:17.076216+0000","last_clean":"2023-10-14T09:18:17.076216+0000","last_became_active":"2023-10-14T09:18:15.644747+0000","last_became_peered":"2023-10-14T09:18:15.644747+0000","last_unstale":"2023-10-14T09:18:17.076216+0000","last_undegraded":"2023-10-14T09:18:17.076216+0000","last_fullsized":"2023-10-14T09:18:17.076216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:16:39.765683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.091758+0000","last_change":"2023-10-14T09:18:16.087100+0000","last_active":"2023-10-14T09:18:16.091758+0000","last_peered":"2023-10-14T09:18:16.091758+0000","last_clean":"2023-10-14T09:18:16.091758+0000","last_became_active":"2023-10-14T09:18:16.086754+0000","last_became_peered":"2023-10-14T09:18:16.086754+0000","last_unstale":"2023-10-14T09:18:16.091758+0000","last_undegraded":"2023-10-14T09:18:16.091758+0000","last_fullsized":"2023-10-14T09:18:16.091758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:09.610273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213148+0000","last_change":"2023-10-14T09:18:15.638964+0000","last_active":"2023-10-14T09:18:17.213148+0000","last_peered":"2023-10-14T09:18:17.213148+0000","last_clean":"2023-10-14T09:18:17.213148+0000","last_became_active":"2023-10-14T09:18:15.638675+0000","last_became_peered":"2023-10-14T09:18:15.638675+0000","last_unstale":"2023-10-14T09:18:17.213148+0000","last_undegraded":"2023-10-14T09:18:17.213148+0000","last_fullsized":"2023-10-14T09:18:17.213148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:18.822735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077019+0000","last_change":"2023-10-14T09:18:16.080912+0000","last_active":"2023-10-14T09:18:17.077019+0000","last_peered":"2023-10-14T09:18:17.077019+0000","last_clean":"2023-10-14T09:18:17.077019+0000","last_became_active":"2023-10-14T09:18:16.080580+0000","last_became_peered":"2023-10-14T09:18:16.080580+0000","last_unstale":"2023-10-14T09:18:17.077019+0000","last_undegraded":"2023-10-14T09:18:17.077019+0000","last_fullsized":"2023-10-14T09:18:17.077019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:44:10.641703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.097524+0000","last_change":"2023-10-14T09:18:15.639852+0000","last_active":"2023-10-14T09:18:16.097524+0000","last_peered":"2023-10-14T09:18:16.097524+0000","last_clean":"2023-10-14T09:18:16.097524+0000","last_became_active":"2023-10-14T09:18:15.639344+0000","last_became_peered":"2023-10-14T09:18:15.639344+0000","last_unstale":"2023-10-14T09:18:16.097524+0000","last_undegraded":"2023-10-14T09:18:16.097524+0000","last_fullsized":"2023-10-14T09:18:16.097524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:29.104151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100779+0000","last_change":"2023-10-14T09:18:16.096712+0000","last_active":"2023-10-14T09:18:16.100779+0000","last_peered":"2023-10-14T09:18:16.100779+0000","last_clean":"2023-10-14T09:18:16.100779+0000","last_became_active":"2023-10-14T09:18:16.096426+0000","last_became_peered":"2023-10-14T09:18:16.096426+0000","last_unstale":"2023-10-14T09:18:16.100779+0000","last_undegraded":"2023-10-14T09:18:16.100779+0000","last_fullsized":"2023-10-14T09:18:16.100779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:46.201293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212925+0000","last_change":"2023-10-14T09:18:15.641459+0000","last_active":"2023-10-14T09:18:17.212925+0000","last_peered":"2023-10-14T09:18:17.212925+0000","last_clean":"2023-10-14T09:18:17.212925+0000","last_became_active":"2023-10-14T09:18:15.640486+0000","last_became_peered":"2023-10-14T09:18:15.640486+0000","last_unstale":"2023-10-14T09:18:17.212925+0000","last_undegraded":"2023-10-14T09:18:17.212925+0000","last_fullsized":"2023-10-14T09:18:17.212925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:47.715078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.104406+0000","last_change":"2023-10-14T09:18:16.095382+0000","last_active":"2023-10-14T09:18:16.104406+0000","last_peered":"2023-10-14T09:18:16.104406+0000","last_clean":"2023-10-14T09:18:16.104406+0000","last_became_active":"2023-10-14T09:18:16.095042+0000","last_became_peered":"2023-10-14T09:18:16.095042+0000","last_unstale":"2023-10-14T09:18:16.104406+0000","last_undegraded":"2023-10-14T09:18:16.104406+0000","last_fullsized":"2023-10-14T09:18:16.104406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:33:27.049041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.097441+0000","last_change":"2023-10-14T09:18:15.647241+0000","last_active":"2023-10-14T09:18:16.097441+0000","last_peered":"2023-10-14T09:18:16.097441+0000","last_clean":"2023-10-14T09:18:16.097441+0000","last_became_active":"2023-10-14T09:18:15.646945+0000","last_became_peered":"2023-10-14T09:18:15.646945+0000","last_unstale":"2023-10-14T09:18:16.097441+0000","last_undegraded":"2023-10-14T09:18:16.097441+0000","last_fullsized":"2023-10-14T09:18:16.097441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:54.244172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100804+0000","last_change":"2023-10-14T09:18:16.097653+0000","last_active":"2023-10-14T09:18:16.100804+0000","last_peered":"2023-10-14T09:18:16.100804+0000","last_clean":"2023-10-14T09:18:16.100804+0000","last_became_active":"2023-10-14T09:18:16.097103+0000","last_became_peered":"2023-10-14T09:18:16.097103+0000","last_unstale":"2023-10-14T09:18:16.100804+0000","last_undegraded":"2023-10-14T09:18:16.100804+0000","last_fullsized":"2023-10-14T09:18:16.100804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:33:27.049041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212650+0000","last_change":"2023-10-14T09:18:15.634463+0000","last_active":"2023-10-14T09:18:17.212650+0000","last_peered":"2023-10-14T09:18:17.212650+0000","last_clean":"2023-10-14T09:18:17.212650+0000","last_became_active":"2023-10-14T09:18:15.634180+0000","last_became_peered":"2023-10-14T09:18:15.634180+0000","last_unstale":"2023-10-14T09:18:17.212650+0000","last_undegraded":"2023-10-14T09:18:17.212650+0000","last_fullsized":"2023-10-14T09:18:17.212650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:12.182340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075620+0000","last_change":"2023-10-14T09:18:16.093022+0000","last_active":"2023-10-14T09:18:17.075620+0000","last_peered":"2023-10-14T09:18:17.075620+0000","last_clean":"2023-10-14T09:18:17.075620+0000","last_became_active":"2023-10-14T09:18:16.091960+0000","last_became_peered":"2023-10-14T09:18:16.091960+0000","last_unstale":"2023-10-14T09:18:17.075620+0000","last_undegraded":"2023-10-14T09:18:17.075620+0000","last_fullsized":"2023-10-14T09:18:17.075620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:36.911030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077136+0000","last_change":"2023-10-14T09:18:15.636294+0000","last_active":"2023-10-14T09:18:17.077136+0000","last_peered":"2023-10-14T09:18:17.077136+0000","last_clean":"2023-10-14T09:18:17.077136+0000","last_became_active":"2023-10-14T09:18:15.636041+0000","last_became_peered":"2023-10-14T09:18:15.636041+0000","last_unstale":"2023-10-14T09:18:17.077136+0000","last_undegraded":"2023-10-14T09:18:17.077136+0000","last_fullsized":"2023-10-14T09:18:17.077136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:17:55.922842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076570+0000","last_change":"2023-10-14T09:18:16.092214+0000","last_active":"2023-10-14T09:18:17.076570+0000","last_peered":"2023-10-14T09:18:17.076570+0000","last_clean":"2023-10-14T09:18:17.076570+0000","last_became_active":"2023-10-14T09:18:16.091834+0000","last_became_peered":"2023-10-14T09:18:16.091834+0000","last_unstale":"2023-10-14T09:18:17.076570+0000","last_undegraded":"2023-10-14T09:18:17.076570+0000","last_fullsized":"2023-10-14T09:18:17.076570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:13.191684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075710+0000","last_change":"2023-10-14T09:18:15.645719+0000","last_active":"2023-10-14T09:18:17.075710+0000","last_peered":"2023-10-14T09:18:17.075710+0000","last_clean":"2023-10-14T09:18:17.075710+0000","last_became_active":"2023-10-14T09:18:15.645368+0000","last_became_peered":"2023-10-14T09:18:15.645368+0000","last_unstale":"2023-10-14T09:18:17.075710+0000","last_undegraded":"2023-10-14T09:18:17.075710+0000","last_fullsized":"2023-10-14T09:18:17.075710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:47.715078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.104781+0000","last_change":"2023-10-14T09:18:16.099820+0000","last_active":"2023-10-14T09:18:16.104781+0000","last_peered":"2023-10-14T09:18:16.104781+0000","last_clean":"2023-10-14T09:18:16.104781+0000","last_became_active":"2023-10-14T09:18:16.099523+0000","last_became_peered":"2023-10-14T09:18:16.099523+0000","last_unstale":"2023-10-14T09:18:16.104781+0000","last_undegraded":"2023-10-14T09:18:16.104781+0000","last_fullsized":"2023-10-14T09:18:16.104781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:36.715992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.086870+0000","last_change":"2023-10-14T09:18:15.648446+0000","last_active":"2023-10-14T09:18:16.086870+0000","last_peered":"2023-10-14T09:18:16.086870+0000","last_clean":"2023-10-14T09:18:16.086870+0000","last_became_active":"2023-10-14T09:18:15.647442+0000","last_became_peered":"2023-10-14T09:18:15.647442+0000","last_unstale":"2023-10-14T09:18:16.086870+0000","last_undegraded":"2023-10-14T09:18:16.086870+0000","last_fullsized":"2023-10-14T09:18:16.086870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:17:55.922842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T09:18:15.640678+0000","last_change":"2023-10-14T09:17:14.304224+0000","last_active":"2023-10-14T09:18:15.640678+0000","last_peered":"2023-10-14T09:18:15.640678+0000","last_clean":"2023-10-14T09:18:15.640678+0000","last_became_active":"2023-10-14T09:17:14.303743+0000","last_became_peered":"2023-10-14T09:17:14.303743+0000","last_unstale":"2023-10-14T09:18:15.640678+0000","last_undegraded":"2023-10-14T09:18:15.640678+0000","last_fullsized":"2023-10-14T09:18:15.640678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_clean_scrub_stamp":"2023-10-14T09:17:13.285641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:24.100243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":725078,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.434},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.875},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.76300000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.90500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":134620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.5389999999999997,"5min":5.5389999999999997,"15min":5.5389999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.4489999999999998,"5min":5.4489999999999998,"15min":5.4489999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.73999999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":5.4770000000000003,"5min":5.4770000000000003,"15min":5.4770000000000003},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72099999999999997}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.62},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.64200000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.83399999999999996}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.54500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59399999999999997}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.754}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.86599999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.85099999999999998}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.94599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":356352,"data_stored":134724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":6.6749999999999998,"5min":6.6749999999999998,"15min":6.6749999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.79700000000000004}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.74099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":134620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46899999999999997}]},{"osd":2,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.58299999999999996}]},{"osd":4,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.755}]},{"osd":5,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.80800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":134620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.377}]},{"osd":1,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.1680000000000001,"5min":4.1680000000000001,"15min":4.1680000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.5}]},{"osd":5,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":4.4219999999999997},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":4.5030000000000001,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.5499999999999998,"5min":4.5499999999999998,"15min":4.5499999999999998},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":134620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.438}]},{"osd":2,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53100000000000003}]},{"osd":4,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.66400000000000003}]},{"osd":5,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.629}]},{"osd":6,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.73499999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":724988,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54200000000000004}]},{"osd":3,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.52100000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.748},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:18:20.708 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:18:20.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca962dc640 1 Processor -- start 2023-10-14T09:18:20.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca962dc640 1 -- start start 2023-10-14T09:18:20.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca962dc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fca901514b0 0x7fca900c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca962dc640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca90154490 con 0x7fca900c4810 2023-10-14T09:18:20.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca962dc640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca900c5a00 con 0x7fca90154920 2023-10-14T09:18:20.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca962dc640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca90153c30 con 0x7fca901514b0 2023-10-14T09:18:20.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca95adb640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fca900c4810 0x7fca9015e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40490/0 (socket says 172.21.15.78:40490) 2023-10-14T09:18:20.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca95adb640 1 -- 172.21.15.78:0/2144625623 learned_addr learned my addr 172.21.15.78:0/2144625623 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:20.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca952da640 1 --2- 172.21.15.78:0/2144625623 >> v2:172.21.15.157:3300/0 conn(0x7fca901514b0 0x7fca900c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394370439 0 0) 0x7fca90154490 con 0x7fca900c4810 2023-10-14T09:18:20.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca7c003530 con 0x7fca900c4810 2023-10-14T09:18:20.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2188649436 0 0) 0x7fca7c003530 con 0x7fca900c4810 2023-10-14T09:18:20.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 >> v2:172.21.15.157:3300/0 conn(0x7fca901514b0 msgr2=0x7fca900c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:20.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 --2- 172.21.15.78:0/2144625623 >> v2:172.21.15.157:3300/0 conn(0x7fca901514b0 0x7fca900c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 >> v1:172.21.15.157:6789/0 conn(0x7fca90154920 legacy=0x7fca900c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90153e40 con 0x7fca900c4810 2023-10-14T09:18:20.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7fca88001a00 con 0x7fca900c4810 2023-10-14T09:18:20.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 >> v1:172.21.15.78:6789/0 conn(0x7fca900c4810 legacy=0x7fca9015e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca7c003a60 0x7fca7c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca7c0047d0 0x7fca7c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca7c005390 0x7fca7c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca90153c30 con 0x7fca7c003a60 2023-10-14T09:18:20.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c00c250 con 0x7fca7c0047d0 2023-10-14T09:18:20.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c00c410 con 0x7fca7c005390 2023-10-14T09:18:20.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca952da640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca7c003a60 0x7fca7c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca94ad9640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca7c0047d0 0x7fca7c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca95adb640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca7c005390 0x7fca7c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca952da640 1 -- 172.21.15.78:0/2144625623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca7c005390 msgr2=0x7fca7c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:20.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca952da640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca7c005390 0x7fca7c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca952da640 1 -- 172.21.15.78:0/2144625623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca7c0047d0 msgr2=0x7fca7c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca952da640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca7c0047d0 0x7fca7c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca952da640 1 -- 172.21.15.78:0/2144625623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c003530 con 0x7fca7c003a60 2023-10-14T09:18:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca95adb640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca7c005390 0x7fca7c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.879+0000 7fca95adb640 1 -- 172.21.15.78:0/2144625623 reap_dead start 2023-10-14T09:18:20.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.883+0000 7fca952da640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca7c003a60 0x7fca7c003e80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009ae0 tx=0x7fca8c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffacd4ef58f17e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:20.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.883+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0a5610 con 0x7fca7c003a60 2023-10-14T09:18:20.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.883+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c0a5770 con 0x7fca7c003a60 2023-10-14T09:18:20.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.883+0000 7fca87fff640 1 -- 172.21.15.78:0/2144625623 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0a5920 con 0x7fca7c003a60 2023-10-14T09:18:20.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.883+0000 7fca962dc640 1 -- 172.21.15.78:0/2144625623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca7c003a60 msgr2=0x7fca7c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.883+0000 7fca962dc640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca7c003a60 0x7fca7c003e80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009ae0 tx=0x7fca8c01ca20 comp rx=0 tx=0).stop 2023-10-14T09:18:20.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.883+0000 7fca962dc640 1 -- 172.21.15.78:0/2144625623 shutdown_connections 2023-10-14T09:18:20.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.883+0000 7fca962dc640 1 --2- 172.21.15.78:0/2144625623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca7c003a60 0x7fca7c003e80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.883+0000 7fca962dc640 1 -- 172.21.15.78:0/2144625623 >> 172.21.15.78:0/2144625623 conn(0x7fca900c9430 msgr2=0x7fca900c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:20.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.883+0000 7fca962dc640 1 -- 172.21.15.78:0/2144625623 shutdown_connections 2023-10-14T09:18:20.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.883+0000 7fca962dc640 1 -- 172.21.15.78:0/2144625623 wait complete. 2023-10-14T09:18:20.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca962dc640 1 Processor -- start 2023-10-14T09:18:20.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca962dc640 1 -- start start 2023-10-14T09:18:20.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca962dc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca7c003a60 0x7fca901f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca962dc640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca9014cc40 0x7fca90156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca962dc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca90157410 0x7fca900a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca962dc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca901564c0 con 0x7fca90157410 2023-10-14T09:18:20.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca962dc640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca901f05b0 con 0x7fca9014cc40 2023-10-14T09:18:20.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca962dc640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca90156a40 con 0x7fca7c003a60 2023-10-14T09:18:20.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca95adb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca90157410 0x7fca900a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca952da640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca7c003a60 0x7fca901f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca95adb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca90157410 0x7fca900a9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58928/0 (socket says 172.21.15.78:58928) 2023-10-14T09:18:20.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca95adb640 1 -- 172.21.15.78:0/566289242 learned_addr learned my addr 172.21.15.78:0/566289242 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:20.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca94ad9640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca9014cc40 0x7fca90156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca95adb640 1 -- 172.21.15.78:0/566289242 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca7c003a60 msgr2=0x7fca901f0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca95adb640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca7c003a60 0x7fca901f0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca95adb640 1 -- 172.21.15.78:0/566289242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca9014cc40 msgr2=0x7fca90156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:20.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca95adb640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca9014cc40 0x7fca90156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:20.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca95adb640 1 -- 172.21.15.78:0/566289242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90147500 con 0x7fca90157410 2023-10-14T09:18:20.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca95adb640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca90157410 0x7fca900a9e00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fca900ca090 tx=0x7fca8800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:20.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca85ffb640 1 -- 172.21.15.78:0/566289242 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88004d70 con 0x7fca90157410 2023-10-14T09:18:20.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca85ffb640 1 -- 172.21.15.78:0/566289242 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8800bb20 con 0x7fca90157410 2023-10-14T09:18:20.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca962dc640 1 -- 172.21.15.78:0/566289242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca901477e0 con 0x7fca90157410 2023-10-14T09:18:20.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca85ffb640 1 -- 172.21.15.78:0/566289242 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8800bed0 con 0x7fca90157410 2023-10-14T09:18:20.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.887+0000 7fca962dc640 1 -- 172.21.15.78:0/566289242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9014f0a0 con 0x7fca90157410 2023-10-14T09:18:20.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.891+0000 7fca962dc640 1 -- 172.21.15.78:0/566289242 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca90156bd0 con 0x7fca90157410 2023-10-14T09:18:20.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.891+0000 7fca85ffb640 1 -- 172.21.15.78:0/566289242 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca88007070 con 0x7fca90157410 2023-10-14T09:18:20.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.891+0000 7fca85ffb640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fca740664a0 0x7fca74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:20.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.891+0000 7fca85ffb640 1 -- 172.21.15.78:0/566289242 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fca88083b20 con 0x7fca90157410 2023-10-14T09:18:20.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.891+0000 7fca952da640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fca740664a0 0x7fca74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:20.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.891+0000 7fca952da640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fca740664a0 0x7fca74068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0af000 tx=0x7fca8c0046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:20.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:20.895+0000 7fca85ffb640 1 -- 172.21.15.78:0/566289242 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca88051020 con 0x7fca90157410 2023-10-14T09:18:21.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.039+0000 7fca962dc640 1 -- 172.21.15.78:0/566289242 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca901479d0 con 0x7fca740664a0 2023-10-14T09:18:21.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.047+0000 7fca85ffb640 1 -- 172.21.15.78:0/566289242 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288950 (secure 0 0 0) 0x7fca901479d0 con 0x7fca740664a0 2023-10-14T09:18:21.055 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:21.057 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-10-14T09:18:21.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 -- 172.21.15.78:0/566289242 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fca740664a0 msgr2=0x7fca74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fca740664a0 0x7fca74068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0af000 tx=0x7fca8c0046d0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 -- 172.21.15.78:0/566289242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca90157410 msgr2=0x7fca900a9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca90157410 0x7fca900a9e00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fca900ca090 tx=0x7fca8800b4a0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 -- 172.21.15.78:0/566289242 shutdown_connections 2023-10-14T09:18:21.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca90157410 0x7fca900a9e00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fca9014cc40 0x7fca90156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fca740664a0 0x7fca74068960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 --2- 172.21.15.78:0/566289242 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fca7c003a60 0x7fca901f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 -- 172.21.15.78:0/566289242 >> 172.21.15.78:0/566289242 conn(0x7fca900c9430 msgr2=0x7fca900c5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 -- 172.21.15.78:0/566289242 shutdown_connections 2023-10-14T09:18:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.051+0000 7fca962dc640 1 -- 172.21.15.78:0/566289242 wait complete. 2023-10-14T09:18:21.075 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-10-14T09:18:19.241988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223212,"kb_used_data":2868,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751508,"statfs":{"total":773094113280,"available":772865544192,"internally_reserved":0,"allocated":2936832,"data_stored":2258562,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.624381"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.104346+0000","last_change":"2023-10-14T09:18:16.097097+0000","last_active":"2023-10-14T09:18:16.104346+0000","last_peered":"2023-10-14T09:18:16.104346+0000","last_clean":"2023-10-14T09:18:16.104346+0000","last_became_active":"2023-10-14T09:18:16.096790+0000","last_became_peered":"2023-10-14T09:18:16.096790+0000","last_unstale":"2023-10-14T09:18:16.104346+0000","last_undegraded":"2023-10-14T09:18:16.104346+0000","last_fullsized":"2023-10-14T09:18:16.104346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:35.520331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076126+0000","last_change":"2023-10-14T09:18:16.095858+0000","last_active":"2023-10-14T09:18:17.076126+0000","last_peered":"2023-10-14T09:18:17.076126+0000","last_clean":"2023-10-14T09:18:17.076126+0000","last_became_active":"2023-10-14T09:18:16.095313+0000","last_became_peered":"2023-10-14T09:18:16.095313+0000","last_unstale":"2023-10-14T09:18:17.076126+0000","last_undegraded":"2023-10-14T09:18:17.076126+0000","last_fullsized":"2023-10-14T09:18:17.076126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:44:10.641703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076499+0000","last_change":"2023-10-14T09:18:16.081368+0000","last_active":"2023-10-14T09:18:17.076499+0000","last_peered":"2023-10-14T09:18:17.076499+0000","last_clean":"2023-10-14T09:18:17.076499+0000","last_became_active":"2023-10-14T09:18:16.081094+0000","last_became_peered":"2023-10-14T09:18:16.081094+0000","last_unstale":"2023-10-14T09:18:17.076499+0000","last_undegraded":"2023-10-14T09:18:17.076499+0000","last_fullsized":"2023-10-14T09:18:17.076499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:58.150011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212843+0000","last_change":"2023-10-14T09:18:16.081852+0000","last_active":"2023-10-14T09:18:17.212843+0000","last_peered":"2023-10-14T09:18:17.212843+0000","last_clean":"2023-10-14T09:18:17.212843+0000","last_became_active":"2023-10-14T09:18:16.080395+0000","last_became_peered":"2023-10-14T09:18:16.080395+0000","last_unstale":"2023-10-14T09:18:17.212843+0000","last_undegraded":"2023-10-14T09:18:17.212843+0000","last_fullsized":"2023-10-14T09:18:17.212843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:56.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100265+0000","last_change":"2023-10-14T09:18:16.095464+0000","last_active":"2023-10-14T09:18:16.100265+0000","last_peered":"2023-10-14T09:18:16.100265+0000","last_clean":"2023-10-14T09:18:16.100265+0000","last_became_active":"2023-10-14T09:18:16.095184+0000","last_became_peered":"2023-10-14T09:18:16.095184+0000","last_unstale":"2023-10-14T09:18:16.100265+0000","last_undegraded":"2023-10-14T09:18:16.100265+0000","last_fullsized":"2023-10-14T09:18:16.100265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:04.516670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076138+0000","last_change":"2023-10-14T09:18:16.099298+0000","last_active":"2023-10-14T09:18:17.076138+0000","last_peered":"2023-10-14T09:18:17.076138+0000","last_clean":"2023-10-14T09:18:17.076138+0000","last_became_active":"2023-10-14T09:18:16.099013+0000","last_became_peered":"2023-10-14T09:18:16.099013+0000","last_unstale":"2023-10-14T09:18:17.076138+0000","last_undegraded":"2023-10-14T09:18:17.076138+0000","last_fullsized":"2023-10-14T09:18:17.076138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:33:02.104346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.105327+0000","last_change":"2023-10-14T09:18:16.102115+0000","last_active":"2023-10-14T09:18:16.105327+0000","last_peered":"2023-10-14T09:18:16.105327+0000","last_clean":"2023-10-14T09:18:16.105327+0000","last_became_active":"2023-10-14T09:18:16.101797+0000","last_became_peered":"2023-10-14T09:18:16.101797+0000","last_unstale":"2023-10-14T09:18:16.105327+0000","last_undegraded":"2023-10-14T09:18:16.105327+0000","last_fullsized":"2023-10-14T09:18:16.105327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:12.073123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103860+0000","last_change":"2023-10-14T09:18:16.097221+0000","last_active":"2023-10-14T09:18:16.103860+0000","last_peered":"2023-10-14T09:18:16.103860+0000","last_clean":"2023-10-14T09:18:16.103860+0000","last_became_active":"2023-10-14T09:18:16.095180+0000","last_became_peered":"2023-10-14T09:18:16.095180+0000","last_unstale":"2023-10-14T09:18:16.103860+0000","last_undegraded":"2023-10-14T09:18:16.103860+0000","last_fullsized":"2023-10-14T09:18:16.103860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:13.191684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077854+0000","last_change":"2023-10-14T09:18:16.084927+0000","last_active":"2023-10-14T09:18:17.077854+0000","last_peered":"2023-10-14T09:18:17.077854+0000","last_clean":"2023-10-14T09:18:17.077854+0000","last_became_active":"2023-10-14T09:18:16.084629+0000","last_became_peered":"2023-10-14T09:18:16.084629+0000","last_unstale":"2023-10-14T09:18:17.077854+0000","last_undegraded":"2023-10-14T09:18:17.077854+0000","last_fullsized":"2023-10-14T09:18:17.077854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:56.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213015+0000","last_change":"2023-10-14T09:18:16.093720+0000","last_active":"2023-10-14T09:18:17.213015+0000","last_peered":"2023-10-14T09:18:17.213015+0000","last_clean":"2023-10-14T09:18:17.213015+0000","last_became_active":"2023-10-14T09:18:16.092225+0000","last_became_peered":"2023-10-14T09:18:16.092225+0000","last_unstale":"2023-10-14T09:18:17.213015+0000","last_undegraded":"2023-10-14T09:18:17.213015+0000","last_fullsized":"2023-10-14T09:18:17.213015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:08:04.840122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.104494+0000","last_change":"2023-10-14T09:18:16.097701+0000","last_active":"2023-10-14T09:18:16.104494+0000","last_peered":"2023-10-14T09:18:16.104494+0000","last_clean":"2023-10-14T09:18:16.104494+0000","last_became_active":"2023-10-14T09:18:16.097422+0000","last_became_peered":"2023-10-14T09:18:16.097422+0000","last_unstale":"2023-10-14T09:18:16.104494+0000","last_undegraded":"2023-10-14T09:18:16.104494+0000","last_fullsized":"2023-10-14T09:18:16.104494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:42.840106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076352+0000","last_change":"2023-10-14T09:18:16.091436+0000","last_active":"2023-10-14T09:18:17.076352+0000","last_peered":"2023-10-14T09:18:17.076352+0000","last_clean":"2023-10-14T09:18:17.076352+0000","last_became_active":"2023-10-14T09:18:16.091165+0000","last_became_peered":"2023-10-14T09:18:16.091165+0000","last_unstale":"2023-10-14T09:18:17.076352+0000","last_undegraded":"2023-10-14T09:18:17.076352+0000","last_fullsized":"2023-10-14T09:18:17.076352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:48:48.009344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.084802+0000","last_change":"2023-10-14T09:18:16.082495+0000","last_active":"2023-10-14T09:18:16.084802+0000","last_peered":"2023-10-14T09:18:16.084802+0000","last_clean":"2023-10-14T09:18:16.084802+0000","last_became_active":"2023-10-14T09:18:16.082240+0000","last_became_peered":"2023-10-14T09:18:16.082240+0000","last_unstale":"2023-10-14T09:18:16.084802+0000","last_undegraded":"2023-10-14T09:18:16.084802+0000","last_fullsized":"2023-10-14T09:18:16.084802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:58:48.135497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076250+0000","last_change":"2023-10-14T09:18:16.089148+0000","last_active":"2023-10-14T09:18:17.076250+0000","last_peered":"2023-10-14T09:18:17.076250+0000","last_clean":"2023-10-14T09:18:17.076250+0000","last_became_active":"2023-10-14T09:18:16.088775+0000","last_became_peered":"2023-10-14T09:18:16.088775+0000","last_unstale":"2023-10-14T09:18:17.076250+0000","last_undegraded":"2023-10-14T09:18:17.076250+0000","last_fullsized":"2023-10-14T09:18:17.076250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:29.617795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076810+0000","last_change":"2023-10-14T09:18:16.093001+0000","last_active":"2023-10-14T09:18:17.076810+0000","last_peered":"2023-10-14T09:18:17.076810+0000","last_clean":"2023-10-14T09:18:17.076810+0000","last_became_active":"2023-10-14T09:18:16.092713+0000","last_became_peered":"2023-10-14T09:18:16.092713+0000","last_unstale":"2023-10-14T09:18:17.076810+0000","last_undegraded":"2023-10-14T09:18:17.076810+0000","last_fullsized":"2023-10-14T09:18:17.076810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:42.385871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.105294+0000","last_change":"2023-10-14T09:18:16.099921+0000","last_active":"2023-10-14T09:18:16.105294+0000","last_peered":"2023-10-14T09:18:16.105294+0000","last_clean":"2023-10-14T09:18:16.105294+0000","last_became_active":"2023-10-14T09:18:16.099620+0000","last_became_peered":"2023-10-14T09:18:16.099620+0000","last_unstale":"2023-10-14T09:18:16.105294+0000","last_undegraded":"2023-10-14T09:18:16.105294+0000","last_fullsized":"2023-10-14T09:18:16.105294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:16:05.657118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.105319+0000","last_change":"2023-10-14T09:18:16.102107+0000","last_active":"2023-10-14T09:18:16.105319+0000","last_peered":"2023-10-14T09:18:16.105319+0000","last_clean":"2023-10-14T09:18:16.105319+0000","last_became_active":"2023-10-14T09:18:16.101819+0000","last_became_peered":"2023-10-14T09:18:16.101819+0000","last_unstale":"2023-10-14T09:18:16.105319+0000","last_undegraded":"2023-10-14T09:18:16.105319+0000","last_fullsized":"2023-10-14T09:18:16.105319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:56.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076133+0000","last_change":"2023-10-14T09:18:16.089991+0000","last_active":"2023-10-14T09:18:17.076133+0000","last_peered":"2023-10-14T09:18:17.076133+0000","last_clean":"2023-10-14T09:18:17.076133+0000","last_became_active":"2023-10-14T09:18:16.089764+0000","last_became_peered":"2023-10-14T09:18:16.089764+0000","last_unstale":"2023-10-14T09:18:17.076133+0000","last_undegraded":"2023-10-14T09:18:17.076133+0000","last_fullsized":"2023-10-14T09:18:17.076133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:40:37.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075883+0000","last_change":"2023-10-14T09:18:16.093748+0000","last_active":"2023-10-14T09:18:17.075883+0000","last_peered":"2023-10-14T09:18:17.075883+0000","last_clean":"2023-10-14T09:18:17.075883+0000","last_became_active":"2023-10-14T09:18:16.093511+0000","last_became_peered":"2023-10-14T09:18:16.093511+0000","last_unstale":"2023-10-14T09:18:17.075883+0000","last_undegraded":"2023-10-14T09:18:17.075883+0000","last_fullsized":"2023-10-14T09:18:17.075883+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:42.385871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.097322+0000","last_change":"2023-10-14T09:18:16.094566+0000","last_active":"2023-10-14T09:18:16.097322+0000","last_peered":"2023-10-14T09:18:16.097322+0000","last_clean":"2023-10-14T09:18:16.097322+0000","last_became_active":"2023-10-14T09:18:16.094267+0000","last_became_peered":"2023-10-14T09:18:16.094267+0000","last_unstale":"2023-10-14T09:18:16.097322+0000","last_undegraded":"2023-10-14T09:18:16.097322+0000","last_fullsized":"2023-10-14T09:18:16.097322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:37:46.847050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077345+0000","last_change":"2023-10-14T09:18:16.095144+0000","last_active":"2023-10-14T09:18:17.077345+0000","last_peered":"2023-10-14T09:18:17.077345+0000","last_clean":"2023-10-14T09:18:17.077345+0000","last_became_active":"2023-10-14T09:18:16.094798+0000","last_became_peered":"2023-10-14T09:18:16.094798+0000","last_unstale":"2023-10-14T09:18:17.077345+0000","last_undegraded":"2023-10-14T09:18:17.077345+0000","last_fullsized":"2023-10-14T09:18:17.077345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:16:05.657118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077293+0000","last_change":"2023-10-14T09:18:16.091458+0000","last_active":"2023-10-14T09:18:17.077293+0000","last_peered":"2023-10-14T09:18:17.077293+0000","last_clean":"2023-10-14T09:18:17.077293+0000","last_became_active":"2023-10-14T09:18:16.089533+0000","last_became_peered":"2023-10-14T09:18:16.089533+0000","last_unstale":"2023-10-14T09:18:17.077293+0000","last_undegraded":"2023-10-14T09:18:17.077293+0000","last_fullsized":"2023-10-14T09:18:17.077293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:16:40.775027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.108943+0000","last_change":"2023-10-14T09:18:16.102753+0000","last_active":"2023-10-14T09:18:16.108943+0000","last_peered":"2023-10-14T09:18:16.108943+0000","last_clean":"2023-10-14T09:18:16.108943+0000","last_became_active":"2023-10-14T09:18:16.102473+0000","last_became_peered":"2023-10-14T09:18:16.102473+0000","last_unstale":"2023-10-14T09:18:16.108943+0000","last_undegraded":"2023-10-14T09:18:16.108943+0000","last_fullsized":"2023-10-14T09:18:16.108943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:07.615677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076100+0000","last_change":"2023-10-14T09:18:16.082186+0000","last_active":"2023-10-14T09:18:17.076100+0000","last_peered":"2023-10-14T09:18:17.076100+0000","last_clean":"2023-10-14T09:18:17.076100+0000","last_became_active":"2023-10-14T09:18:16.081561+0000","last_became_peered":"2023-10-14T09:18:16.081561+0000","last_unstale":"2023-10-14T09:18:17.076100+0000","last_undegraded":"2023-10-14T09:18:17.076100+0000","last_fullsized":"2023-10-14T09:18:17.076100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:08:04.840122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213100+0000","last_change":"2023-10-14T09:18:16.097740+0000","last_active":"2023-10-14T09:18:17.213100+0000","last_peered":"2023-10-14T09:18:17.213100+0000","last_clean":"2023-10-14T09:18:17.213100+0000","last_became_active":"2023-10-14T09:18:16.097491+0000","last_became_peered":"2023-10-14T09:18:16.097491+0000","last_unstale":"2023-10-14T09:18:17.213100+0000","last_undegraded":"2023-10-14T09:18:17.213100+0000","last_fullsized":"2023-10-14T09:18:17.213100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:42:48.390583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076253+0000","last_change":"2023-10-14T09:18:16.096089+0000","last_active":"2023-10-14T09:18:17.076253+0000","last_peered":"2023-10-14T09:18:17.076253+0000","last_clean":"2023-10-14T09:18:17.076253+0000","last_became_active":"2023-10-14T09:18:16.095627+0000","last_became_peered":"2023-10-14T09:18:16.095627+0000","last_unstale":"2023-10-14T09:18:17.076253+0000","last_undegraded":"2023-10-14T09:18:17.076253+0000","last_fullsized":"2023-10-14T09:18:17.076253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:48:13.538402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213031+0000","last_change":"2023-10-14T09:18:16.085305+0000","last_active":"2023-10-14T09:18:17.213031+0000","last_peered":"2023-10-14T09:18:17.213031+0000","last_clean":"2023-10-14T09:18:17.213031+0000","last_became_active":"2023-10-14T09:18:16.084749+0000","last_became_peered":"2023-10-14T09:18:16.084749+0000","last_unstale":"2023-10-14T09:18:17.213031+0000","last_undegraded":"2023-10-14T09:18:17.213031+0000","last_fullsized":"2023-10-14T09:18:17.213031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:59.090596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076501+0000","last_change":"2023-10-14T09:18:16.092125+0000","last_active":"2023-10-14T09:18:17.076501+0000","last_peered":"2023-10-14T09:18:17.076501+0000","last_clean":"2023-10-14T09:18:17.076501+0000","last_became_active":"2023-10-14T09:18:16.091787+0000","last_became_peered":"2023-10-14T09:18:16.091787+0000","last_unstale":"2023-10-14T09:18:17.076501+0000","last_undegraded":"2023-10-14T09:18:17.076501+0000","last_fullsized":"2023-10-14T09:18:17.076501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:36.911030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077237+0000","last_change":"2023-10-14T09:18:16.095770+0000","last_active":"2023-10-14T09:18:17.077237+0000","last_peered":"2023-10-14T09:18:17.077237+0000","last_clean":"2023-10-14T09:18:17.077237+0000","last_became_active":"2023-10-14T09:18:16.095489+0000","last_became_peered":"2023-10-14T09:18:16.095489+0000","last_unstale":"2023-10-14T09:18:17.077237+0000","last_undegraded":"2023-10-14T09:18:17.077237+0000","last_fullsized":"2023-10-14T09:18:17.077237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:48.724422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103835+0000","last_change":"2023-10-14T09:18:16.097179+0000","last_active":"2023-10-14T09:18:16.103835+0000","last_peered":"2023-10-14T09:18:16.103835+0000","last_clean":"2023-10-14T09:18:16.103835+0000","last_became_active":"2023-10-14T09:18:16.096288+0000","last_became_peered":"2023-10-14T09:18:16.096288+0000","last_unstale":"2023-10-14T09:18:16.103835+0000","last_undegraded":"2023-10-14T09:18:16.103835+0000","last_fullsized":"2023-10-14T09:18:16.103835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:56.229459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100499+0000","last_change":"2023-10-14T09:18:16.091488+0000","last_active":"2023-10-14T09:18:16.100499+0000","last_peered":"2023-10-14T09:18:16.100499+0000","last_clean":"2023-10-14T09:18:16.100499+0000","last_became_active":"2023-10-14T09:18:16.091148+0000","last_became_peered":"2023-10-14T09:18:16.091148+0000","last_unstale":"2023-10-14T09:18:16.100499+0000","last_undegraded":"2023-10-14T09:18:16.100499+0000","last_fullsized":"2023-10-14T09:18:16.100499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:45.334110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103947+0000","last_change":"2023-10-14T09:18:16.098238+0000","last_active":"2023-10-14T09:18:16.103947+0000","last_peered":"2023-10-14T09:18:16.103947+0000","last_clean":"2023-10-14T09:18:16.103947+0000","last_became_active":"2023-10-14T09:18:16.097903+0000","last_became_peered":"2023-10-14T09:18:16.097903+0000","last_unstale":"2023-10-14T09:18:16.103947+0000","last_undegraded":"2023-10-14T09:18:16.103947+0000","last_fullsized":"2023-10-14T09:18:16.103947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:48.724422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.108923+0000","last_change":"2023-10-14T09:18:16.102695+0000","last_active":"2023-10-14T09:18:16.108923+0000","last_peered":"2023-10-14T09:18:16.108923+0000","last_clean":"2023-10-14T09:18:16.108923+0000","last_became_active":"2023-10-14T09:18:16.102419+0000","last_became_peered":"2023-10-14T09:18:16.102419+0000","last_unstale":"2023-10-14T09:18:16.108923+0000","last_undegraded":"2023-10-14T09:18:16.108923+0000","last_fullsized":"2023-10-14T09:18:16.108923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:35.520331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.644159+0000","last_change":"2023-10-14T09:18:15.646487+0000","last_active":"2023-10-14T09:18:16.644159+0000","last_peered":"2023-10-14T09:18:16.644159+0000","last_clean":"2023-10-14T09:18:16.644159+0000","last_became_active":"2023-10-14T09:18:15.646216+0000","last_became_peered":"2023-10-14T09:18:15.646216+0000","last_unstale":"2023-10-14T09:18:16.644159+0000","last_undegraded":"2023-10-14T09:18:16.644159+0000","last_fullsized":"2023-10-14T09:18:16.644159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:54.244172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103264+0000","last_change":"2023-10-14T09:18:16.094519+0000","last_active":"2023-10-14T09:18:16.103264+0000","last_peered":"2023-10-14T09:18:16.103264+0000","last_clean":"2023-10-14T09:18:16.103264+0000","last_became_active":"2023-10-14T09:18:16.094246+0000","last_became_peered":"2023-10-14T09:18:16.094246+0000","last_unstale":"2023-10-14T09:18:16.103264+0000","last_undegraded":"2023-10-14T09:18:16.103264+0000","last_fullsized":"2023-10-14T09:18:16.103264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:07.615677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.646696+0000","last_change":"2023-10-14T09:18:15.644538+0000","last_active":"2023-10-14T09:18:16.646696+0000","last_peered":"2023-10-14T09:18:16.646696+0000","last_clean":"2023-10-14T09:18:16.646696+0000","last_became_active":"2023-10-14T09:18:15.644259+0000","last_became_peered":"2023-10-14T09:18:15.644259+0000","last_unstale":"2023-10-14T09:18:16.646696+0000","last_undegraded":"2023-10-14T09:18:16.646696+0000","last_fullsized":"2023-10-14T09:18:16.646696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:17:55.922842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077805+0000","last_change":"2023-10-14T09:18:16.091773+0000","last_active":"2023-10-14T09:18:17.077805+0000","last_peered":"2023-10-14T09:18:17.077805+0000","last_clean":"2023-10-14T09:18:17.077805+0000","last_became_active":"2023-10-14T09:18:16.091545+0000","last_became_peered":"2023-10-14T09:18:16.091545+0000","last_unstale":"2023-10-14T09:18:17.077805+0000","last_undegraded":"2023-10-14T09:18:17.077805+0000","last_fullsized":"2023-10-14T09:18:17.077805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:36.715992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075782+0000","last_change":"2023-10-14T09:18:15.644414+0000","last_active":"2023-10-14T09:18:17.075782+0000","last_peered":"2023-10-14T09:18:17.075782+0000","last_clean":"2023-10-14T09:18:17.075782+0000","last_became_active":"2023-10-14T09:18:15.643570+0000","last_became_peered":"2023-10-14T09:18:15.643570+0000","last_unstale":"2023-10-14T09:18:17.075782+0000","last_undegraded":"2023-10-14T09:18:17.075782+0000","last_fullsized":"2023-10-14T09:18:17.075782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:18:57.140667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213051+0000","last_change":"2023-10-14T09:18:16.085530+0000","last_active":"2023-10-14T09:18:17.213051+0000","last_peered":"2023-10-14T09:18:17.213051+0000","last_clean":"2023-10-14T09:18:17.213051+0000","last_became_active":"2023-10-14T09:18:16.085055+0000","last_became_peered":"2023-10-14T09:18:16.085055+0000","last_unstale":"2023-10-14T09:18:17.213051+0000","last_undegraded":"2023-10-14T09:18:17.213051+0000","last_fullsized":"2023-10-14T09:18:17.213051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:48:48.009344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.648910+0000","last_change":"2023-10-14T09:18:15.635078+0000","last_active":"2023-10-14T09:18:16.648910+0000","last_peered":"2023-10-14T09:18:16.648910+0000","last_clean":"2023-10-14T09:18:16.648910+0000","last_became_active":"2023-10-14T09:18:15.634790+0000","last_became_peered":"2023-10-14T09:18:15.634790+0000","last_unstale":"2023-10-14T09:18:16.648910+0000","last_undegraded":"2023-10-14T09:18:16.648910+0000","last_fullsized":"2023-10-14T09:18:16.648910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:41.382756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100687+0000","last_change":"2023-10-14T09:18:16.094185+0000","last_active":"2023-10-14T09:18:16.100687+0000","last_peered":"2023-10-14T09:18:16.100687+0000","last_clean":"2023-10-14T09:18:16.100687+0000","last_became_active":"2023-10-14T09:18:16.093808+0000","last_became_peered":"2023-10-14T09:18:16.093808+0000","last_unstale":"2023-10-14T09:18:16.100687+0000","last_undegraded":"2023-10-14T09:18:16.100687+0000","last_fullsized":"2023-10-14T09:18:16.100687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:30.113496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077431+0000","last_change":"2023-10-14T09:18:15.645012+0000","last_active":"2023-10-14T09:18:17.077431+0000","last_peered":"2023-10-14T09:18:17.077431+0000","last_clean":"2023-10-14T09:18:17.077431+0000","last_became_active":"2023-10-14T09:18:15.644700+0000","last_became_peered":"2023-10-14T09:18:15.644700+0000","last_unstale":"2023-10-14T09:18:17.077431+0000","last_undegraded":"2023-10-14T09:18:17.077431+0000","last_fullsized":"2023-10-14T09:18:17.077431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:33:26.039696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076403+0000","last_change":"2023-10-14T09:18:16.102238+0000","last_active":"2023-10-14T09:18:17.076403+0000","last_peered":"2023-10-14T09:18:17.076403+0000","last_clean":"2023-10-14T09:18:17.076403+0000","last_became_active":"2023-10-14T09:18:16.101381+0000","last_became_peered":"2023-10-14T09:18:16.101381+0000","last_unstale":"2023-10-14T09:18:17.076403+0000","last_undegraded":"2023-10-14T09:18:17.076403+0000","last_fullsized":"2023-10-14T09:18:17.076403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:42:48.390583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077389+0000","last_change":"2023-10-14T09:18:15.647382+0000","last_active":"2023-10-14T09:18:17.077389+0000","last_peered":"2023-10-14T09:18:17.077389+0000","last_clean":"2023-10-14T09:18:17.077389+0000","last_became_active":"2023-10-14T09:18:15.647076+0000","last_became_peered":"2023-10-14T09:18:15.647076+0000","last_unstale":"2023-10-14T09:18:17.077389+0000","last_undegraded":"2023-10-14T09:18:17.077389+0000","last_fullsized":"2023-10-14T09:18:17.077389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:55.220115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076222+0000","last_change":"2023-10-14T09:18:16.095441+0000","last_active":"2023-10-14T09:18:17.076222+0000","last_peered":"2023-10-14T09:18:17.076222+0000","last_clean":"2023-10-14T09:18:17.076222+0000","last_became_active":"2023-10-14T09:18:16.095085+0000","last_became_peered":"2023-10-14T09:18:16.095085+0000","last_unstale":"2023-10-14T09:18:17.076222+0000","last_undegraded":"2023-10-14T09:18:17.076222+0000","last_fullsized":"2023-10-14T09:18:17.076222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:12.073123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076325+0000","last_change":"2023-10-14T09:18:15.641580+0000","last_active":"2023-10-14T09:18:17.076325+0000","last_peered":"2023-10-14T09:18:17.076325+0000","last_clean":"2023-10-14T09:18:17.076325+0000","last_became_active":"2023-10-14T09:18:15.641312+0000","last_became_peered":"2023-10-14T09:18:15.641312+0000","last_unstale":"2023-10-14T09:18:17.076325+0000","last_undegraded":"2023-10-14T09:18:17.076325+0000","last_fullsized":"2023-10-14T09:18:17.076325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:35.706648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212568+0000","last_change":"2023-10-14T09:18:16.079511+0000","last_active":"2023-10-14T09:18:17.212568+0000","last_peered":"2023-10-14T09:18:17.212568+0000","last_clean":"2023-10-14T09:18:17.212568+0000","last_became_active":"2023-10-14T09:18:16.079263+0000","last_became_peered":"2023-10-14T09:18:16.079263+0000","last_unstale":"2023-10-14T09:18:17.212568+0000","last_undegraded":"2023-10-14T09:18:17.212568+0000","last_fullsized":"2023-10-14T09:18:17.212568+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:42.840106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076305+0000","last_change":"2023-10-14T09:18:15.641614+0000","last_active":"2023-10-14T09:18:17.076305+0000","last_peered":"2023-10-14T09:18:17.076305+0000","last_clean":"2023-10-14T09:18:17.076305+0000","last_became_active":"2023-10-14T09:18:15.641300+0000","last_became_peered":"2023-10-14T09:18:15.641300+0000","last_unstale":"2023-10-14T09:18:17.076305+0000","last_undegraded":"2023-10-14T09:18:17.076305+0000","last_fullsized":"2023-10-14T09:18:17.076305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:38:06.606333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076842+0000","last_change":"2023-10-14T09:18:16.092182+0000","last_active":"2023-10-14T09:18:17.076842+0000","last_peered":"2023-10-14T09:18:17.076842+0000","last_clean":"2023-10-14T09:18:17.076842+0000","last_became_active":"2023-10-14T09:18:16.091048+0000","last_became_peered":"2023-10-14T09:18:16.091048+0000","last_unstale":"2023-10-14T09:18:17.076842+0000","last_undegraded":"2023-10-14T09:18:17.076842+0000","last_fullsized":"2023-10-14T09:18:17.076842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:29.382077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076204+0000","last_change":"2023-10-14T09:18:15.648736+0000","last_active":"2023-10-14T09:18:17.076204+0000","last_peered":"2023-10-14T09:18:17.076204+0000","last_clean":"2023-10-14T09:18:17.076204+0000","last_became_active":"2023-10-14T09:18:15.647638+0000","last_became_peered":"2023-10-14T09:18:15.647638+0000","last_unstale":"2023-10-14T09:18:17.076204+0000","last_undegraded":"2023-10-14T09:18:17.076204+0000","last_fullsized":"2023-10-14T09:18:17.076204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:08:14.479468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076197+0000","last_change":"2023-10-14T09:18:16.091742+0000","last_active":"2023-10-14T09:18:17.076197+0000","last_peered":"2023-10-14T09:18:17.076197+0000","last_clean":"2023-10-14T09:18:17.076197+0000","last_became_active":"2023-10-14T09:18:16.091486+0000","last_became_peered":"2023-10-14T09:18:16.091486+0000","last_unstale":"2023-10-14T09:18:17.076197+0000","last_undegraded":"2023-10-14T09:18:17.076197+0000","last_fullsized":"2023-10-14T09:18:17.076197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:19:40.360848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.097447+0000","last_change":"2023-10-14T09:18:15.649031+0000","last_active":"2023-10-14T09:18:16.097447+0000","last_peered":"2023-10-14T09:18:16.097447+0000","last_clean":"2023-10-14T09:18:16.097447+0000","last_became_active":"2023-10-14T09:18:15.648728+0000","last_became_peered":"2023-10-14T09:18:15.648728+0000","last_unstale":"2023-10-14T09:18:16.097447+0000","last_undegraded":"2023-10-14T09:18:16.097447+0000","last_fullsized":"2023-10-14T09:18:16.097447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:55.220115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075976+0000","last_change":"2023-10-14T09:18:16.101940+0000","last_active":"2023-10-14T09:18:17.075976+0000","last_peered":"2023-10-14T09:18:17.075976+0000","last_clean":"2023-10-14T09:18:17.075976+0000","last_became_active":"2023-10-14T09:18:16.101669+0000","last_became_peered":"2023-10-14T09:18:16.101669+0000","last_unstale":"2023-10-14T09:18:17.075976+0000","last_undegraded":"2023-10-14T09:18:17.075976+0000","last_fullsized":"2023-10-14T09:18:17.075976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:02:03.688166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076647+0000","last_change":"2023-10-14T09:18:15.644516+0000","last_active":"2023-10-14T09:18:17.076647+0000","last_peered":"2023-10-14T09:18:17.076647+0000","last_clean":"2023-10-14T09:18:17.076647+0000","last_became_active":"2023-10-14T09:18:15.644038+0000","last_became_peered":"2023-10-14T09:18:15.644038+0000","last_unstale":"2023-10-14T09:18:17.076647+0000","last_undegraded":"2023-10-14T09:18:17.076647+0000","last_fullsized":"2023-10-14T09:18:17.076647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:08:14.479468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076239+0000","last_change":"2023-10-14T09:18:16.083379+0000","last_active":"2023-10-14T09:18:17.076239+0000","last_peered":"2023-10-14T09:18:17.076239+0000","last_clean":"2023-10-14T09:18:17.076239+0000","last_became_active":"2023-10-14T09:18:16.083012+0000","last_became_peered":"2023-10-14T09:18:16.083012+0000","last_unstale":"2023-10-14T09:18:17.076239+0000","last_undegraded":"2023-10-14T09:18:17.076239+0000","last_fullsized":"2023-10-14T09:18:17.076239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:59.090596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076040+0000","last_change":"2023-10-14T09:18:15.643721+0000","last_active":"2023-10-14T09:18:17.076040+0000","last_peered":"2023-10-14T09:18:17.076040+0000","last_clean":"2023-10-14T09:18:17.076040+0000","last_became_active":"2023-10-14T09:18:15.643390+0000","last_became_peered":"2023-10-14T09:18:15.643390+0000","last_unstale":"2023-10-14T09:18:17.076040+0000","last_undegraded":"2023-10-14T09:18:17.076040+0000","last_fullsized":"2023-10-14T09:18:17.076040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:58.081252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212599+0000","last_change":"2023-10-14T09:18:16.079176+0000","last_active":"2023-10-14T09:18:17.212599+0000","last_peered":"2023-10-14T09:18:17.212599+0000","last_clean":"2023-10-14T09:18:17.212599+0000","last_became_active":"2023-10-14T09:18:16.078895+0000","last_became_peered":"2023-10-14T09:18:16.078895+0000","last_unstale":"2023-10-14T09:18:17.212599+0000","last_undegraded":"2023-10-14T09:18:17.212599+0000","last_fullsized":"2023-10-14T09:18:17.212599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:36.715992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077487+0000","last_change":"2023-10-14T09:18:15.641465+0000","last_active":"2023-10-14T09:18:17.077487+0000","last_peered":"2023-10-14T09:18:17.077487+0000","last_clean":"2023-10-14T09:18:17.077487+0000","last_became_active":"2023-10-14T09:18:15.641180+0000","last_became_peered":"2023-10-14T09:18:15.641180+0000","last_unstale":"2023-10-14T09:18:17.077487+0000","last_undegraded":"2023-10-14T09:18:17.077487+0000","last_fullsized":"2023-10-14T09:18:17.077487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:20:34.510987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075927+0000","last_change":"2023-10-14T09:18:16.098530+0000","last_active":"2023-10-14T09:18:17.075927+0000","last_peered":"2023-10-14T09:18:17.075927+0000","last_clean":"2023-10-14T09:18:17.075927+0000","last_became_active":"2023-10-14T09:18:16.098087+0000","last_became_peered":"2023-10-14T09:18:16.098087+0000","last_unstale":"2023-10-14T09:18:17.075927+0000","last_undegraded":"2023-10-14T09:18:17.075927+0000","last_fullsized":"2023-10-14T09:18:17.075927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:38:29.382077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212567+0000","last_change":"2023-10-14T09:18:15.632702+0000","last_active":"2023-10-14T09:18:17.212567+0000","last_peered":"2023-10-14T09:18:17.212567+0000","last_clean":"2023-10-14T09:18:17.212567+0000","last_became_active":"2023-10-14T09:18:15.632439+0000","last_became_peered":"2023-10-14T09:18:15.632439+0000","last_unstale":"2023-10-14T09:18:17.212567+0000","last_undegraded":"2023-10-14T09:18:17.212567+0000","last_fullsized":"2023-10-14T09:18:17.212567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:17:55.922842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103908+0000","last_change":"2023-10-14T09:18:16.097833+0000","last_active":"2023-10-14T09:18:16.103908+0000","last_peered":"2023-10-14T09:18:16.103908+0000","last_clean":"2023-10-14T09:18:16.103908+0000","last_became_active":"2023-10-14T09:18:16.097560+0000","last_became_peered":"2023-10-14T09:18:16.097560+0000","last_unstale":"2023-10-14T09:18:16.103908+0000","last_undegraded":"2023-10-14T09:18:16.103908+0000","last_fullsized":"2023-10-14T09:18:16.103908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:16:40.775027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076368+0000","last_change":"2023-10-14T09:18:15.649710+0000","last_active":"2023-10-14T09:18:17.076368+0000","last_peered":"2023-10-14T09:18:17.076368+0000","last_clean":"2023-10-14T09:18:17.076368+0000","last_became_active":"2023-10-14T09:18:15.645572+0000","last_became_peered":"2023-10-14T09:18:15.645572+0000","last_unstale":"2023-10-14T09:18:17.076368+0000","last_undegraded":"2023-10-14T09:18:17.076368+0000","last_fullsized":"2023-10-14T09:18:17.076368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:55.957212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100518+0000","last_change":"2023-10-14T09:18:16.091524+0000","last_active":"2023-10-14T09:18:16.100518+0000","last_peered":"2023-10-14T09:18:16.100518+0000","last_clean":"2023-10-14T09:18:16.100518+0000","last_became_active":"2023-10-14T09:18:16.091187+0000","last_became_peered":"2023-10-14T09:18:16.091187+0000","last_unstale":"2023-10-14T09:18:16.100518+0000","last_undegraded":"2023-10-14T09:18:16.100518+0000","last_fullsized":"2023-10-14T09:18:16.100518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:49:14.031144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075626+0000","last_change":"2023-10-14T09:18:15.639843+0000","last_active":"2023-10-14T09:18:17.075626+0000","last_peered":"2023-10-14T09:18:17.075626+0000","last_clean":"2023-10-14T09:18:17.075626+0000","last_became_active":"2023-10-14T09:18:15.638599+0000","last_became_peered":"2023-10-14T09:18:15.638599+0000","last_unstale":"2023-10-14T09:18:17.075626+0000","last_undegraded":"2023-10-14T09:18:17.075626+0000","last_fullsized":"2023-10-14T09:18:17.075626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:11.063779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077760+0000","last_change":"2023-10-14T09:18:16.082550+0000","last_active":"2023-10-14T09:18:17.077760+0000","last_peered":"2023-10-14T09:18:17.077760+0000","last_clean":"2023-10-14T09:18:17.077760+0000","last_became_active":"2023-10-14T09:18:16.082125+0000","last_became_peered":"2023-10-14T09:18:16.082125+0000","last_unstale":"2023-10-14T09:18:17.077760+0000","last_undegraded":"2023-10-14T09:18:17.077760+0000","last_fullsized":"2023-10-14T09:18:17.077760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:42.840106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213132+0000","last_change":"2023-10-14T09:18:15.647930+0000","last_active":"2023-10-14T09:18:17.213132+0000","last_peered":"2023-10-14T09:18:17.213132+0000","last_clean":"2023-10-14T09:18:17.213132+0000","last_became_active":"2023-10-14T09:18:15.645974+0000","last_became_peered":"2023-10-14T09:18:15.645974+0000","last_unstale":"2023-10-14T09:18:17.213132+0000","last_undegraded":"2023-10-14T09:18:17.213132+0000","last_fullsized":"2023-10-14T09:18:17.213132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:29.104151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076882+0000","last_change":"2023-10-14T09:18:16.086619+0000","last_active":"2023-10-14T09:18:17.076882+0000","last_peered":"2023-10-14T09:18:17.076882+0000","last_clean":"2023-10-14T09:18:17.076882+0000","last_became_active":"2023-10-14T09:18:16.086211+0000","last_became_peered":"2023-10-14T09:18:16.086211+0000","last_unstale":"2023-10-14T09:18:17.076882+0000","last_undegraded":"2023-10-14T09:18:17.076882+0000","last_fullsized":"2023-10-14T09:18:17.076882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:02:03.688166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077723+0000","last_change":"2023-10-14T09:18:15.639362+0000","last_active":"2023-10-14T09:18:17.077723+0000","last_peered":"2023-10-14T09:18:17.077723+0000","last_clean":"2023-10-14T09:18:17.077723+0000","last_became_active":"2023-10-14T09:18:15.639100+0000","last_became_peered":"2023-10-14T09:18:15.639100+0000","last_unstale":"2023-10-14T09:18:17.077723+0000","last_undegraded":"2023-10-14T09:18:17.077723+0000","last_fullsized":"2023-10-14T09:18:17.077723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:18.822735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212853+0000","last_change":"2023-10-14T09:18:16.084247+0000","last_active":"2023-10-14T09:18:17.212853+0000","last_peered":"2023-10-14T09:18:17.212853+0000","last_clean":"2023-10-14T09:18:17.212853+0000","last_became_active":"2023-10-14T09:18:16.083726+0000","last_became_peered":"2023-10-14T09:18:16.083726+0000","last_unstale":"2023-10-14T09:18:17.212853+0000","last_undegraded":"2023-10-14T09:18:17.212853+0000","last_fullsized":"2023-10-14T09:18:17.212853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:08:15.488812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077741+0000","last_change":"2023-10-14T09:18:15.642588+0000","last_active":"2023-10-14T09:18:17.077741+0000","last_peered":"2023-10-14T09:18:17.077741+0000","last_clean":"2023-10-14T09:18:17.077741+0000","last_became_active":"2023-10-14T09:18:15.642179+0000","last_became_peered":"2023-10-14T09:18:15.642179+0000","last_unstale":"2023-10-14T09:18:17.077741+0000","last_undegraded":"2023-10-14T09:18:17.077741+0000","last_fullsized":"2023-10-14T09:18:17.077741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:29.104151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.103864+0000","last_change":"2023-10-14T09:18:16.099176+0000","last_active":"2023-10-14T09:18:16.103864+0000","last_peered":"2023-10-14T09:18:16.103864+0000","last_clean":"2023-10-14T09:18:16.103864+0000","last_became_active":"2023-10-14T09:18:16.098686+0000","last_became_peered":"2023-10-14T09:18:16.098686+0000","last_unstale":"2023-10-14T09:18:16.103864+0000","last_undegraded":"2023-10-14T09:18:16.103864+0000","last_fullsized":"2023-10-14T09:18:16.103864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:59.165445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077773+0000","last_change":"2023-10-14T09:18:15.645124+0000","last_active":"2023-10-14T09:18:17.077773+0000","last_peered":"2023-10-14T09:18:17.077773+0000","last_clean":"2023-10-14T09:18:17.077773+0000","last_became_active":"2023-10-14T09:18:15.644777+0000","last_became_peered":"2023-10-14T09:18:15.644777+0000","last_unstale":"2023-10-14T09:18:17.077773+0000","last_undegraded":"2023-10-14T09:18:17.077773+0000","last_fullsized":"2023-10-14T09:18:17.077773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:54.244172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.091408+0000","last_change":"2023-10-14T09:18:16.086895+0000","last_active":"2023-10-14T09:18:16.091408+0000","last_peered":"2023-10-14T09:18:16.091408+0000","last_clean":"2023-10-14T09:18:16.091408+0000","last_became_active":"2023-10-14T09:18:16.086620+0000","last_became_peered":"2023-10-14T09:18:16.086620+0000","last_unstale":"2023-10-14T09:18:16.091408+0000","last_undegraded":"2023-10-14T09:18:16.091408+0000","last_fullsized":"2023-10-14T09:18:16.091408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:34:14.674399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.648440+0000","last_change":"2023-10-14T09:18:15.638747+0000","last_active":"2023-10-14T09:18:16.648440+0000","last_peered":"2023-10-14T09:18:16.648440+0000","last_clean":"2023-10-14T09:18:16.648440+0000","last_became_active":"2023-10-14T09:18:15.638480+0000","last_became_peered":"2023-10-14T09:18:15.638480+0000","last_unstale":"2023-10-14T09:18:16.648440+0000","last_undegraded":"2023-10-14T09:18:16.648440+0000","last_fullsized":"2023-10-14T09:18:16.648440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:18.822735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.106308+0000","last_change":"2023-10-14T09:18:16.099719+0000","last_active":"2023-10-14T09:18:16.106308+0000","last_peered":"2023-10-14T09:18:16.106308+0000","last_clean":"2023-10-14T09:18:16.106308+0000","last_became_active":"2023-10-14T09:18:16.098342+0000","last_became_peered":"2023-10-14T09:18:16.098342+0000","last_unstale":"2023-10-14T09:18:16.106308+0000","last_undegraded":"2023-10-14T09:18:16.106308+0000","last_fullsized":"2023-10-14T09:18:16.106308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:19:43.739074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.086695+0000","last_change":"2023-10-14T09:18:15.642503+0000","last_active":"2023-10-14T09:18:16.086695+0000","last_peered":"2023-10-14T09:18:16.086695+0000","last_clean":"2023-10-14T09:18:16.086695+0000","last_became_active":"2023-10-14T09:18:15.641903+0000","last_became_peered":"2023-10-14T09:18:15.641903+0000","last_unstale":"2023-10-14T09:18:16.086695+0000","last_undegraded":"2023-10-14T09:18:16.086695+0000","last_fullsized":"2023-10-14T09:18:16.086695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:45.191949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.096342+0000","last_change":"2023-10-14T09:18:16.093366+0000","last_active":"2023-10-14T09:18:16.096342+0000","last_peered":"2023-10-14T09:18:16.096342+0000","last_clean":"2023-10-14T09:18:16.096342+0000","last_became_active":"2023-10-14T09:18:16.093075+0000","last_became_peered":"2023-10-14T09:18:16.093075+0000","last_unstale":"2023-10-14T09:18:16.096342+0000","last_undegraded":"2023-10-14T09:18:16.096342+0000","last_fullsized":"2023-10-14T09:18:16.096342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:17.738984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076749+0000","last_change":"2023-10-14T09:18:15.635106+0000","last_active":"2023-10-14T09:18:17.076749+0000","last_peered":"2023-10-14T09:18:17.076749+0000","last_clean":"2023-10-14T09:18:17.076749+0000","last_became_active":"2023-10-14T09:18:15.634750+0000","last_became_peered":"2023-10-14T09:18:15.634750+0000","last_unstale":"2023-10-14T09:18:17.076749+0000","last_undegraded":"2023-10-14T09:18:17.076749+0000","last_fullsized":"2023-10-14T09:18:17.076749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:45.191949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100720+0000","last_change":"2023-10-14T09:18:16.094958+0000","last_active":"2023-10-14T09:18:16.100720+0000","last_peered":"2023-10-14T09:18:16.100720+0000","last_clean":"2023-10-14T09:18:16.100720+0000","last_became_active":"2023-10-14T09:18:16.094723+0000","last_became_peered":"2023-10-14T09:18:16.094723+0000","last_unstale":"2023-10-14T09:18:16.100720+0000","last_undegraded":"2023-10-14T09:18:16.100720+0000","last_fullsized":"2023-10-14T09:18:16.100720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:19.832080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076216+0000","last_change":"2023-10-14T09:18:15.645045+0000","last_active":"2023-10-14T09:18:17.076216+0000","last_peered":"2023-10-14T09:18:17.076216+0000","last_clean":"2023-10-14T09:18:17.076216+0000","last_became_active":"2023-10-14T09:18:15.644747+0000","last_became_peered":"2023-10-14T09:18:15.644747+0000","last_unstale":"2023-10-14T09:18:17.076216+0000","last_undegraded":"2023-10-14T09:18:17.076216+0000","last_fullsized":"2023-10-14T09:18:17.076216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:16:39.765683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.091758+0000","last_change":"2023-10-14T09:18:16.087100+0000","last_active":"2023-10-14T09:18:16.091758+0000","last_peered":"2023-10-14T09:18:16.091758+0000","last_clean":"2023-10-14T09:18:16.091758+0000","last_became_active":"2023-10-14T09:18:16.086754+0000","last_became_peered":"2023-10-14T09:18:16.086754+0000","last_unstale":"2023-10-14T09:18:16.091758+0000","last_undegraded":"2023-10-14T09:18:16.091758+0000","last_fullsized":"2023-10-14T09:18:16.091758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:09.610273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.213148+0000","last_change":"2023-10-14T09:18:15.638964+0000","last_active":"2023-10-14T09:18:17.213148+0000","last_peered":"2023-10-14T09:18:17.213148+0000","last_clean":"2023-10-14T09:18:17.213148+0000","last_became_active":"2023-10-14T09:18:15.638675+0000","last_became_peered":"2023-10-14T09:18:15.638675+0000","last_unstale":"2023-10-14T09:18:17.213148+0000","last_undegraded":"2023-10-14T09:18:17.213148+0000","last_fullsized":"2023-10-14T09:18:17.213148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:23:18.822735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077019+0000","last_change":"2023-10-14T09:18:16.080912+0000","last_active":"2023-10-14T09:18:17.077019+0000","last_peered":"2023-10-14T09:18:17.077019+0000","last_clean":"2023-10-14T09:18:17.077019+0000","last_became_active":"2023-10-14T09:18:16.080580+0000","last_became_peered":"2023-10-14T09:18:16.080580+0000","last_unstale":"2023-10-14T09:18:17.077019+0000","last_undegraded":"2023-10-14T09:18:17.077019+0000","last_fullsized":"2023-10-14T09:18:17.077019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:44:10.641703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.097524+0000","last_change":"2023-10-14T09:18:15.639852+0000","last_active":"2023-10-14T09:18:16.097524+0000","last_peered":"2023-10-14T09:18:16.097524+0000","last_clean":"2023-10-14T09:18:16.097524+0000","last_became_active":"2023-10-14T09:18:15.639344+0000","last_became_peered":"2023-10-14T09:18:15.639344+0000","last_unstale":"2023-10-14T09:18:16.097524+0000","last_undegraded":"2023-10-14T09:18:16.097524+0000","last_fullsized":"2023-10-14T09:18:16.097524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:29.104151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100779+0000","last_change":"2023-10-14T09:18:16.096712+0000","last_active":"2023-10-14T09:18:16.100779+0000","last_peered":"2023-10-14T09:18:16.100779+0000","last_clean":"2023-10-14T09:18:16.100779+0000","last_became_active":"2023-10-14T09:18:16.096426+0000","last_became_peered":"2023-10-14T09:18:16.096426+0000","last_unstale":"2023-10-14T09:18:16.100779+0000","last_undegraded":"2023-10-14T09:18:16.100779+0000","last_fullsized":"2023-10-14T09:18:16.100779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:46.201293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212925+0000","last_change":"2023-10-14T09:18:15.641459+0000","last_active":"2023-10-14T09:18:17.212925+0000","last_peered":"2023-10-14T09:18:17.212925+0000","last_clean":"2023-10-14T09:18:17.212925+0000","last_became_active":"2023-10-14T09:18:15.640486+0000","last_became_peered":"2023-10-14T09:18:15.640486+0000","last_unstale":"2023-10-14T09:18:17.212925+0000","last_undegraded":"2023-10-14T09:18:17.212925+0000","last_fullsized":"2023-10-14T09:18:17.212925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:47.715078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.104406+0000","last_change":"2023-10-14T09:18:16.095382+0000","last_active":"2023-10-14T09:18:16.104406+0000","last_peered":"2023-10-14T09:18:16.104406+0000","last_clean":"2023-10-14T09:18:16.104406+0000","last_became_active":"2023-10-14T09:18:16.095042+0000","last_became_peered":"2023-10-14T09:18:16.095042+0000","last_unstale":"2023-10-14T09:18:16.104406+0000","last_undegraded":"2023-10-14T09:18:16.104406+0000","last_fullsized":"2023-10-14T09:18:16.104406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:33:27.049041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.097441+0000","last_change":"2023-10-14T09:18:15.647241+0000","last_active":"2023-10-14T09:18:16.097441+0000","last_peered":"2023-10-14T09:18:16.097441+0000","last_clean":"2023-10-14T09:18:16.097441+0000","last_became_active":"2023-10-14T09:18:15.646945+0000","last_became_peered":"2023-10-14T09:18:15.646945+0000","last_unstale":"2023-10-14T09:18:16.097441+0000","last_undegraded":"2023-10-14T09:18:16.097441+0000","last_fullsized":"2023-10-14T09:18:16.097441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:54.244172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.100804+0000","last_change":"2023-10-14T09:18:16.097653+0000","last_active":"2023-10-14T09:18:16.100804+0000","last_peered":"2023-10-14T09:18:16.100804+0000","last_clean":"2023-10-14T09:18:16.100804+0000","last_became_active":"2023-10-14T09:18:16.097103+0000","last_became_peered":"2023-10-14T09:18:16.097103+0000","last_unstale":"2023-10-14T09:18:16.100804+0000","last_undegraded":"2023-10-14T09:18:16.100804+0000","last_fullsized":"2023-10-14T09:18:16.100804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:33:27.049041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.212650+0000","last_change":"2023-10-14T09:18:15.634463+0000","last_active":"2023-10-14T09:18:17.212650+0000","last_peered":"2023-10-14T09:18:17.212650+0000","last_clean":"2023-10-14T09:18:17.212650+0000","last_became_active":"2023-10-14T09:18:15.634180+0000","last_became_peered":"2023-10-14T09:18:15.634180+0000","last_unstale":"2023-10-14T09:18:17.212650+0000","last_undegraded":"2023-10-14T09:18:17.212650+0000","last_fullsized":"2023-10-14T09:18:17.212650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:12.182340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075620+0000","last_change":"2023-10-14T09:18:16.093022+0000","last_active":"2023-10-14T09:18:17.075620+0000","last_peered":"2023-10-14T09:18:17.075620+0000","last_clean":"2023-10-14T09:18:17.075620+0000","last_became_active":"2023-10-14T09:18:16.091960+0000","last_became_peered":"2023-10-14T09:18:16.091960+0000","last_unstale":"2023-10-14T09:18:17.075620+0000","last_undegraded":"2023-10-14T09:18:17.075620+0000","last_fullsized":"2023-10-14T09:18:17.075620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:36.911030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.077136+0000","last_change":"2023-10-14T09:18:15.636294+0000","last_active":"2023-10-14T09:18:17.077136+0000","last_peered":"2023-10-14T09:18:17.077136+0000","last_clean":"2023-10-14T09:18:17.077136+0000","last_became_active":"2023-10-14T09:18:15.636041+0000","last_became_peered":"2023-10-14T09:18:15.636041+0000","last_unstale":"2023-10-14T09:18:17.077136+0000","last_undegraded":"2023-10-14T09:18:17.077136+0000","last_fullsized":"2023-10-14T09:18:17.077136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:17:55.922842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.076570+0000","last_change":"2023-10-14T09:18:16.092214+0000","last_active":"2023-10-14T09:18:17.076570+0000","last_peered":"2023-10-14T09:18:17.076570+0000","last_clean":"2023-10-14T09:18:17.076570+0000","last_became_active":"2023-10-14T09:18:16.091834+0000","last_became_peered":"2023-10-14T09:18:16.091834+0000","last_unstale":"2023-10-14T09:18:17.076570+0000","last_undegraded":"2023-10-14T09:18:17.076570+0000","last_fullsized":"2023-10-14T09:18:17.076570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:26:13.191684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T09:18:17.075710+0000","last_change":"2023-10-14T09:18:15.645719+0000","last_active":"2023-10-14T09:18:17.075710+0000","last_peered":"2023-10-14T09:18:17.075710+0000","last_clean":"2023-10-14T09:18:17.075710+0000","last_became_active":"2023-10-14T09:18:15.645368+0000","last_became_peered":"2023-10-14T09:18:15.645368+0000","last_unstale":"2023-10-14T09:18:17.075710+0000","last_undegraded":"2023-10-14T09:18:17.075710+0000","last_fullsized":"2023-10-14T09:18:17.075710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:47.715078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.104781+0000","last_change":"2023-10-14T09:18:16.099820+0000","last_active":"2023-10-14T09:18:16.104781+0000","last_peered":"2023-10-14T09:18:16.104781+0000","last_clean":"2023-10-14T09:18:16.104781+0000","last_became_active":"2023-10-14T09:18:16.099523+0000","last_became_peered":"2023-10-14T09:18:16.099523+0000","last_unstale":"2023-10-14T09:18:16.104781+0000","last_undegraded":"2023-10-14T09:18:16.104781+0000","last_fullsized":"2023-10-14T09:18:16.104781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:15.614964+0000","last_clean_scrub_stamp":"2023-10-14T09:18:15.614964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:36.715992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T09:18:16.086870+0000","last_change":"2023-10-14T09:18:15.648446+0000","last_active":"2023-10-14T09:18:16.086870+0000","last_peered":"2023-10-14T09:18:16.086870+0000","last_clean":"2023-10-14T09:18:16.086870+0000","last_became_active":"2023-10-14T09:18:15.647442+0000","last_became_peered":"2023-10-14T09:18:15.647442+0000","last_unstale":"2023-10-14T09:18:16.086870+0000","last_undegraded":"2023-10-14T09:18:16.086870+0000","last_fullsized":"2023-10-14T09:18:16.086870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:18:14.605620+0000","last_clean_scrub_stamp":"2023-10-14T09:18:14.605620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:17:55.922842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T09:18:15.640678+0000","last_change":"2023-10-14T09:17:14.304224+0000","last_active":"2023-10-14T09:18:15.640678+0000","last_peered":"2023-10-14T09:18:15.640678+0000","last_clean":"2023-10-14T09:18:15.640678+0000","last_became_active":"2023-10-14T09:17:14.303743+0000","last_became_peered":"2023-10-14T09:17:14.303743+0000","last_unstale":"2023-10-14T09:18:15.640678+0000","last_undegraded":"2023-10-14T09:18:15.640678+0000","last_fullsized":"2023-10-14T09:18:15.640678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_clean_scrub_stamp":"2023-10-14T09:17:13.285641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:24.100243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":725078,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.434},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.875},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.76300000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.90500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":134620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.5389999999999997,"5min":5.5389999999999997,"15min":5.5389999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.4489999999999998,"5min":5.4489999999999998,"15min":5.4489999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.73999999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":5.4770000000000003,"5min":5.4770000000000003,"15min":5.4770000000000003},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72099999999999997}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.62},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.64200000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.83399999999999996}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.54500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":135292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59399999999999997}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.754}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.86599999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.78700000000000003}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.85099999999999998}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.94599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":356352,"data_stored":134724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":6.6749999999999998,"5min":6.6749999999999998,"15min":6.6749999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.79700000000000004}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.74099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":134620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.46899999999999997}]},{"osd":2,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.58299999999999996}]},{"osd":4,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.755}]},{"osd":5,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.80800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":134620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.377}]},{"osd":1,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.1680000000000001,"5min":4.1680000000000001,"15min":4.1680000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.5}]},{"osd":5,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":4.4219999999999997},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":4.5030000000000001,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.5499999999999998,"5min":4.5499999999999998,"15min":4.5499999999999998},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":134620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.438}]},{"osd":2,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53100000000000003}]},{"osd":4,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.66400000000000003}]},{"osd":5,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.629}]},{"osd":6,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.73499999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":724988,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54200000000000004}]},{"osd":3,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.52100000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.748},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:18:21.081 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T09:18:21.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-14T09:18:21.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7785b48640 1 Processor -- start 2023-10-14T09:18:21.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7785b48640 1 -- start start 2023-10-14T09:18:21.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7785b48640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77800c6320 0x7f77800c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7785b48640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f77800bcc50 0x7f7780153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7785b48640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77800c4360 con 0x7f778006c900 2023-10-14T09:18:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7785b48640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7780157c20 con 0x7f77800c6320 2023-10-14T09:18:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7785b48640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77800c4010 con 0x7f77800bcc50 2023-10-14T09:18:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7784b46640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77800c6320 0x7f77800c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7785347640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f778006c900 0x7f77801540c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40506/0 (socket says 172.21.15.78:40506) 2023-10-14T09:18:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7785347640 1 -- 172.21.15.78:0/1130704079 learned_addr learned my addr 172.21.15.78:0/1130704079 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7777fff640 1 --2- 172.21.15.78:0/1130704079 >> v2:172.21.15.157:3300/0 conn(0x7f77800bcc50 0x7f7780153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7784b46640 1 -- 172.21.15.78:0/1130704079 >> v2:172.21.15.157:3300/0 conn(0x7f77800bcc50 msgr2=0x7f7780153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7784b46640 1 --2- 172.21.15.78:0/1130704079 >> v2:172.21.15.157:3300/0 conn(0x7f77800bcc50 0x7f7780153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7784b46640 1 -- 172.21.15.78:0/1130704079 >> v1:172.21.15.78:6789/0 conn(0x7f778006c900 legacy=0x7f77801540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.259+0000 7f7784b46640 1 -- 172.21.15.78:0/1130704079 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7780157ec0 con 0x7f77800c6320 2023-10-14T09:18:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f7784b46640 1 --2- 172.21.15.78:0/1130704079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77800c6320 0x7f77800c6700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f77800c3af0 tx=0x7f777c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a64f4bbeaa9b01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f77777fe640 1 -- 172.21.15.78:0/1130704079 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c0ab600 con 0x7f77800c6320 2023-10-14T09:18:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f77777fe640 1 -- 172.21.15.78:0/1130704079 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c0a7050 con 0x7f77800c6320 2023-10-14T09:18:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f77777fe640 1 -- 172.21.15.78:0/1130704079 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c0ab980 con 0x7f77800c6320 2023-10-14T09:18:21.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f7785b48640 1 -- 172.21.15.78:0/1130704079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77800c6320 msgr2=0x7f77800c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f7785b48640 1 --2- 172.21.15.78:0/1130704079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77800c6320 0x7f77800c6700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f77800c3af0 tx=0x7f777c01c260 comp rx=0 tx=0).stop 2023-10-14T09:18:21.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f7785b48640 1 -- 172.21.15.78:0/1130704079 shutdown_connections 2023-10-14T09:18:21.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f7785b48640 1 --2- 172.21.15.78:0/1130704079 >> v2:172.21.15.157:3300/0 conn(0x7f77800bcc50 0x7f7780153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f7785b48640 1 --2- 172.21.15.78:0/1130704079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77800c6320 0x7f77800c6700 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f7785b48640 1 -- 172.21.15.78:0/1130704079 >> 172.21.15.78:0/1130704079 conn(0x7f7780071790 msgr2=0x7f7780071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:21.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f7785b48640 1 -- 172.21.15.78:0/1130704079 shutdown_connections 2023-10-14T09:18:21.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f7785b48640 1 -- 172.21.15.78:0/1130704079 wait complete. 2023-10-14T09:18:21.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.263+0000 7f7785b48640 1 Processor -- start 2023-10-14T09:18:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785b48640 1 -- start start 2023-10-14T09:18:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785b48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778006c900 0x7f77800c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785b48640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77800c6320 0x7f7780153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785b48640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f778014f810 0x7f778014fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785b48640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77800c0ce0 con 0x7f778006c900 2023-10-14T09:18:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785b48640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77800bd040 con 0x7f778014f810 2023-10-14T09:18:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785b48640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77801501e0 con 0x7f77800c6320 2023-10-14T09:18:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7784b46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778006c900 0x7f77800c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7784b46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778006c900 0x7f77800c05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58942/0 (socket says 172.21.15.78:58942) 2023-10-14T09:18:21.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7784b46640 1 -- 172.21.15.78:0/829790634 learned_addr learned my addr 172.21.15.78:0/829790634 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:21.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7777fff640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77800c6320 0x7f7780153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785347640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f778014f810 0x7f778014fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7784b46640 1 -- 172.21.15.78:0/829790634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77800c6320 msgr2=0x7f7780153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7784b46640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77800c6320 0x7f7780153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7784b46640 1 -- 172.21.15.78:0/829790634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f778014f810 msgr2=0x7f778014fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7784b46640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f778014f810 0x7f778014fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7784b46640 1 -- 172.21.15.78:0/829790634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c009420 con 0x7f778006c900 2023-10-14T09:18:21.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785347640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f778014f810 0x7f778014fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:21.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7784b46640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778006c900 0x7f77800c05e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f777c0ae040 tx=0x7f777c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:21.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f77757fa640 1 -- 172.21.15.78:0/829790634 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c0b48e0 con 0x7f778006c900 2023-10-14T09:18:21.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f77757fa640 1 -- 172.21.15.78:0/829790634 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c0a4e90 con 0x7f778006c900 2023-10-14T09:18:21.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785b48640 1 -- 172.21.15.78:0/829790634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77800bfa90 con 0x7f778006c900 2023-10-14T09:18:21.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f77757fa640 1 -- 172.21.15.78:0/829790634 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c0b4ca0 con 0x7f778006c900 2023-10-14T09:18:21.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785b48640 1 -- 172.21.15.78:0/829790634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77800c0050 con 0x7f778006c900 2023-10-14T09:18:21.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.267+0000 7f7785b48640 1 -- 172.21.15.78:0/829790634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77800c0240 con 0x7f778006c900 2023-10-14T09:18:21.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.271+0000 7f77757fa640 1 -- 172.21.15.78:0/829790634 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f777c0b2040 con 0x7f778006c900 2023-10-14T09:18:21.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.271+0000 7f77757fa640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f776c0664d0 0x7f776c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.271+0000 7f77757fa640 1 -- 172.21.15.78:0/829790634 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f777c11e1c0 con 0x7f778006c900 2023-10-14T09:18:21.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.271+0000 7f7777fff640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f776c0664d0 0x7f776c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.271+0000 7f7777fff640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f776c0664d0 0x7f776c068990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7780153e90 tx=0x7f7770008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:21.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.275+0000 7f77757fa640 1 -- 172.21.15.78:0/829790634 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f777c0eb610 con 0x7f778006c900 2023-10-14T09:18:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.487+0000 7f7785b48640 1 -- 172.21.15.78:0/829790634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7f7780074110 con 0x7f778006c900 2023-10-14T09:18:21.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.491+0000 7f77757fa640 1 -- 172.21.15.78:0/829790634 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 195+0+152 (secure 0 0 0) 0x7f777c0eec30 con 0x7f778006c900 2023-10-14T09:18:21.496 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-10-14T09:18:21.496 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBsXCplSecJBhAAyIuXUmhDhdaJgqqjjqAa/w== 2023-10-14T09:18:21.497 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2023-10-14T09:18:21.497 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2023-10-14T09:18:21.497 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-14T09:18:21.498 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-10-14T09:18:21.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 -- 172.21.15.78:0/829790634 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f776c0664d0 msgr2=0x7f776c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f776c0664d0 0x7f776c068990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7780153e90 tx=0x7f7770008040 comp rx=0 tx=0).stop 2023-10-14T09:18:21.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 -- 172.21.15.78:0/829790634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778006c900 msgr2=0x7f77800c05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778006c900 0x7f77800c05e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f777c0ae040 tx=0x7f777c019000 comp rx=0 tx=0).stop 2023-10-14T09:18:21.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 -- 172.21.15.78:0/829790634 shutdown_connections 2023-10-14T09:18:21.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f778014f810 0x7f778014fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f776c0664d0 0x7f776c068990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77800c6320 0x7f7780153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 --2- 172.21.15.78:0/829790634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778006c900 0x7f77800c05e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 -- 172.21.15.78:0/829790634 >> 172.21.15.78:0/829790634 conn(0x7f7780071790 msgr2=0x7f7780152230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:21.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 -- 172.21.15.78:0/829790634 shutdown_connections 2023-10-14T09:18:21.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.495+0000 7f7785b48640 1 -- 172.21.15.78:0/829790634 wait complete. 2023-10-14T09:18:21.517 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:21.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe168417640 1 Processor -- start 2023-10-14T09:18:21.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe168417640 1 -- start start 2023-10-14T09:18:21.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe168417640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe16013b050 0x7fe160155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe168417640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe1600a8360 0x7fe1600a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe168417640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe160152a60 con 0x7fe16006cd70 2023-10-14T09:18:21.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe168417640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1600a9340 con 0x7fe16013b050 2023-10-14T09:18:21.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe168417640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe160155fb0 con 0x7fe1600a8360 2023-10-14T09:18:21.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe1661b3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe16013b050 0x7fe160155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe1669b4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe16006cd70 0x7fe16006d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40520/0 (socket says 172.21.15.78:40520) 2023-10-14T09:18:21.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe1669b4640 1 -- 172.21.15.78:0/3631016051 learned_addr learned my addr 172.21.15.78:0/3631016051 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:21.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe1659b2640 1 --2- 172.21.15.78:0/3631016051 >> v2:172.21.15.157:3300/0 conn(0x7fe1600a8360 0x7fe1600a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe1661b3640 1 -- 172.21.15.78:0/3631016051 >> v2:172.21.15.157:3300/0 conn(0x7fe1600a8360 msgr2=0x7fe1600a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:21.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe1661b3640 1 --2- 172.21.15.78:0/3631016051 >> v2:172.21.15.157:3300/0 conn(0x7fe1600a8360 0x7fe1600a87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe1661b3640 1 -- 172.21.15.78:0/3631016051 >> v1:172.21.15.78:6789/0 conn(0x7fe16006cd70 legacy=0x7fe16006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe1661b3640 1 -- 172.21.15.78:0/3631016051 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160151e50 con 0x7fe16013b050 2023-10-14T09:18:21.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe1651b1640 1 -- 172.21.15.78:0/3631016051 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399682434 0 0) 0x7fe160152a60 con 0x7fe16006cd70 2023-10-14T09:18:21.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.651+0000 7fe1659b2640 1 --2- 172.21.15.78:0/3631016051 >> v2:172.21.15.157:3300/0 conn(0x7fe1600a8360 0x7fe1600a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe1661b3640 1 --2- 172.21.15.78:0/3631016051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16013b050 0x7fe160155a70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe16006dec0 tx=0x7fe15c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d8233efe84cdea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe1651b1640 1 -- 172.21.15.78:0/3631016051 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c0ac600 con 0x7fe16013b050 2023-10-14T09:18:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe1651b1640 1 -- 172.21.15.78:0/3631016051 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15c0a8050 con 0x7fe16013b050 2023-10-14T09:18:21.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe1651b1640 1 -- 172.21.15.78:0/3631016051 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c0ac980 con 0x7fe16013b050 2023-10-14T09:18:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe168417640 1 -- 172.21.15.78:0/3631016051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16013b050 msgr2=0x7fe160155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe168417640 1 --2- 172.21.15.78:0/3631016051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16013b050 0x7fe160155a70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe16006dec0 tx=0x7fe15c01c3a0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe168417640 1 -- 172.21.15.78:0/3631016051 shutdown_connections 2023-10-14T09:18:21.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe168417640 1 --2- 172.21.15.78:0/3631016051 >> v2:172.21.15.157:3300/0 conn(0x7fe1600a8360 0x7fe1600a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe168417640 1 --2- 172.21.15.78:0/3631016051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16013b050 0x7fe160155a70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe168417640 1 -- 172.21.15.78:0/3631016051 >> 172.21.15.78:0/3631016051 conn(0x7fe1600c1cc0 msgr2=0x7fe1600c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe168417640 1 -- 172.21.15.78:0/3631016051 shutdown_connections 2023-10-14T09:18:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.655+0000 7fe168417640 1 -- 172.21.15.78:0/3631016051 wait complete. 2023-10-14T09:18:21.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe168417640 1 Processor -- start 2023-10-14T09:18:21.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe168417640 1 -- start start 2023-10-14T09:18:21.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe168417640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe16006cd70 0x7fe160134ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe168417640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600a8360 0x7fe1601ef290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe168417640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16013b050 0x7fe16014f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe168417640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe160134630 con 0x7fe16013b050 2023-10-14T09:18:21.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe168417640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe160135000 con 0x7fe16006cd70 2023-10-14T09:18:21.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe168417640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe160130240 con 0x7fe1600a8360 2023-10-14T09:18:21.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1669b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16013b050 0x7fe16014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1669b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16013b050 0x7fe16014f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58952/0 (socket says 172.21.15.78:58952) 2023-10-14T09:18:21.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1669b4640 1 -- 172.21.15.78:0/1668836107 learned_addr learned my addr 172.21.15.78:0/1668836107 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:21.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1659b2640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600a8360 0x7fe1601ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1661b3640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe16006cd70 0x7fe160134ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1669b4640 1 -- 172.21.15.78:0/1668836107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600a8360 msgr2=0x7fe1601ef290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1669b4640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600a8360 0x7fe1601ef290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1669b4640 1 -- 172.21.15.78:0/1668836107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe16006cd70 msgr2=0x7fe160134ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1669b4640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe16006cd70 0x7fe160134ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1669b4640 1 -- 172.21.15.78:0/1668836107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c009420 con 0x7fe16013b050 2023-10-14T09:18:21.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1659b2640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600a8360 0x7fe1601ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:21.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe1669b4640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16013b050 0x7fe16014f350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe158001570 tx=0x7fe15800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:21.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe156ffd640 1 -- 172.21.15.78:0/1668836107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15800a640 con 0x7fe16013b050 2023-10-14T09:18:21.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe156ffd640 1 -- 172.21.15.78:0/1668836107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15800a7c0 con 0x7fe16013b050 2023-10-14T09:18:21.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe168417640 1 -- 172.21.15.78:0/1668836107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1600719e0 con 0x7fe16013b050 2023-10-14T09:18:21.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe156ffd640 1 -- 172.21.15.78:0/1668836107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15800ab70 con 0x7fe16013b050 2023-10-14T09:18:21.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.659+0000 7fe168417640 1 -- 172.21.15.78:0/1668836107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe160071700 con 0x7fe16013b050 2023-10-14T09:18:21.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.663+0000 7fe168417640 1 -- 172.21.15.78:0/1668836107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1601347e0 con 0x7fe16013b050 2023-10-14T09:18:21.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.663+0000 7fe156ffd640 1 -- 172.21.15.78:0/1668836107 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe15800acd0 con 0x7fe16013b050 2023-10-14T09:18:21.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.667+0000 7fe156ffd640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe1440664a0 0x7fe144068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:21.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.667+0000 7fe156ffd640 1 -- 172.21.15.78:0/1668836107 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe158083790 con 0x7fe16013b050 2023-10-14T09:18:21.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.667+0000 7fe1661b3640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe1440664a0 0x7fe144068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:21.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.667+0000 7fe1661b3640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe1440664a0 0x7fe144068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0ae000 tx=0x7fe15c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:21.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.667+0000 7fe156ffd640 1 -- 172.21.15.78:0/1668836107 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe158050d10 con 0x7fe16013b050 2023-10-14T09:18:21.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.847+0000 7fe168417640 1 -- 172.21.15.78:0/1668836107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1601347e0 con 0x7fe16013b050 2023-10-14T09:18:21.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.847+0000 7fe156ffd640 1 -- 172.21.15.78:0/1668836107 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fe1601347e0 con 0x7fe16013b050 2023-10-14T09:18:21.854 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:21.854 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:18:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:18:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 -- 172.21.15.78:0/1668836107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe1440664a0 msgr2=0x7fe144068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe1440664a0 0x7fe144068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0ae000 tx=0x7fe15c0a7000 comp rx=0 tx=0).stop 2023-10-14T09:18:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 -- 172.21.15.78:0/1668836107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16013b050 msgr2=0x7fe16014f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16013b050 0x7fe16014f350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe158001570 tx=0x7fe15800cca0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 -- 172.21.15.78:0/1668836107 shutdown_connections 2023-10-14T09:18:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16013b050 0x7fe16014f350 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe1440664a0 0x7fe144068960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe1600a8360 0x7fe1601ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 --2- 172.21.15.78:0/1668836107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe16006cd70 0x7fe160134ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:21.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 -- 172.21.15.78:0/1668836107 >> 172.21.15.78:0/1668836107 conn(0x7fe1600c1cc0 msgr2=0x7fe1600c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:21.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 -- 172.21.15.78:0/1668836107 shutdown_connections 2023-10-14T09:18:21.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:21.851+0000 7fe168417640 1 -- 172.21.15.78:0/1668836107 wait complete. 2023-10-14T09:18:22.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T09:18:16.002036+0000', 'modified': '2023-10-14T09:18:19.017889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5109}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5109': {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T09:18:22.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T09:18:22.278 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T09:18:22.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.411+0000 7fbcb3565640 1 Processor -- start 2023-10-14T09:18:22.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.411+0000 7fbcb3565640 1 -- start start 2023-10-14T09:18:22.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb3565640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fbcac0c3a30 0x7fbcac154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb3565640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcac06af50 0x7fbcac154740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb3565640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac0c1be0 con 0x7fbcac151610 2023-10-14T09:18:22.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb3565640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac0a55b0 con 0x7fbcac0c3a30 2023-10-14T09:18:22.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb3565640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac157e20 con 0x7fbcac06af50 2023-10-14T09:18:22.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb1301640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbcac151610 0x7fbcac06d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40536/0 (socket says 172.21.15.78:40536) 2023-10-14T09:18:22.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb1301640 1 -- 172.21.15.78:0/3892412372 learned_addr learned my addr 172.21.15.78:0/3892412372 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:22.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736219621 0 0) 0x7fbcac0c1be0 con 0x7fbcac151610 2023-10-14T09:18:22.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc98003530 con 0x7fbcac151610 2023-10-14T09:18:22.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/3892412372 >> v2:172.21.15.157:3300/0 conn(0x7fbcac0c3a30 0x7fbcac154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcac06af50 0x7fbcac154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281889771 0 0) 0x7fbc98003530 con 0x7fbcac151610 2023-10-14T09:18:22.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcac06af50 msgr2=0x7fbcac154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcac06af50 0x7fbcac154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 >> v2:172.21.15.157:3300/0 conn(0x7fbcac0c3a30 msgr2=0x7fbcac154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 --2- 172.21.15.78:0/3892412372 >> v2:172.21.15.157:3300/0 conn(0x7fbcac0c3a30 0x7fbcac154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac06e610 con 0x7fbcac151610 2023-10-14T09:18:22.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7fbca8001680 con 0x7fbcac151610 2023-10-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 >> v1:172.21.15.78:6789/0 conn(0x7fbcac151610 legacy=0x7fbcac06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc98003980 0x7fbc98003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc980047d0 0x7fbc98004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcac06af50 0x7fbc98005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0a55b0 con 0x7fbc98003980 2023-10-14T09:18:22.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac157e20 con 0x7fbc980047d0 2023-10-14T09:18:22.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9800baf0 con 0x7fbcac06af50 2023-10-14T09:18:22.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb1301640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc98003980 0x7fbc98003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc980047d0 0x7fbc98004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcac06af50 0x7fbc98005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb1301640 1 -- 172.21.15.78:0/3892412372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcac06af50 msgr2=0x7fbc98005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb1301640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbcac06af50 0x7fbc98005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb1301640 1 -- 172.21.15.78:0/3892412372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc980047d0 msgr2=0x7fbc98004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb1301640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbc980047d0 0x7fbc98004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.415+0000 7fbcb1301640 1 -- 172.21.15.78:0/3892412372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc98003530 con 0x7fbc98003980 2023-10-14T09:18:22.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbcb1301640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc98003980 0x7fbc98003d60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbca8008fd0 tx=0x7fbca801cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6443efe4bf66f4a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:22.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8005ae0 con 0x7fbc98003980 2023-10-14T09:18:22.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8005c40 con 0x7fbc98003980 2023-10-14T09:18:22.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbca3fff640 1 -- 172.21.15.78:0/3892412372 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8008110 con 0x7fbc98003980 2023-10-14T09:18:22.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbcb3565640 1 -- 172.21.15.78:0/3892412372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc98003980 msgr2=0x7fbc98003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbcb3565640 1 --2- 172.21.15.78:0/3892412372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc98003980 0x7fbc98003d60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbca8008fd0 tx=0x7fbca801cf10 comp rx=0 tx=0).stop 2023-10-14T09:18:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbcb1b02640 1 -- 172.21.15.78:0/3892412372 reap_dead start 2023-10-14T09:18:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbcb3565640 1 -- 172.21.15.78:0/3892412372 shutdown_connections 2023-10-14T09:18:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbcb3565640 1 -- 172.21.15.78:0/3892412372 >> 172.21.15.78:0/3892412372 conn(0x7fbcac0c25b0 msgr2=0x7fbcac0c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbcb3565640 1 -- 172.21.15.78:0/3892412372 shutdown_connections 2023-10-14T09:18:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbcb3565640 1 -- 172.21.15.78:0/3892412372 wait complete. 2023-10-14T09:18:22.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.419+0000 7fbcb3565640 1 Processor -- start 2023-10-14T09:18:22.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb3565640 1 -- start start 2023-10-14T09:18:22.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb3565640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc98003980 0x7fbcac13d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb3565640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcac146320 0x7fbcac148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb3565640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcac0ba9f0 0x7fbcac1ec540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb3565640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac1458d0 con 0x7fbcac0ba9f0 2023-10-14T09:18:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb3565640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac145e90 con 0x7fbcac146320 2023-10-14T09:18:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb3565640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0bc3e0 con 0x7fbc98003980 2023-10-14T09:18:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb1b02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcac0ba9f0 0x7fbcac1ec540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb1b02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcac0ba9f0 0x7fbcac1ec540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58962/0 (socket says 172.21.15.78:58962) 2023-10-14T09:18:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb1b02640 1 -- 172.21.15.78:0/79995568 learned_addr learned my addr 172.21.15.78:0/79995568 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcac146320 0x7fbcac148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb1301640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc98003980 0x7fbcac13d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb1b02640 1 -- 172.21.15.78:0/79995568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc98003980 msgr2=0x7fbcac13d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc98003980 0x7fbcac13d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb1b02640 1 -- 172.21.15.78:0/79995568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcac146320 msgr2=0x7fbcac148d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcac146320 0x7fbcac148d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb1b02640 1 -- 172.21.15.78:0/79995568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0bc6c0 con 0x7fbcac0ba9f0 2023-10-14T09:18:22.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcac0ba9f0 0x7fbcac1ec540 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0669f0 tx=0x7fbca4007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:22.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbca1ffb640 1 -- 172.21.15.78:0/79995568 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40046a0 con 0x7fbcac0ba9f0 2023-10-14T09:18:22.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbca1ffb640 1 -- 172.21.15.78:0/79995568 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca4004800 con 0x7fbcac0ba9f0 2023-10-14T09:18:22.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbca1ffb640 1 -- 172.21.15.78:0/79995568 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4015640 con 0x7fbcac0ba9f0 2023-10-14T09:18:22.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb3565640 1 -- 172.21.15.78:0/79995568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac145b20 con 0x7fbcac0ba9f0 2023-10-14T09:18:22.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.423+0000 7fbcb3565640 1 -- 172.21.15.78:0/79995568 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac149aa0 con 0x7fbcac0ba9f0 2023-10-14T09:18:22.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbca1ffb640 1 -- 172.21.15.78:0/79995568 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbca40157a0 con 0x7fbcac0ba9f0 2023-10-14T09:18:22.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbca1ffb640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbc900664d0 0x7fbc90068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbca1ffb640 1 -- 172.21.15.78:0/79995568 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fbca4084330 con 0x7fbcac0ba9f0 2023-10-14T09:18:22.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1301640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbc900664d0 0x7fbc90068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb68ee000 1 Processor -- start 2023-10-14T09:18:22.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1301640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbc900664d0 0x7fbc90068990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc980057b0 tx=0x7fbca8001e10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:22.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb68ee000 1 -- start start 2023-10-14T09:18:22.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caeeeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeef530 0x55d1caeef910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caef0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cace6cc0 con 0x55d1caeefe50 2023-10-14T09:18:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cad49920 con 0x55d1caeef530 2023-10-14T09:18:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1cad46e50 con 0x55d1caf2cd70 2023-10-14T09:18:22.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1b02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caef0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1b02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caef0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58968/0 (socket says 172.21.15.78:58968) 2023-10-14T09:18:22.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1b02640 1 -- 172.21.15.78:0/3020438137 learned_addr learned my addr 172.21.15.78:0/3020438137 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:22.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1301640 1 --2- 172.21.15.78:0/3020438137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caeeeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/3020438137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeef530 0x55d1caeef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1b02640 1 -- 172.21.15.78:0/3020438137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 msgr2=0x55d1caeeeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/3020438137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caeeeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1b02640 1 -- 172.21.15.78:0/3020438137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeef530 msgr2=0x55d1caeef910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/3020438137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeef530 0x55d1caeef910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1b02640 1 -- 172.21.15.78:0/3020438137 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1caa3b890 con 0x55d1caeefe50 2023-10-14T09:18:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/3020438137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caef0230 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbca4002240 tx=0x7fbca4004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347b8c42e47d8d80 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbc8effd640 1 -- 172.21.15.78:0/3020438137 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca405d780 con 0x55d1caeefe50 2023-10-14T09:18:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbc8effd640 1 -- 172.21.15.78:0/3020438137 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca40840d0 con 0x55d1caeefe50 2023-10-14T09:18:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.427+0000 7fbc8effd640 1 -- 172.21.15.78:0/3020438137 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40538d0 con 0x55d1caeefe50 2023-10-14T09:18:22.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 -- 172.21.15.78:0/3020438137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 msgr2=0x55d1caef0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/3020438137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caef0230 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbca4002240 tx=0x7fbca4004a30 comp rx=0 tx=0).stop 2023-10-14T09:18:22.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 -- 172.21.15.78:0/3020438137 shutdown_connections 2023-10-14T09:18:22.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/3020438137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caef0230 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/3020438137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeef530 0x55d1caeef910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/3020438137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caeeeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 -- 172.21.15.78:0/3020438137 >> 172.21.15.78:0/3020438137 conn(0x55d1caef7c90 msgr2=0x55d1caf2f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:22.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 -- 172.21.15.78:0/3020438137 shutdown_connections 2023-10-14T09:18:22.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 -- 172.21.15.78:0/3020438137 wait complete. 2023-10-14T09:18:22.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 -- start start 2023-10-14T09:18:22.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 Processor -- start 2023-10-14T09:18:22.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caeef530 0x55d1caf2b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf2bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caf2cd70 0x55d1caef2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cad42740 con 0x55d1caeefe50 2023-10-14T09:18:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cad01d10 con 0x55d1caf2cd70 2023-10-14T09:18:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1cad019b0 con 0x55d1caeef530 2023-10-14T09:18:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 10 client.0 _ll_register_callbacks cb 0x55d1caedd390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb0b00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf2bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb0b00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf2bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58974/0 (socket says 172.21.15.78:58974) 2023-10-14T09:18:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb0b00640 1 -- 172.21.15.78:0/834970969 learned_addr learned my addr 172.21.15.78:0/834970969 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb1301640 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caeef530 0x55d1caf2b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caf2cd70 0x55d1caef2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb0b00640 1 -- 172.21.15.78:0/834970969 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caeef530 msgr2=0x55d1caf2b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caeef530 0x55d1caf2b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb0b00640 1 -- 172.21.15.78:0/834970969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caf2cd70 msgr2=0x55d1caef2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caf2cd70 0x55d1caef2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb0b00640 1 -- 172.21.15.78:0/834970969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac149aa0 con 0x55d1caeefe50 2023-10-14T09:18:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf2bec0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbcac146700 tx=0x7fbc9c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a34a8c325953ff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:22.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbc87fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbc87fff640 1 -- 172.21.15.78:0/834970969 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0156f0 con 0x55d1caeefe50 2023-10-14T09:18:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbc87fff640 1 -- 172.21.15.78:0/834970969 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fbc9c015850 con 0x55d1caeefe50 2023-10-14T09:18:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbcb68ee000 1 -- 172.21.15.78:0/834970969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1cacf6370 con 0x55d1caeefe50 2023-10-14T09:18:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.431+0000 7fbc87fff640 1 -- 172.21.15.78:0/834970969 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc9c015a10 con 0x55d1caeefe50 2023-10-14T09:18:22.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 10 client.5286 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:22.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 -- 172.21.15.78:0/834970969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d1cad04460 con 0x55d1caeefe50 2023-10-14T09:18:22.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbc87fff640 1 -- 172.21.15.78:0/834970969 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1cacf6370 con 0x55d1caeefe50 2023-10-14T09:18:22.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbc87fff640 1 -- 172.21.15.78:0/834970969 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fbc9c015b70 con 0x55d1caeefe50 2023-10-14T09:18:22.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 10 client.5286 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:22.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 10 client.5286 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:22.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 20 client.5286 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:22.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d1caef37d0 0x55d1caef3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 4 client.5286 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:18:22.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 -- 172.21.15.78:0/834970969 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1cacdc2d0 con 0x55d1caef37d0 2023-10-14T09:18:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb1301640 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d1caef37d0 0x55d1caef3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb1301640 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d1caef37d0 0x55d1caef3bb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d7979bdce6a1cde server_cookie=5d858cdedfb23bfd in_seq=0 out_seq=0 2023-10-14T09:18:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbc87fff640 10 client.5286 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:22.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbc87fff640 1 -- 172.21.15.78:0/834970969 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d1cacdc2d0 con 0x55d1caef37d0 2023-10-14T09:18:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbc87fff640 10 client.5286 handle_command_reply: tid=0 2023-10-14T09:18:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 client.5286 shutdown 2023-10-14T09:18:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 -- 172.21.15.78:0/834970969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 msgr2=0x55d1caf2bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf2bec0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbcac146700 tx=0x7fbc9c00b870 comp rx=0 tx=0).stop 2023-10-14T09:18:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 -- 172.21.15.78:0/834970969 shutdown_connections 2023-10-14T09:18:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d1caef37d0 0x55d1caef3bb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caf2cd70 0x55d1caef2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf2bec0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbc87fff640 0 client.5286 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/834970969 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caeef530 0x55d1caf2b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 -- 172.21.15.78:0/834970969 >> 172.21.15.78:0/834970969 conn(0x55d1caef7c90 msgr2=0x55d1caeee6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:22.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 -- 172.21.15.78:0/834970969 shutdown_connections 2023-10-14T09:18:22.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 1 -- 172.21.15.78:0/834970969 wait complete. 2023-10-14T09:18:22.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.435+0000 7fbcb68ee000 20 client.5286 trim_cache size 0 max 16384 2023-10-14T09:18:22.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb68ee000 1 Processor -- start 2023-10-14T09:18:22.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb68ee000 1 -- start start 2023-10-14T09:18:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeef530 0x55d1caf43dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf44310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caf44850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1ca9fc940 con 0x55d1caeefe50 2023-10-14T09:18:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cad415d0 con 0x55d1caeef530 2023-10-14T09:18:22.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1cad4c200 con 0x55d1caf2cd70 2023-10-14T09:18:22.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb0b00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf44310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb0b00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf44310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58990/0 (socket says 172.21.15.78:58990) 2023-10-14T09:18:22.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb0b00640 1 -- 172.21.15.78:0/2020191029 learned_addr learned my addr 172.21.15.78:0/2020191029 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:22.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb1301640 1 --2- 172.21.15.78:0/2020191029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeef530 0x55d1caf43dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/2020191029 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caf44850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb0b00640 1 -- 172.21.15.78:0/2020191029 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 msgr2=0x55d1caf44850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/2020191029 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caf44850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb0b00640 1 -- 172.21.15.78:0/2020191029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeef530 msgr2=0x55d1caf43dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/2020191029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeef530 0x55d1caf43dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb0b00640 1 -- 172.21.15.78:0/2020191029 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1cacea760 con 0x55d1caeefe50 2023-10-14T09:18:22.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/2020191029 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caf44850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/2020191029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf44310 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c008010 tx=0x7fbc9c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb088a4f4f4b24c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbc8f7fe640 1 -- 172.21.15.78:0/2020191029 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c003cf0 con 0x55d1caeefe50 2023-10-14T09:18:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbc8f7fe640 1 -- 172.21.15.78:0/2020191029 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c004280 con 0x55d1caeefe50 2023-10-14T09:18:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbc8f7fe640 1 -- 172.21.15.78:0/2020191029 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0158f0 con 0x55d1caeefe50 2023-10-14T09:18:22.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb68ee000 1 -- 172.21.15.78:0/2020191029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 msgr2=0x55d1caf44310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.451+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/2020191029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf44310 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c008010 tx=0x7fbc9c019000 comp rx=0 tx=0).stop 2023-10-14T09:18:22.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 -- 172.21.15.78:0/2020191029 shutdown_connections 2023-10-14T09:18:22.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/2020191029 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caf44850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/2020191029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeefe50 0x55d1caf44310 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/2020191029 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeef530 0x55d1caf43dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 -- 172.21.15.78:0/2020191029 >> 172.21.15.78:0/2020191029 conn(0x55d1caef7c90 msgr2=0x55d1caeed750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:22.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 -- 172.21.15.78:0/2020191029 shutdown_connections 2023-10-14T09:18:22.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 -- 172.21.15.78:0/2020191029 wait complete. 2023-10-14T09:18:22.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 -- start start 2023-10-14T09:18:22.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 Processor -- start 2023-10-14T09:18:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeef530 0x55d1caf91470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeefe50 0x55d1caf919b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caf54c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cad089e0 con 0x55d1caeef530 2023-10-14T09:18:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1cae00570 con 0x55d1caeefe50 2023-10-14T09:18:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1cad0db30 con 0x55d1caf2cd70 2023-10-14T09:18:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 10 client.0 _ll_register_callbacks cb 0x7fbca40518f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb1301640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeef530 0x55d1caf91470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb1301640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeef530 0x55d1caf91470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58998/0 (socket says 172.21.15.78:58998) 2023-10-14T09:18:22.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb1301640 1 -- 172.21.15.78:0/1684886042 learned_addr learned my addr 172.21.15.78:0/1684886042 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:22.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeefe50 0x55d1caf919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb1b02640 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caf54c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb1301640 1 -- 172.21.15.78:0/1684886042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 msgr2=0x55d1caf54c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb1301640 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caf54c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb1301640 1 -- 172.21.15.78:0/1684886042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeefe50 msgr2=0x55d1caf919b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb1301640 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeefe50 0x55d1caf919b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb1301640 1 -- 172.21.15.78:0/1684886042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1cad04460 con 0x55d1caeef530 2023-10-14T09:18:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb1301640 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeef530 0x55d1caf91470 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbca801be80 tx=0x7fbca801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4102c54335bf97a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbc87fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbc87fff640 1 -- 172.21.15.78:0/1684886042 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8001860 con 0x55d1caeef530 2023-10-14T09:18:22.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbc87fff640 1 -- 172.21.15.78:0/1684886042 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fbca80c3040 con 0x55d1caeef530 2023-10-14T09:18:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 -- 172.21.15.78:0/1684886042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1cad3b720 con 0x55d1caeef530 2023-10-14T09:18:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbc87fff640 1 -- 172.21.15.78:0/1684886042 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbca80019c0 con 0x55d1caeef530 2023-10-14T09:18:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 10 client.5292 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 -- 172.21.15.78:0/1684886042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d1caa3bcc0 con 0x55d1caeef530 2023-10-14T09:18:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbc87fff640 1 -- 172.21.15.78:0/1684886042 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1cad3b720 con 0x55d1caeef530 2023-10-14T09:18:22.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbc87fff640 1 -- 172.21.15.78:0/1684886042 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fbca80058c0 con 0x55d1caeef530 2023-10-14T09:18:22.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 10 client.5292 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:22.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 10 client.5292 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:22.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 20 client.5292 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:22.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d1caf551d0 0x55d1caf555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 4 client.5292 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T09:18:22.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.455+0000 7fbcb68ee000 1 -- 172.21.15.78:0/1684886042 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d1cad3b440 con 0x55d1caf551d0 2023-10-14T09:18:22.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d1caf551d0 0x55d1caf555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb0b00640 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d1caf551d0 0x55d1caf555b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7e616f9e64862af server_cookie=dc5cf394c3871a99 in_seq=0 out_seq=0 2023-10-14T09:18:22.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbc87fff640 10 client.5292 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbc87fff640 1 -- 172.21.15.78:0/1684886042 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x55d1cad3b440 con 0x55d1caf551d0 2023-10-14T09:18:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbc87fff640 10 client.5292 handle_command_reply: tid=0 2023-10-14T09:18:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 1 client.5292 shutdown 2023-10-14T09:18:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 1 -- 172.21.15.78:0/1684886042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeef530 msgr2=0x55d1caf91470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeef530 0x55d1caf91470 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbca801be80 tx=0x7fbca801a000 comp rx=0 tx=0).stop 2023-10-14T09:18:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 1 -- 172.21.15.78:0/1684886042 shutdown_connections 2023-10-14T09:18:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d1caf551d0 0x55d1caf555b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d1caf2cd70 0x55d1caf54c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d1caeefe50 0x55d1caf919b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 1 --2- 172.21.15.78:0/1684886042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d1caeef530 0x55d1caf91470 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 1 -- 172.21.15.78:0/1684886042 >> 172.21.15.78:0/1684886042 conn(0x55d1caef7c90 msgr2=0x55d1caeeec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbc87fff640 0 client.5292 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 1 -- 172.21.15.78:0/1684886042 shutdown_connections 2023-10-14T09:18:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 1 -- 172.21.15.78:0/1684886042 wait complete. 2023-10-14T09:18:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb68ee000 20 client.5292 trim_cache size 0 max 16384 2023-10-14T09:18:22.487 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:18:22.487 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "1f80be0e-0937-433c-91b2-bf32e5285783", 2023-10-14T09:18:22.487 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-10-14T09:18:22.487 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5109, 2023-10-14T09:18:22.488 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-10-14T09:18:22.488 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-10-14T09:18:22.488 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "testcephfs1", 2023-10-14T09:18:22.488 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 5.8315276220000003, 2023-10-14T09:18:22.488 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 17, 2023-10-14T09:18:22.489 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 32, 2023-10-14T09:18:22.489 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 32, 2023-10-14T09:18:22.489 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 13.69497892 2023-10-14T09:18:22.489 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:18:22.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 -- 172.21.15.78:0/79995568 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbc900664d0 msgr2=0x7fbc90068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbc900664d0 0x7fbc90068990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc980057b0 tx=0x7fbca8001e10 comp rx=0 tx=0).stop 2023-10-14T09:18:22.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 -- 172.21.15.78:0/79995568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcac0ba9f0 msgr2=0x7fbcac1ec540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcac0ba9f0 0x7fbcac1ec540 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0669f0 tx=0x7fbca4007700 comp rx=0 tx=0).stop 2023-10-14T09:18:22.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 -- 172.21.15.78:0/79995568 shutdown_connections 2023-10-14T09:18:22.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcac0ba9f0 0x7fbcac1ec540 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbcac146320 0x7fbcac148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fbc900664d0 0x7fbc90068990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 --2- 172.21.15.78:0/79995568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbc98003980 0x7fbcac13d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 -- 172.21.15.78:0/79995568 >> 172.21.15.78:0/79995568 conn(0x7fbcac0c25b0 msgr2=0x7fbcac06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:22.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 -- 172.21.15.78:0/79995568 shutdown_connections 2023-10-14T09:18:22.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.459+0000 7fbcb3565640 1 -- 172.21.15.78:0/79995568 wait complete. 2023-10-14T09:18:22.494 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:22.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.627+0000 7f256bff8640 1 Processor -- start 2023-10-14T09:18:22.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.627+0000 7f256bff8640 1 -- start start 2023-10-14T09:18:22.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f256bff8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f256413b050 0x7f2564155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f256bff8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f25640a87c0 0x7f256406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f256bff8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2564152a60 con 0x7f25640a8360 2023-10-14T09:18:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f256bff8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25640a9340 con 0x7f256413b050 2023-10-14T09:18:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f256bff8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25640a8c10 con 0x7f25640a87c0 2023-10-14T09:18:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f2569d94640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f256413b050 0x7f2564155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f2569d94640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f256413b050 0x7f2564155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59004/0 (socket says 172.21.15.78:59004) 2023-10-14T09:18:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f2569d94640 1 -- 172.21.15.78:0/3847441935 learned_addr learned my addr 172.21.15.78:0/3847441935 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f256a595640 1 --2- 172.21.15.78:0/3847441935 >> v2:172.21.15.157:3300/0 conn(0x7f25640a87c0 0x7f256406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f2569d94640 1 -- 172.21.15.78:0/3847441935 >> v2:172.21.15.157:3300/0 conn(0x7f25640a87c0 msgr2=0x7f256406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f2569d94640 1 --2- 172.21.15.78:0/3847441935 >> v2:172.21.15.157:3300/0 conn(0x7f25640a87c0 0x7f256406d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f2569d94640 1 -- 172.21.15.78:0/3847441935 >> v1:172.21.15.157:6789/0 conn(0x7f25640a8360 legacy=0x7f256406cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f2569d94640 1 -- 172.21.15.78:0/3847441935 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564155fb0 con 0x7f256413b050 2023-10-14T09:18:22.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f2569d94640 1 --2- 172.21.15.78:0/3847441935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256413b050 0x7f2564155a70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f25640bf820 tx=0x7f256001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124a80cf6973bee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:22.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.631+0000 7f2568d92640 1 -- 172.21.15.78:0/3847441935 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25600ab640 con 0x7f256413b050 2023-10-14T09:18:22.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f2568d92640 1 -- 172.21.15.78:0/3847441935 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25600a7070 con 0x7f256413b050 2023-10-14T09:18:22.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f2568d92640 1 -- 172.21.15.78:0/3847441935 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25600ab9c0 con 0x7f256413b050 2023-10-14T09:18:22.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 -- 172.21.15.78:0/3847441935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256413b050 msgr2=0x7f2564155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 --2- 172.21.15.78:0/3847441935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256413b050 0x7f2564155a70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f25640bf820 tx=0x7f256001c440 comp rx=0 tx=0).stop 2023-10-14T09:18:22.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 -- 172.21.15.78:0/3847441935 shutdown_connections 2023-10-14T09:18:22.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 --2- 172.21.15.78:0/3847441935 >> v2:172.21.15.157:3300/0 conn(0x7f25640a87c0 0x7f256406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 --2- 172.21.15.78:0/3847441935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256413b050 0x7f2564155a70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 -- 172.21.15.78:0/3847441935 >> 172.21.15.78:0/3847441935 conn(0x7f25640c1cc0 msgr2=0x7f25640c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:22.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 -- 172.21.15.78:0/3847441935 shutdown_connections 2023-10-14T09:18:22.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 -- 172.21.15.78:0/3847441935 wait complete. 2023-10-14T09:18:22.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 Processor -- start 2023-10-14T09:18:22.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 -- start start 2023-10-14T09:18:22.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25640a8360 0x7f25640c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25640a87c0 0x7f256414eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256413b050 0x7f256414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25640be8b0 con 0x7f256413b050 2023-10-14T09:18:22.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2564135a80 con 0x7f25640a87c0 2023-10-14T09:18:22.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256bff8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2564135d60 con 0x7f25640a8360 2023-10-14T09:18:22.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256a595640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256413b050 0x7f256414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256a595640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256413b050 0x7f256414eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59008/0 (socket says 172.21.15.78:59008) 2023-10-14T09:18:22.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f256a595640 1 -- 172.21.15.78:0/1359614495 learned_addr learned my addr 172.21.15.78:0/1359614495 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:22.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f2569593640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25640a87c0 0x7f256414eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.635+0000 7f2569d94640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25640a8360 0x7f25640c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f256a595640 1 -- 172.21.15.78:0/1359614495 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25640a8360 msgr2=0x7f25640c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f256a595640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25640a8360 0x7f25640c37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f256a595640 1 -- 172.21.15.78:0/1359614495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25640a87c0 msgr2=0x7f256414eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f256a595640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25640a87c0 0x7f256414eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f256a595640 1 -- 172.21.15.78:0/1359614495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600094d0 con 0x7f256413b050 2023-10-14T09:18:22.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f256a595640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256413b050 0x7f256414eff0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f255c007e40 tx=0x7f255c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:22.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f255a7fc640 1 -- 172.21.15.78:0/1359614495 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c014620 con 0x7f256413b050 2023-10-14T09:18:22.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f255a7fc640 1 -- 172.21.15.78:0/1359614495 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c00ee90 con 0x7f256413b050 2023-10-14T09:18:22.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f256bff8640 1 -- 172.21.15.78:0/1359614495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25641f0120 con 0x7f256413b050 2023-10-14T09:18:22.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f255a7fc640 1 -- 172.21.15.78:0/1359614495 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c0149e0 con 0x7f256413b050 2023-10-14T09:18:22.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f256bff8640 1 -- 172.21.15.78:0/1359614495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2564134220 con 0x7f256413b050 2023-10-14T09:18:22.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f256bff8640 1 -- 172.21.15.78:0/1359614495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25640670e0 con 0x7f256413b050 2023-10-14T09:18:22.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f255a7fc640 1 -- 172.21.15.78:0/1359614495 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f255c014b40 con 0x7f256413b050 2023-10-14T09:18:22.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f255a7fc640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25480664a0 0x7f2548068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f255a7fc640 1 -- 172.21.15.78:0/1359614495 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f255c084740 con 0x7f256413b050 2023-10-14T09:18:22.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.639+0000 7f2569d94640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25480664a0 0x7f2548068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.643+0000 7f2569d94640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25480664a0 0x7f2548068960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f25600af000 tx=0x7f25600b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:22.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.643+0000 7f255a7fc640 1 -- 172.21.15.78:0/1359614495 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25640670e0 con 0x7f256413b050 2023-10-14T09:18:22.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.823+0000 7f256bff8640 1 -- 172.21.15.78:0/1359614495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25640670e0 con 0x7f256413b050 2023-10-14T09:18:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.823+0000 7f255a7fc640 1 -- 172.21.15.78:0/1359614495 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f25640670e0 con 0x7f256413b050 2023-10-14T09:18:22.829 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:22.829 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:18:22.831 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:18:22.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 -- 172.21.15.78:0/1359614495 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25480664a0 msgr2=0x7f2548068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25480664a0 0x7f2548068960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f25600af000 tx=0x7f25600b6040 comp rx=0 tx=0).stop 2023-10-14T09:18:22.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 -- 172.21.15.78:0/1359614495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256413b050 msgr2=0x7f256414eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256413b050 0x7f256414eff0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f255c007e40 tx=0x7f255c00e4b0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 -- 172.21.15.78:0/1359614495 shutdown_connections 2023-10-14T09:18:22.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f256413b050 0x7f256414eff0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25640a87c0 0x7f256414eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25480664a0 0x7f2548068960 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 --2- 172.21.15.78:0/1359614495 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25640a8360 0x7f25640c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 -- 172.21.15.78:0/1359614495 >> 172.21.15.78:0/1359614495 conn(0x7f25640c1cc0 msgr2=0x7f256406cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:22.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 -- 172.21.15.78:0/1359614495 shutdown_connections 2023-10-14T09:18:22.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.827+0000 7f256bff8640 1 -- 172.21.15.78:0/1359614495 wait complete. 2023-10-14T09:18:22.850 INFO:tasks.cephfs.test_failover:status = { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T09:18:16.002036+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5109": { "addr": "172.21.15.78:6837/4241140805", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6836", "nonce": 4241140805, "type": "v2" }, { "addr": "172.21.15.78:6837", "nonce": 4241140805, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5109, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T09:18:19.017889+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5109 } } } ], "standbys": [ { "addr": "172.21.15.157:6833/2822193022", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6832", "nonce": 2822193022, "type": "v2" }, { "addr": "172.21.15.157:6833", "nonce": 2822193022, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5002, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.157:6835/488302185", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6834", "nonce": 488302185, "type": "v2" }, { "addr": "172.21.15.157:6835", "nonce": 488302185, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5005, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.78:6835/3378161275", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6834", "nonce": 3378161275, "type": "v2" }, { "addr": "172.21.15.78:6835", "nonce": 3378161275, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5106, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T09:18:22.851 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T09:18:22.851 INFO:tasks.cephfs.test_failover:current = [{'gid': 5106, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.78:6835/3378161275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3378161275}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3378161275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 5002, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6833/2822193022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6832', 'nonce': 2822193022}, {'type': 'v1', 'addr': '172.21.15.157:6833', 'nonce': 2822193022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 5005, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6835/488302185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 488302185}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 488302185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T09:18:22.852 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.b mds_join_fs cephfs 2023-10-14T09:18:22.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.987+0000 7efc84965640 1 Processor -- start 2023-10-14T09:18:22.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.987+0000 7efc84965640 1 -- start start 2023-10-14T09:18:22.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.987+0000 7efc84965640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc800c4030 0x7efc800c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.987+0000 7efc84965640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc8006cc50 0x7efc800c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:22.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.987+0000 7efc84965640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc800c7af0 con 0x7efc80153d90 2023-10-14T09:18:22.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.987+0000 7efc84965640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc800c5300 con 0x7efc8006cc50 2023-10-14T09:18:22.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.987+0000 7efc84965640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc80157360 con 0x7efc800c4030 2023-10-14T09:18:22.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.987+0000 7efc75d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc8006cc50 0x7efc800c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.987+0000 7efc75d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efc8006cc50 0x7efc800c4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59020/0 (socket says 172.21.15.78:59020) 2023-10-14T09:18:22.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.987+0000 7efc75d9b640 1 -- 172.21.15.78:0/64598606 learned_addr learned my addr 172.21.15.78:0/64598606 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:22.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc7e59c640 1 --2- 172.21.15.78:0/64598606 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc800c4030 0x7efc800c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:22.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc75d9b640 1 -- 172.21.15.78:0/64598606 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc800c4030 msgr2=0x7efc800c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:22.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc75d9b640 1 --2- 172.21.15.78:0/64598606 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc800c4030 0x7efc800c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc75d9b640 1 -- 172.21.15.78:0/64598606 >> v1:172.21.15.157:6789/0 conn(0x7efc80153d90 legacy=0x7efc801541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc75d9b640 1 -- 172.21.15.78:0/64598606 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc80157ee0 con 0x7efc8006cc50 2023-10-14T09:18:22.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc75d9b640 1 --2- 172.21.15.78:0/64598606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8006cc50 0x7efc800c4410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efc68009870 tx=0x7efc6801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59dd3bce2f8f57f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:22.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc7dd9b640 1 -- 172.21.15.78:0/64598606 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc680ac620 con 0x7efc8006cc50 2023-10-14T09:18:22.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc7dd9b640 1 -- 172.21.15.78:0/64598606 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc680ac780 con 0x7efc8006cc50 2023-10-14T09:18:22.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc7dd9b640 1 -- 172.21.15.78:0/64598606 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc680acb10 con 0x7efc8006cc50 2023-10-14T09:18:22.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc84965640 1 -- 172.21.15.78:0/64598606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8006cc50 msgr2=0x7efc800c4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:22.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc84965640 1 --2- 172.21.15.78:0/64598606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8006cc50 0x7efc800c4410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efc68009870 tx=0x7efc6801c4b0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc84965640 1 -- 172.21.15.78:0/64598606 shutdown_connections 2023-10-14T09:18:22.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc84965640 1 --2- 172.21.15.78:0/64598606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8006cc50 0x7efc800c4410 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc84965640 1 --2- 172.21.15.78:0/64598606 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc800c4030 0x7efc800c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:22.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc84965640 1 -- 172.21.15.78:0/64598606 >> 172.21.15.78:0/64598606 conn(0x7efc800ab240 msgr2=0x7efc800ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:22.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc84965640 1 -- 172.21.15.78:0/64598606 shutdown_connections 2023-10-14T09:18:22.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.991+0000 7efc84965640 1 -- 172.21.15.78:0/64598606 wait complete. 2023-10-14T09:18:23.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc84965640 1 Processor -- start 2023-10-14T09:18:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc84965640 1 -- start start 2023-10-14T09:18:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc84965640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8006cc50 0x7efc8014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc84965640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc800c4030 0x7efc8014b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc84965640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc80153d90 0x7efc8014be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc84965640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80151350 con 0x7efc8006cc50 2023-10-14T09:18:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc84965640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8014c3d0 con 0x7efc800c4030 2023-10-14T09:18:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc84965640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc800ada70 con 0x7efc80153d90 2023-10-14T09:18:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc7e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8006cc50 0x7efc8014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc7e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8006cc50 0x7efc8014fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59032/0 (socket says 172.21.15.78:59032) 2023-10-14T09:18:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc7e59c640 1 -- 172.21.15.78:0/2027067345 learned_addr learned my addr 172.21.15.78:0/2027067345 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:23.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc75d9b640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc800c4030 0x7efc8014b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc7ed9d640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc80153d90 0x7efc8014be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc7e59c640 1 -- 172.21.15.78:0/2027067345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc80153d90 msgr2=0x7efc8014be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:23.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc7e59c640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc80153d90 0x7efc8014be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc7e59c640 1 -- 172.21.15.78:0/2027067345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc800c4030 msgr2=0x7efc8014b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:23.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc7e59c640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc800c4030 0x7efc8014b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc7e59c640 1 -- 172.21.15.78:0/2027067345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc680094d0 con 0x7efc8006cc50 2023-10-14T09:18:23.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc75d9b640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc800c4030 0x7efc8014b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:23.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc7ed9d640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc80153d90 0x7efc8014be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:23.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc7e59c640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8006cc50 0x7efc8014fe90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efc70007ec0 tx=0x7efc7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:23.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc777fe640 1 -- 172.21.15.78:0/2027067345 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70014620 con 0x7efc8006cc50 2023-10-14T09:18:23.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc777fe640 1 -- 172.21.15.78:0/2027067345 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc700147a0 con 0x7efc8006cc50 2023-10-14T09:18:23.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc84965640 1 -- 172.21.15.78:0/2027067345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc800ac3e0 con 0x7efc8006cc50 2023-10-14T09:18:23.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.995+0000 7efc777fe640 1 -- 172.21.15.78:0/2027067345 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70014b50 con 0x7efc8006cc50 2023-10-14T09:18:23.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.999+0000 7efc84965640 1 -- 172.21.15.78:0/2027067345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc80150f70 con 0x7efc8006cc50 2023-10-14T09:18:23.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.999+0000 7efc84965640 1 -- 172.21.15.78:0/2027067345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc80074110 con 0x7efc8006cc50 2023-10-14T09:18:23.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.999+0000 7efc777fe640 1 -- 172.21.15.78:0/2027067345 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efc70014cb0 con 0x7efc8006cc50 2023-10-14T09:18:23.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.999+0000 7efc777fe640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efc600664a0 0x7efc60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.999+0000 7efc777fe640 1 -- 172.21.15.78:0/2027067345 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7efc700848c0 con 0x7efc8006cc50 2023-10-14T09:18:23.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.999+0000 7efc75d9b640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efc600664a0 0x7efc60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:22.999+0000 7efc75d9b640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efc600664a0 0x7efc60068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efc680ae000 tx=0x7efc68008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:23.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.003+0000 7efc777fe640 1 -- 172.21.15.78:0/2027067345 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efc70051d10 con 0x7efc8006cc50 2023-10-14T09:18:23.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.151+0000 7efc84965640 1 -- 172.21.15.78:0/2027067345 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7efc800c7040 con 0x7efc8006cc50 2023-10-14T09:18:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.155+0000 7efc777fe640 1 -- 172.21.15.78:0/2027067345 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v12)=0 v12) v1 ==== 116+0+0 (secure 0 0 0) 0x7efc70055330 con 0x7efc8006cc50 2023-10-14T09:18:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 -- 172.21.15.78:0/2027067345 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efc600664a0 msgr2=0x7efc60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efc600664a0 0x7efc60068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efc680ae000 tx=0x7efc68008040 comp rx=0 tx=0).stop 2023-10-14T09:18:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 -- 172.21.15.78:0/2027067345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8006cc50 msgr2=0x7efc8014fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8006cc50 0x7efc8014fe90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efc70007ec0 tx=0x7efc7000e4b0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 -- 172.21.15.78:0/2027067345 shutdown_connections 2023-10-14T09:18:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efc600664a0 0x7efc60068960 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efc80153d90 0x7efc8014be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc800c4030 0x7efc8014b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 --2- 172.21.15.78:0/2027067345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc8006cc50 0x7efc8014fe90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 -- 172.21.15.78:0/2027067345 >> 172.21.15.78:0/2027067345 conn(0x7efc800ab240 msgr2=0x7efc80152660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:23.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 -- 172.21.15.78:0/2027067345 shutdown_connections 2023-10-14T09:18:23.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.159+0000 7efc84965640 1 -- 172.21.15.78:0/2027067345 wait complete. 2023-10-14T09:18:23.182 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.315+0000 7fdfd2f1d640 1 Processor -- start 2023-10-14T09:18:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.315+0000 7fdfd2f1d640 1 -- start start 2023-10-14T09:18:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfd2f1d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfcc14ed10 0x7fdfcc14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfd2f1d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc1531d0 con 0x7fdfcc14f700 2023-10-14T09:18:23.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfd2f1d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc1534b0 con 0x7fdfcc14e0f0 2023-10-14T09:18:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfd2f1d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc153e50 con 0x7fdfcc14ed10 2023-10-14T09:18:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfd14ba640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdfcc14f700 0x7fdfcc150a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40542/0 (socket says 172.21.15.78:40542) 2023-10-14T09:18:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfd14ba640 1 -- 172.21.15.78:0/3426045250 learned_addr learned my addr 172.21.15.78:0/3426045250 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:23.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc3fff640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfcc14ed10 0x7fdfcc14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347685291 0 0) 0x7fdfcc1531d0 con 0x7fdfcc14f700 2023-10-14T09:18:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb4005740 con 0x7fdfcc14f700 2023-10-14T09:18:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504923518 0 0) 0x7fdfcc1534b0 con 0x7fdfcc14e0f0 2023-10-14T09:18:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfcc1531d0 con 0x7fdfcc14e0f0 2023-10-14T09:18:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2449292745 0 0) 0x7fdfb4005740 con 0x7fdfcc14f700 2023-10-14T09:18:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfcc14ed10 msgr2=0x7fdfcc14f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfcc14ed10 0x7fdfcc14f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 >> v1:172.21.15.157:6789/0 conn(0x7fdfcc14e0f0 legacy=0x7fdfcc152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc153790 con 0x7fdfcc14f700 2023-10-14T09:18:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7fdfc4001a00 con 0x7fdfcc14f700 2023-10-14T09:18:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc3fff640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfcc14ed10 0x7fdfcc14f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:18:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 >> v1:172.21.15.78:6789/0 conn(0x7fdfcc14f700 legacy=0x7fdfcc150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:23.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfb4005d50 0x7fdfb4006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfb40069e0 0x7fdfb4006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfcc14ed10 0x7fdfb40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc153e50 con 0x7fdfb40069e0 2023-10-14T09:18:23.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb400dcb0 con 0x7fdfb4005d50 2023-10-14T09:18:23.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb400de70 con 0x7fdfcc14ed10 2023-10-14T09:18:23.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc3fff640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfb40069e0 0x7fdfb4006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfd0cb9640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfb4005d50 0x7fdfb4006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfd14ba640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfcc14ed10 0x7fdfb40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc3fff640 1 -- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfcc14ed10 msgr2=0x7fdfb40073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:23.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc3fff640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfcc14ed10 0x7fdfb40073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc3fff640 1 -- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfb4005d50 msgr2=0x7fdfb4006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:23.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc3fff640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfb4005d50 0x7fdfb4006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfc3fff640 1 -- 172.21.15.78:0/3426045250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc009420 con 0x7fdfb40069e0 2023-10-14T09:18:23.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.319+0000 7fdfd14ba640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfcc14ed10 0x7fdfb40073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfc3fff640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfb40069e0 0x7fdfb4006e60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009c80 tx=0x7fdfcc1519b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16244b1ff8ef6f9d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0a5630 con 0x7fdfb40069e0 2023-10-14T09:18:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0a5790 con 0x7fdfb40069e0 2023-10-14T09:18:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfc37fe640 1 -- 172.21.15.78:0/3426045250 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0a5b00 con 0x7fdfb40069e0 2023-10-14T09:18:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/3426045250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfb40069e0 msgr2=0x7fdfb4006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfd2f1d640 1 --2- 172.21.15.78:0/3426045250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfb40069e0 0x7fdfb4006e60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009c80 tx=0x7fdfcc1519b0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfd14ba640 1 -- 172.21.15.78:0/3426045250 reap_dead start 2023-10-14T09:18:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/3426045250 shutdown_connections 2023-10-14T09:18:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/3426045250 >> 172.21.15.78:0/3426045250 conn(0x7fdfcc0c1cc0 msgr2=0x7fdfcc0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/3426045250 shutdown_connections 2023-10-14T09:18:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/3426045250 wait complete. 2023-10-14T09:18:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfd2f1d640 1 Processor -- start 2023-10-14T09:18:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.323+0000 7fdfd2f1d640 1 -- start start 2023-10-14T09:18:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd2f1d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb40069e0 0x7fdfcc070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd2f1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfcc147ed0 0x7fdfcc06c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd2f1d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfcc06c7a0 0x7fdfcc1eb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd2f1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc14acb0 con 0x7fdfcc147ed0 2023-10-14T09:18:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd2f1d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0709d0 con 0x7fdfcc06c7a0 2023-10-14T09:18:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd2f1d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc06bc40 con 0x7fdfb40069e0 2023-10-14T09:18:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfcc147ed0 0x7fdfcc06c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfcc147ed0 0x7fdfcc06c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59052/0 (socket says 172.21.15.78:59052) 2023-10-14T09:18:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc3fff640 1 -- 172.21.15.78:0/1485577448 learned_addr learned my addr 172.21.15.78:0/1485577448 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc3fff640 1 -- 172.21.15.78:0/1485577448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb40069e0 msgr2=0x7fdfcc070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd14ba640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfcc06c7a0 0x7fdfcc1eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd0cb9640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb40069e0 0x7fdfcc070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc3fff640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb40069e0 0x7fdfcc070490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc3fff640 1 -- 172.21.15.78:0/1485577448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfcc06c7a0 msgr2=0x7fdfcc1eb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc3fff640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfcc06c7a0 0x7fdfcc1eb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc3fff640 1 -- 172.21.15.78:0/1485577448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc14a0a0 con 0x7fdfcc147ed0 2023-10-14T09:18:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd14ba640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfcc06c7a0 0x7fdfcc1eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd0cb9640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb40069e0 0x7fdfcc070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc3fff640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfcc147ed0 0x7fdfcc06c260 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009c80 tx=0x7fdfbc019930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc17fa640 1 -- 172.21.15.78:0/1485577448 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc006e40 con 0x7fdfcc147ed0 2023-10-14T09:18:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc17fa640 1 -- 172.21.15.78:0/1485577448 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0b8450 con 0x7fdfcc147ed0 2023-10-14T09:18:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfc17fa640 1 -- 172.21.15.78:0/1485577448 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0b87c0 con 0x7fdfcc147ed0 2023-10-14T09:18:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/1485577448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc14a380 con 0x7fdfcc147ed0 2023-10-14T09:18:23.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/1485577448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc14a940 con 0x7fdfcc147ed0 2023-10-14T09:18:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.327+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/1485577448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc06bf80 con 0x7fdfcc147ed0 2023-10-14T09:18:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.331+0000 7fdfc17fa640 1 -- 172.21.15.78:0/1485577448 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdfbc0b4070 con 0x7fdfcc147ed0 2023-10-14T09:18:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.331+0000 7fdfc17fa640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdfb80664a0 0x7fdfb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.331+0000 7fdfc17fa640 1 -- 172.21.15.78:0/1485577448 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fdfbc11d9e0 con 0x7fdfcc147ed0 2023-10-14T09:18:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.331+0000 7fdfd0cb9640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdfb80664a0 0x7fdfb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.331+0000 7fdfd0cb9640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdfb80664a0 0x7fdfb8068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8007af0 tx=0x7fdfc8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:23.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.335+0000 7fdfc17fa640 1 -- 172.21.15.78:0/1485577448 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdfcc06bf80 con 0x7fdfcc147ed0 2023-10-14T09:18:23.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.511+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/1485577448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfcc06bf80 con 0x7fdfcc147ed0 2023-10-14T09:18:23.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfc17fa640 1 -- 172.21.15.78:0/1485577448 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fdfbc0eaeb0 con 0x7fdfcc147ed0 2023-10-14T09:18:23.518 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:23.519 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:18:23.519 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:18:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/1485577448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdfb80664a0 msgr2=0x7fdfb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:23.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdfb80664a0 0x7fdfb8068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8007af0 tx=0x7fdfc8009040 comp rx=0 tx=0).stop 2023-10-14T09:18:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/1485577448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfcc147ed0 msgr2=0x7fdfcc06c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfcc147ed0 0x7fdfcc06c260 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009c80 tx=0x7fdfbc019930 comp rx=0 tx=0).stop 2023-10-14T09:18:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/1485577448 shutdown_connections 2023-10-14T09:18:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfcc06c7a0 0x7fdfcc1eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdfcc147ed0 0x7fdfcc06c260 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fdfb80664a0 0x7fdfb8068960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 --2- 172.21.15.78:0/1485577448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb40069e0 0x7fdfcc070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:23.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/1485577448 >> 172.21.15.78:0/1485577448 conn(0x7fdfcc0c1cc0 msgr2=0x7fdfcc151f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:23.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/1485577448 shutdown_connections 2023-10-14T09:18:23.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:23.515+0000 7fdfd2f1d640 1 -- 172.21.15.78:0/1485577448 wait complete. 2023-10-14T09:18:23.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T09:18:16.002036+0000', 'modified': '2023-10-14T09:18:19.017889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5109}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5109': {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T09:18:23.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T09:18:23.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T09:18:24.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9127fd9640 1 Processor -- start 2023-10-14T09:18:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9127fd9640 1 -- start start 2023-10-14T09:18:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9127fd9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9120153e80 0x7f91200c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9127fd9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912006c470 con 0x7f912014ddb0 2023-10-14T09:18:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9127fd9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912006c750 con 0x7f91200c6910 2023-10-14T09:18:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9127fd9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91200c64f0 con 0x7f9120153e80 2023-10-14T09:18:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9125d75640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f912014ddb0 0x7f912006bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40552/0 (socket says 172.21.15.78:40552) 2023-10-14T09:18:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9125d75640 1 -- 172.21.15.78:0/535401760 learned_addr learned my addr 172.21.15.78:0/535401760 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9125574640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9120153e80 0x7f91200c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482555177 0 0) 0x7f912006c470 con 0x7f912014ddb0 2023-10-14T09:18:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f910c003530 con 0x7f912014ddb0 2023-10-14T09:18:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957025252 0 0) 0x7f912006c750 con 0x7f91200c6910 2023-10-14T09:18:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f912006c470 con 0x7f91200c6910 2023-10-14T09:18:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3474704012 0 0) 0x7f910c003530 con 0x7f912014ddb0 2023-10-14T09:18:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9120153e80 msgr2=0x7f91200c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9120153e80 0x7f91200c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 >> v1:172.21.15.157:6789/0 conn(0x7f91200c6910 legacy=0x7f91200c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912006ca30 con 0x7f912014ddb0 2023-10-14T09:18:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f911c001680 con 0x7f912014ddb0 2023-10-14T09:18:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 >> v1:172.21.15.78:6789/0 conn(0x7f912014ddb0 legacy=0x7f912006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f910c003b40 0x7f910c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f910c0047d0 0x7f910c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9120153e80 0x7f910c005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91200c64f0 con 0x7f910c0047d0 2023-10-14T09:18:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c00bb50 con 0x7f910c003b40 2023-10-14T09:18:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c00bd10 con 0x7f9120153e80 2023-10-14T09:18:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9125574640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f910c0047d0 0x7f910c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9125d75640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f910c003b40 0x7f910c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.079+0000 7f9126576640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9120153e80 0x7f910c005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9125574640 1 -- 172.21.15.78:0/535401760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9120153e80 msgr2=0x7f910c005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9125574640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9120153e80 0x7f910c005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9125574640 1 -- 172.21.15.78:0/535401760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f910c003b40 msgr2=0x7f910c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9125574640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f910c003b40 0x7f910c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9125574640 1 -- 172.21.15.78:0/535401760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c003530 con 0x7f910c0047d0 2023-10-14T09:18:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9125574640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f910c0047d0 0x7f910c004c50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9110009ab0 tx=0x7f911001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cc70aa72c12315 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100a6410 con 0x7f910c0047d0 2023-10-14T09:18:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91100a6570 con 0x7f910c0047d0 2023-10-14T09:18:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9124d73640 1 -- 172.21.15.78:0/535401760 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100a6920 con 0x7f910c0047d0 2023-10-14T09:18:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9127fd9640 1 -- 172.21.15.78:0/535401760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f910c0047d0 msgr2=0x7f910c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9127fd9640 1 --2- 172.21.15.78:0/535401760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f910c0047d0 0x7f910c004c50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9110009ab0 tx=0x7f911001ca30 comp rx=0 tx=0).stop 2023-10-14T09:18:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.083+0000 7f9126576640 1 -- 172.21.15.78:0/535401760 reap_dead start 2023-10-14T09:18:24.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 -- 172.21.15.78:0/535401760 shutdown_connections 2023-10-14T09:18:24.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 -- 172.21.15.78:0/535401760 >> 172.21.15.78:0/535401760 conn(0x7f91200ab1f0 msgr2=0x7f91200ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:24.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 -- 172.21.15.78:0/535401760 shutdown_connections 2023-10-14T09:18:24.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 -- 172.21.15.78:0/535401760 wait complete. 2023-10-14T09:18:24.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 Processor -- start 2023-10-14T09:18:24.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 -- start start 2023-10-14T09:18:24.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f910c0047d0 0x7f91201ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91200c3050 0x7f91200bf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f912014a780 0x7f912014ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91201576d0 con 0x7f91200c3050 2023-10-14T09:18:24.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91200bd910 con 0x7f912014a780 2023-10-14T09:18:24.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9127fd9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91200c3aa0 con 0x7f910c0047d0 2023-10-14T09:18:24.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9125574640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91200c3050 0x7f91200bf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9125d75640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f910c0047d0 0x7f91201ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9125574640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91200c3050 0x7f91200bf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59066/0 (socket says 172.21.15.78:59066) 2023-10-14T09:18:24.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9125574640 1 -- 172.21.15.78:0/3892388488 learned_addr learned my addr 172.21.15.78:0/3892388488 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:24.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9126576640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f912014a780 0x7f912014ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9125574640 1 -- 172.21.15.78:0/3892388488 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f910c0047d0 msgr2=0x7f91201ecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:24.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9125574640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f910c0047d0 0x7f91201ecfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9125574640 1 -- 172.21.15.78:0/3892388488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f912014a780 msgr2=0x7f912014ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:24.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9125574640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f912014a780 0x7f912014ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.087+0000 7f9125574640 1 -- 172.21.15.78:0/3892388488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91200c37c0 con 0x7f91200c3050 2023-10-14T09:18:24.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.091+0000 7f9125574640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91200c3050 0x7f91200bf850 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9110009ab0 tx=0x7f910c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:24.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.091+0000 7f91167fc640 1 -- 172.21.15.78:0/3892388488 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100b5070 con 0x7f91200c3050 2023-10-14T09:18:24.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.091+0000 7f91167fc640 1 -- 172.21.15.78:0/3892388488 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911000f000 con 0x7f91200c3050 2023-10-14T09:18:24.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.091+0000 7f91167fc640 1 -- 172.21.15.78:0/3892388488 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100bb420 con 0x7f91200c3050 2023-10-14T09:18:24.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.091+0000 7f9127fd9640 1 -- 172.21.15.78:0/3892388488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91200bd2c0 con 0x7f91200c3050 2023-10-14T09:18:24.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.091+0000 7f9127fd9640 1 -- 172.21.15.78:0/3892388488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91200c34d0 con 0x7f91200c3050 2023-10-14T09:18:24.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.091+0000 7f91167fc640 1 -- 172.21.15.78:0/3892388488 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f91100b9070 con 0x7f91200c3050 2023-10-14T09:18:24.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f91167fc640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91040664d0 0x7f9104068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f91167fc640 1 -- 172.21.15.78:0/3892388488 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f911011d860 con 0x7f91200c3050 2023-10-14T09:18:24.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 Processor -- start 2023-10-14T09:18:24.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9125d75640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91040664d0 0x7f9104068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 -- start start 2023-10-14T09:18:24.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9125d75640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91040664d0 0x7f9104068990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91200c2e10 tx=0x7f911c001e20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:24.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d1d8d70 0x562b1d19aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19b530 0x562b1d19b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19be50 0x562b1d19c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cf92cc0 con 0x562b1d19be50 2023-10-14T09:18:24.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cff5920 con 0x562b1d19b530 2023-10-14T09:18:24.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b1cff2e50 con 0x562b1d1d8d70 2023-10-14T09:18:24.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9126576640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19be50 0x562b1d19c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9125d75640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d1d8d70 0x562b1d19aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9126576640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19be50 0x562b1d19c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59070/0 (socket says 172.21.15.78:59070) 2023-10-14T09:18:24.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9126576640 1 -- 172.21.15.78:0/1190820215 learned_addr learned my addr 172.21.15.78:0/1190820215 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:24.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9125574640 1 --2- 172.21.15.78:0/1190820215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19b530 0x562b1d19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9126576640 1 -- 172.21.15.78:0/1190820215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d1d8d70 msgr2=0x562b1d19aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:24.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9126576640 1 --2- 172.21.15.78:0/1190820215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d1d8d70 0x562b1d19aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9126576640 1 -- 172.21.15.78:0/1190820215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19b530 msgr2=0x562b1d19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:24.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9126576640 1 --2- 172.21.15.78:0/1190820215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19b530 0x562b1d19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9126576640 1 -- 172.21.15.78:0/1190820215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b1cce7890 con 0x562b1d19be50 2023-10-14T09:18:24.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f9126576640 1 --2- 172.21.15.78:0/1190820215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19be50 0x562b1d19c230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f91200abec0 tx=0x7f91180021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1790c09fe269e813 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:24.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f91037fe640 1 -- 172.21.15.78:0/1190820215 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911801a030 con 0x562b1d19be50 2023-10-14T09:18:24.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f91037fe640 1 -- 172.21.15.78:0/1190820215 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9118006d70 con 0x562b1d19be50 2023-10-14T09:18:24.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f91037fe640 1 -- 172.21.15.78:0/1190820215 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118012bd0 con 0x562b1d19be50 2023-10-14T09:18:24.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 -- 172.21.15.78:0/1190820215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19be50 msgr2=0x562b1d19c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:24.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 --2- 172.21.15.78:0/1190820215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19be50 0x562b1d19c230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f91200abec0 tx=0x7f91180021f0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 -- 172.21.15.78:0/1190820215 shutdown_connections 2023-10-14T09:18:24.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 --2- 172.21.15.78:0/1190820215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19be50 0x562b1d19c230 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 --2- 172.21.15.78:0/1190820215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19b530 0x562b1d19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 --2- 172.21.15.78:0/1190820215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d1d8d70 0x562b1d19aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 -- 172.21.15.78:0/1190820215 >> 172.21.15.78:0/1190820215 conn(0x562b1d1a3c90 msgr2=0x562b1d1db5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:24.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.095+0000 7f912b359000 1 -- 172.21.15.78:0/1190820215 shutdown_connections 2023-10-14T09:18:24.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 1 -- 172.21.15.78:0/1190820215 wait complete. 2023-10-14T09:18:24.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 1 -- start start 2023-10-14T09:18:24.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 1 Processor -- start 2023-10-14T09:18:24.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19b530 0x562b1d1d7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19be50 0x562b1d1d7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cfee740 con 0x562b1d1d8d70 2023-10-14T09:18:24.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cfadd10 con 0x562b1d19be50 2023-10-14T09:18:24.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b1cfad9b0 con 0x562b1d19b530 2023-10-14T09:18:24.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 10 client.0 _ll_register_callbacks cb 0x562b1d189390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:24.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9126576640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9126576640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d19ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59074/0 (socket says 172.21.15.78:59074) 2023-10-14T09:18:24.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9126576640 1 -- 172.21.15.78:0/3483606099 learned_addr learned my addr 172.21.15.78:0/3483606099 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:24.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9125d75640 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19b530 0x562b1d1d7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9125574640 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19be50 0x562b1d1d7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9126576640 1 -- 172.21.15.78:0/3483606099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19b530 msgr2=0x562b1d1d7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:24.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9126576640 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19b530 0x562b1d1d7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9126576640 1 -- 172.21.15.78:0/3483606099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19be50 msgr2=0x562b1d1d7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:24.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9126576640 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19be50 0x562b1d1d7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9126576640 1 -- 172.21.15.78:0/3483606099 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912006c470 con 0x562b1d1d8d70 2023-10-14T09:18:24.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9125574640 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19be50 0x562b1d1d7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:24.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9126576640 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d19ea60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x562b1d170cb0 tx=0x7f9118001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e5379a37b79d96 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:24.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9100ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:24.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9100ff9640 1 -- 172.21.15.78:0/3483606099 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118005070 con 0x562b1d1d8d70 2023-10-14T09:18:24.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9100ff9640 1 -- 172.21.15.78:0/3483606099 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f911801b070 con 0x562b1d1d8d70 2023-10-14T09:18:24.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 1 -- 172.21.15.78:0/3483606099 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b1cfa2370 con 0x562b1d1d8d70 2023-10-14T09:18:24.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9100ff9640 1 -- 172.21.15.78:0/3483606099 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91180051d0 con 0x562b1d1d8d70 2023-10-14T09:18:24.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 10 client.5322 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:24.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f912b359000 1 -- 172.21.15.78:0/3483606099 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x562b1cfb0460 con 0x562b1d1d8d70 2023-10-14T09:18:24.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.099+0000 7f9100ff9640 1 -- 172.21.15.78:0/3483606099 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b1cfa2370 con 0x562b1d1d8d70 2023-10-14T09:18:24.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f9100ff9640 1 -- 172.21.15.78:0/3483606099 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f9118005330 con 0x562b1d1d8d70 2023-10-14T09:18:24.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 10 client.5322 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:24.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 10 client.5322 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:24.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 20 client.5322 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:24.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x562b1d19f800 0x562b1d19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 4 client.5322 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:18:24.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 -- 172.21.15.78:0/3483606099 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b1cf882d0 con 0x562b1d19f800 2023-10-14T09:18:24.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f9125d75640 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x562b1d19f800 0x562b1d19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f9125d75640 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x562b1d19f800 0x562b1d19fbe0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3bad88c90d5021 server_cookie=880de2b0ef067144 in_seq=0 out_seq=0 2023-10-14T09:18:24.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f9100ff9640 10 client.5322 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:24.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f9100ff9640 1 -- 172.21.15.78:0/3483606099 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562b1cf882d0 con 0x562b1d19f800 2023-10-14T09:18:24.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f9100ff9640 10 client.5322 handle_command_reply: tid=0 2023-10-14T09:18:24.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 client.5322 shutdown 2023-10-14T09:18:24.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 -- 172.21.15.78:0/3483606099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 msgr2=0x562b1d19ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:24.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d19ea60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x562b1d170cb0 tx=0x7f9118001660 comp rx=0 tx=0).stop 2023-10-14T09:18:24.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 -- 172.21.15.78:0/3483606099 shutdown_connections 2023-10-14T09:18:24.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x562b1d19f800 0x562b1d19fbe0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d19ea60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19be50 0x562b1d1d7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 --2- 172.21.15.78:0/3483606099 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19b530 0x562b1d1d7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f9100ff9640 0 client.5322 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:24.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 -- 172.21.15.78:0/3483606099 >> 172.21.15.78:0/3483606099 conn(0x562b1d1a3c90 msgr2=0x562b1d19a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:24.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 -- 172.21.15.78:0/3483606099 shutdown_connections 2023-10-14T09:18:24.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 1 -- 172.21.15.78:0/3483606099 wait complete. 2023-10-14T09:18:24.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.103+0000 7f912b359000 20 client.5322 trim_cache size 0 max 16384 2023-10-14T09:18:24.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 Processor -- start 2023-10-14T09:18:24.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 -- start start 2023-10-14T09:18:24.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19b530 0x562b1d19a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19be50 0x562b1d1eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d1ee300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cca8940 con 0x562b1d1d8d70 2023-10-14T09:18:24.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cff2740 con 0x562b1d19be50 2023-10-14T09:18:24.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b1d074180 con 0x562b1d19b530 2023-10-14T09:18:24.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9126576640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d1ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9126576640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d1ee300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59082/0 (socket says 172.21.15.78:59082) 2023-10-14T09:18:24.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9126576640 1 -- 172.21.15.78:0/1580492266 learned_addr learned my addr 172.21.15.78:0/1580492266 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:24.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9125d75640 1 --2- 172.21.15.78:0/1580492266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19b530 0x562b1d19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9125574640 1 --2- 172.21.15.78:0/1580492266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19be50 0x562b1d1eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9126576640 1 -- 172.21.15.78:0/1580492266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19b530 msgr2=0x562b1d19a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:24.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9126576640 1 --2- 172.21.15.78:0/1580492266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19b530 0x562b1d19a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9126576640 1 -- 172.21.15.78:0/1580492266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19be50 msgr2=0x562b1d1eddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:24.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9126576640 1 --2- 172.21.15.78:0/1580492266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19be50 0x562b1d1eddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9126576640 1 -- 172.21.15.78:0/1580492266 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b1cf96760 con 0x562b1d1d8d70 2023-10-14T09:18:24.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9125d75640 1 --2- 172.21.15.78:0/1580492266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19b530 0x562b1d19a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:24.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9126576640 1 --2- 172.21.15.78:0/1580492266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d1ee300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9118007e00 tx=0x7f9118023070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb1fc1cdd766b9b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:24.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9103fff640 1 -- 172.21.15.78:0/1580492266 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911801a070 con 0x562b1d1d8d70 2023-10-14T09:18:24.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9103fff640 1 -- 172.21.15.78:0/1580492266 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911801b040 con 0x562b1d1d8d70 2023-10-14T09:18:24.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f9103fff640 1 -- 172.21.15.78:0/1580492266 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118005070 con 0x562b1d1d8d70 2023-10-14T09:18:24.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 -- 172.21.15.78:0/1580492266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 msgr2=0x562b1d1ee300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:24.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 --2- 172.21.15.78:0/1580492266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d1ee300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9118007e00 tx=0x7f9118023070 comp rx=0 tx=0).stop 2023-10-14T09:18:24.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 -- 172.21.15.78:0/1580492266 shutdown_connections 2023-10-14T09:18:24.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 --2- 172.21.15.78:0/1580492266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d1d8d70 0x562b1d1ee300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 --2- 172.21.15.78:0/1580492266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d19be50 0x562b1d1eddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 --2- 172.21.15.78:0/1580492266 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19b530 0x562b1d19a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 -- 172.21.15.78:0/1580492266 >> 172.21.15.78:0/1580492266 conn(0x562b1d1a3c90 msgr2=0x562b1d2353e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:24.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.119+0000 7f912b359000 1 -- 172.21.15.78:0/1580492266 shutdown_connections 2023-10-14T09:18:24.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 -- 172.21.15.78:0/1580492266 wait complete. 2023-10-14T09:18:24.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 -- start start 2023-10-14T09:18:24.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 Processor -- start 2023-10-14T09:18:24.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19b530 0x562b1d1f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19be50 0x562b1d1f1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d1d8d70 0x562b1d1f1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1d0b5de0 con 0x562b1d19b530 2023-10-14T09:18:24.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cfc9130 con 0x562b1d1d8d70 2023-10-14T09:18:24.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b1d08a810 con 0x562b1d19be50 2023-10-14T09:18:24.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 10 client.0 _ll_register_callbacks cb 0x7f911c000f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:24.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9125d75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19b530 0x562b1d1f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9125d75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19b530 0x562b1d1f0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59086/0 (socket says 172.21.15.78:59086) 2023-10-14T09:18:24.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9125d75640 1 -- 172.21.15.78:0/3459321707 learned_addr learned my addr 172.21.15.78:0/3459321707 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:24.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9125574640 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19be50 0x562b1d1f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9126576640 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d1d8d70 0x562b1d1f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9125d75640 1 -- 172.21.15.78:0/3459321707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19be50 msgr2=0x562b1d1f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:24.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9125d75640 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19be50 0x562b1d1f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9125d75640 1 -- 172.21.15.78:0/3459321707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d1d8d70 msgr2=0x562b1d1f1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:24.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9125d75640 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d1d8d70 0x562b1d1f1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9125d75640 1 -- 172.21.15.78:0/3459321707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b1cfb0460 con 0x562b1d19b530 2023-10-14T09:18:24.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9125d75640 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19b530 0x562b1d1f0ed0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f911c004c80 tx=0x7f911c001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77d3124ba593f2a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:24.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9100ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:24.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9100ff9640 1 -- 172.21.15.78:0/3459321707 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c01a040 con 0x562b1d19b530 2023-10-14T09:18:24.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9100ff9640 1 -- 172.21.15.78:0/3459321707 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f911c02b520 con 0x562b1d19b530 2023-10-14T09:18:24.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 -- 172.21.15.78:0/3459321707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b1cf866f0 con 0x562b1d19b530 2023-10-14T09:18:24.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9100ff9640 1 -- 172.21.15.78:0/3459321707 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f911c02b7a0 con 0x562b1d19b530 2023-10-14T09:18:24.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 10 client.5328 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:24.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 -- 172.21.15.78:0/3459321707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x562b1cce7cc0 con 0x562b1d19b530 2023-10-14T09:18:24.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9100ff9640 1 -- 172.21.15.78:0/3459321707 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b1cf866f0 con 0x562b1d19b530 2023-10-14T09:18:24.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9100ff9640 1 -- 172.21.15.78:0/3459321707 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f911c020040 con 0x562b1d19b530 2023-10-14T09:18:24.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 10 client.5328 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:24.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 10 client.5328 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:24.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 20 client.5328 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:24.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x562b1d2436b0 0x562b1d245aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:24.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 4 client.5328 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T09:18:24.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f912b359000 1 -- 172.21.15.78:0/3459321707 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562b1cfe7720 con 0x562b1d2436b0 2023-10-14T09:18:24.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.123+0000 7f9125574640 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x562b1d2436b0 0x562b1d245aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:24.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9100ff9640 10 client.5328 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:24.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9125574640 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x562b1d2436b0 0x562b1d245aa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e2ce234b0bae2ed server_cookie=4deb9699942b6b65 in_seq=0 out_seq=0 2023-10-14T09:18:24.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9100ff9640 1 -- 172.21.15.78:0/3459321707 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x562b1cfe7720 con 0x562b1d2436b0 2023-10-14T09:18:24.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9100ff9640 10 client.5328 handle_command_reply: tid=0 2023-10-14T09:18:24.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 1 client.5328 shutdown 2023-10-14T09:18:24.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 1 -- 172.21.15.78:0/3459321707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19b530 msgr2=0x562b1d1f0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:24.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19b530 0x562b1d1f0ed0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f911c004c80 tx=0x7f911c001990 comp rx=0 tx=0).stop 2023-10-14T09:18:24.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 1 -- 172.21.15.78:0/3459321707 shutdown_connections 2023-10-14T09:18:24.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x562b1d2436b0 0x562b1d245aa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x562b1d1d8d70 0x562b1d1f1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x562b1d19be50 0x562b1d1f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 1 --2- 172.21.15.78:0/3459321707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b1d19b530 0x562b1d1f0ed0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9100ff9640 0 client.5328 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:24.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 1 -- 172.21.15.78:0/3459321707 >> 172.21.15.78:0/3459321707 conn(0x562b1d1a3c90 msgr2=0x562b1d199fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:24.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 1 -- 172.21.15.78:0/3459321707 shutdown_connections 2023-10-14T09:18:24.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 1 -- 172.21.15.78:0/3459321707 wait complete. 2023-10-14T09:18:24.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f912b359000 20 client.5328 trim_cache size 0 max 16384 2023-10-14T09:18:24.147 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:18:24.147 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "1f80be0e-0937-433c-91b2-bf32e5285783", 2023-10-14T09:18:24.147 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-10-14T09:18:24.147 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5109, 2023-10-14T09:18:24.148 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-10-14T09:18:24.148 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-10-14T09:18:24.148 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "testcephfs1", 2023-10-14T09:18:24.148 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 7.4993173640000004, 2023-10-14T09:18:24.148 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 17, 2023-10-14T09:18:24.149 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 32, 2023-10-14T09:18:24.149 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 32, 2023-10-14T09:18:24.149 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 15.362768426000001 2023-10-14T09:18:24.149 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:18:24.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 -- 172.21.15.78:0/3892388488 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91040664d0 msgr2=0x7f9104068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91040664d0 0x7f9104068990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91200c2e10 tx=0x7f911c001e20 comp rx=0 tx=0).stop 2023-10-14T09:18:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 -- 172.21.15.78:0/3892388488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91200c3050 msgr2=0x7f91200bf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91200c3050 0x7f91200bf850 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9110009ab0 tx=0x7f910c005800 comp rx=0 tx=0).stop 2023-10-14T09:18:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 -- 172.21.15.78:0/3892388488 shutdown_connections 2023-10-14T09:18:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f912014a780 0x7f912014ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91200c3050 0x7f91200bf850 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91040664d0 0x7f9104068990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 --2- 172.21.15.78:0/3892388488 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f910c0047d0 0x7f91201ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:24.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 -- 172.21.15.78:0/3892388488 >> 172.21.15.78:0/3892388488 conn(0x7f91200ab1f0 msgr2=0x7f91200c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:24.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 -- 172.21.15.78:0/3892388488 shutdown_connections 2023-10-14T09:18:24.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:24.127+0000 7f9127fd9640 1 -- 172.21.15.78:0/3892388488 wait complete. 2023-10-14T09:18:24.153 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T09:18:16.002036+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5109": { "addr": "172.21.15.78:6837/4241140805", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6836", "nonce": 4241140805, "type": "v2" }, { "addr": "172.21.15.78:6837", "nonce": 4241140805, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5109, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T09:18:19.017889+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5109 } } } ], "standbys": [ { "addr": "172.21.15.157:6833/2822193022", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6832", "nonce": 2822193022, "type": "v2" }, { "addr": "172.21.15.157:6833", "nonce": 2822193022, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5002, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.157:6835/488302185", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6834", "nonce": 488302185, "type": "v2" }, { "addr": "172.21.15.157:6835", "nonce": 488302185, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5005, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.78:6835/3378161275", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6834", "nonce": 3378161275, "type": "v2" }, { "addr": "172.21.15.78:6835", "nonce": 3378161275, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5106, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T09:18:24.154 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': 2, 'name': 'b', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T09:18:24.155 INFO:tasks.cephfs.test_failover:current = [{'gid': 5106, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.78:6835/3378161275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3378161275}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3378161275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 5002, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6833/2822193022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6832', 'nonce': 2822193022}, {'type': 'v1', 'addr': '172.21.15.157:6833', 'nonce': 2822193022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 5005, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6835/488302185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 488302185}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 488302185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T09:18:24.155 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T09:18:24.156 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T09:18:25.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:18:25.371 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:18:29.156 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:29.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b80fe4640 1 Processor -- start 2023-10-14T09:18:29.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b80fe4640 1 -- start start 2023-10-14T09:18:29.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b80fe4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5b7c0c5850 0x7f5b7c0bc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:29.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b80fe4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c154620 con 0x7f5b7c0c3730 2023-10-14T09:18:29.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b80fe4640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c0c6a60 con 0x7f5b7c151300 2023-10-14T09:18:29.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b80fe4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c154b40 con 0x7f5b7c0c5850 2023-10-14T09:18:29.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b7affd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5b7c0c3730 0x7f5b7c0c5140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53748/0 (socket says 172.21.15.78:53748) 2023-10-14T09:18:29.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b7affd640 1 -- 172.21.15.78:0/3283722997 learned_addr learned my addr 172.21.15.78:0/3283722997 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:29.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b7bfff640 1 --2- 172.21.15.78:0/3283722997 >> v2:172.21.15.157:3300/0 conn(0x7f5b7c0c5850 0x7f5b7c0bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:29.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b7a7fc640 1 -- 172.21.15.78:0/3283722997 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941817937 0 0) 0x7f5b70001120 con 0x7f5b7c0c3730 2023-10-14T09:18:29.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b7a7fc640 1 -- 172.21.15.78:0/3283722997 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b64003530 con 0x7f5b7c0c3730 2023-10-14T09:18:29.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b7bfff640 1 -- 172.21.15.78:0/3283722997 >> v1:172.21.15.157:6789/0 conn(0x7f5b7c151300 legacy=0x7f5b7c0a8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:29.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b7a7fc640 1 -- 172.21.15.78:0/3283722997 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876753234 0 0) 0x7f5b7c0c6a60 con 0x7f5b7c151300 2023-10-14T09:18:29.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b7bfff640 1 -- 172.21.15.78:0/3283722997 >> v1:172.21.15.78:6789/0 conn(0x7f5b7c0c3730 legacy=0x7f5b7c0c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:29.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.303+0000 7f5b7bfff640 1 -- 172.21.15.78:0/3283722997 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0c6f40 con 0x7f5b7c0c5850 2023-10-14T09:18:29.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.307+0000 7f5b7bfff640 1 --2- 172.21.15.78:0/3283722997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b7c0c5850 0x7f5b7c0bc100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009d90 tx=0x7f5b7401c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3ac7869117c4506 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:29.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.307+0000 7f5b7a7fc640 1 -- 172.21.15.78:0/3283722997 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70001810 con 0x7f5b7c0c5850 2023-10-14T09:18:29.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.307+0000 7f5b7a7fc640 1 -- 172.21.15.78:0/3283722997 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b740a6420 con 0x7f5b7c0c5850 2023-10-14T09:18:29.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.307+0000 7f5b7a7fc640 1 -- 172.21.15.78:0/3283722997 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740a67b0 con 0x7f5b7c0c5850 2023-10-14T09:18:29.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.307+0000 7f5b80fe4640 1 -- 172.21.15.78:0/3283722997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b7c0c5850 msgr2=0x7f5b7c0bc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:29.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.307+0000 7f5b80fe4640 1 --2- 172.21.15.78:0/3283722997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b7c0c5850 0x7f5b7c0bc100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009d90 tx=0x7f5b7401c790 comp rx=0 tx=0).stop 2023-10-14T09:18:29.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.307+0000 7f5b80fe4640 1 -- 172.21.15.78:0/3283722997 shutdown_connections 2023-10-14T09:18:29.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.307+0000 7f5b80fe4640 1 --2- 172.21.15.78:0/3283722997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b7c0c5850 0x7f5b7c0bc100 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:29.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.307+0000 7f5b80fe4640 1 -- 172.21.15.78:0/3283722997 >> 172.21.15.78:0/3283722997 conn(0x7f5b7c0c7240 msgr2=0x7f5b7c0c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:29.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.307+0000 7f5b80fe4640 1 -- 172.21.15.78:0/3283722997 shutdown_connections 2023-10-14T09:18:29.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.307+0000 7f5b80fe4640 1 -- 172.21.15.78:0/3283722997 wait complete. 2023-10-14T09:18:29.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b80fe4640 1 Processor -- start 2023-10-14T09:18:29.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b80fe4640 1 -- start start 2023-10-14T09:18:29.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b80fe4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b7c0c3730 0x7f5b7c1eca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:29.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b80fe4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c0c5850 0x7f5b7c1ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:29.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b80fe4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b7c151300 0x7f5b7c147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:29.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b80fe4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1ec0b0 con 0x7f5b7c0c5850 2023-10-14T09:18:29.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b80fe4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c06f5d0 con 0x7f5b7c0c3730 2023-10-14T09:18:29.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b80fe4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c14ae40 con 0x7f5b7c151300 2023-10-14T09:18:29.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c0c5850 0x7f5b7c1ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:29.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c0c5850 0x7f5b7c1ed520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50356/0 (socket says 172.21.15.78:50356) 2023-10-14T09:18:29.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7affd640 1 -- 172.21.15.78:0/1891093782 learned_addr learned my addr 172.21.15.78:0/1891093782 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:29.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7b7fe640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b7c0c3730 0x7f5b7c1eca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:29.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7bfff640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b7c151300 0x7f5b7c147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:29.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7affd640 1 -- 172.21.15.78:0/1891093782 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b7c151300 msgr2=0x7f5b7c147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:29.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7affd640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b7c151300 0x7f5b7c147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:29.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7affd640 1 -- 172.21.15.78:0/1891093782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b7c0c3730 msgr2=0x7f5b7c1eca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:29.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7affd640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b7c0c3730 0x7f5b7c1eca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:29.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7affd640 1 -- 172.21.15.78:0/1891093782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74009a70 con 0x7f5b7c0c5850 2023-10-14T09:18:29.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7b7fe640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b7c0c3730 0x7f5b7c1eca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:29.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b7affd640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c0c5850 0x7f5b7c1ed520 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000c760 tx=0x7f5b7000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:29.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b63fff640 1 -- 172.21.15.78:0/1891093782 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700074e0 con 0x7f5b7c0c5850 2023-10-14T09:18:29.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b63fff640 1 -- 172.21.15.78:0/1891093782 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70007660 con 0x7f5b7c0c5850 2023-10-14T09:18:29.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b80fe4640 1 -- 172.21.15.78:0/1891093782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c1ecfc0 con 0x7f5b7c0c5850 2023-10-14T09:18:29.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b63fff640 1 -- 172.21.15.78:0/1891093782 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70004a30 con 0x7f5b7c0c5850 2023-10-14T09:18:29.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b80fe4640 1 -- 172.21.15.78:0/1891093782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c06f010 con 0x7f5b7c0c5850 2023-10-14T09:18:29.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.311+0000 7f5b80fe4640 1 -- 172.21.15.78:0/1891093782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c04e9c0 con 0x7f5b7c0c5850 2023-10-14T09:18:29.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.315+0000 7f5b63fff640 1 -- 172.21.15.78:0/1891093782 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b70004b90 con 0x7f5b7c0c5850 2023-10-14T09:18:29.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.315+0000 7f5b63fff640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b680664a0 0x7f5b68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:29.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.315+0000 7f5b63fff640 1 -- 172.21.15.78:0/1891093782 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f5b700834a0 con 0x7f5b7c0c5850 2023-10-14T09:18:29.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.315+0000 7f5b7b7fe640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b680664a0 0x7f5b68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:29.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.315+0000 7f5b7b7fe640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b680664a0 0x7f5b68068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000f70 tx=0x7f5b6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:29.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.319+0000 7f5b63fff640 1 -- 172.21.15.78:0/1891093782 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b70050970 con 0x7f5b7c0c5850 2023-10-14T09:18:29.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.499+0000 7f5b80fe4640 1 -- 172.21.15.78:0/1891093782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b7c154620 con 0x7f5b7c0c5850 2023-10-14T09:18:29.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b63fff640 1 -- 172.21.15.78:0/1891093782 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f5b7c154620 con 0x7f5b7c0c5850 2023-10-14T09:18:29.506 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:29.507 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:18:29.507 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:18:29.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 -- 172.21.15.78:0/1891093782 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b680664a0 msgr2=0x7f5b68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:29.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b680664a0 0x7f5b68068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000f70 tx=0x7f5b6c009040 comp rx=0 tx=0).stop 2023-10-14T09:18:29.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 -- 172.21.15.78:0/1891093782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c0c5850 msgr2=0x7f5b7c1ed520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:29.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c0c5850 0x7f5b7c1ed520 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000c760 tx=0x7f5b7000cc20 comp rx=0 tx=0).stop 2023-10-14T09:18:29.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 -- 172.21.15.78:0/1891093782 shutdown_connections 2023-10-14T09:18:29.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f5b680664a0 0x7f5b68068960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:29.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5b7c151300 0x7f5b7c147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:29.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b7c0c5850 0x7f5b7c1ed520 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:29.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 --2- 172.21.15.78:0/1891093782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5b7c0c3730 0x7f5b7c1eca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:29.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 -- 172.21.15.78:0/1891093782 >> 172.21.15.78:0/1891093782 conn(0x7f5b7c0c7240 msgr2=0x7f5b7c151a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:29.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 -- 172.21.15.78:0/1891093782 shutdown_connections 2023-10-14T09:18:29.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:29.503+0000 7f5b80fe4640 1 -- 172.21.15.78:0/1891093782 wait complete. 2023-10-14T09:18:29.929 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T09:18:16.002036+0000', 'modified': '2023-10-14T09:18:19.017889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5109}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5109': {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T09:18:29.929 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T09:18:29.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T09:18:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.063+0000 7f112ea9e640 1 Processor -- start 2023-10-14T09:18:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.063+0000 7f112ea9e640 1 -- start start 2023-10-14T09:18:30.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112ea9e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f11280a8360 0x7f11280a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112ea9e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f112806cd70 0x7f112806d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112ea9e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1128152a60 con 0x7f112813b050 2023-10-14T09:18:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112ea9e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11280a9340 con 0x7f112806cd70 2023-10-14T09:18:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112ea9e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1128151e50 con 0x7f11280a8360 2023-10-14T09:18:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112c83a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f112813b050 0x7f1128155a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53756/0 (socket says 172.21.15.78:53756) 2023-10-14T09:18:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112c83a640 1 -- 172.21.15.78:0/3416199402 learned_addr learned my addr 172.21.15.78:0/3416199402 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112d03b640 1 --2- 172.21.15.78:0/3416199402 >> v2:172.21.15.78:3300/0 conn(0x7f112806cd70 0x7f112806d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f111ffff640 1 --2- 172.21.15.78:0/3416199402 >> v2:172.21.15.157:3300/0 conn(0x7f11280a8360 0x7f11280a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f111f7fe640 1 -- 172.21.15.78:0/3416199402 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585116321 0 0) 0x7f1128152a60 con 0x7f112813b050 2023-10-14T09:18:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f111f7fe640 1 -- 172.21.15.78:0/3416199402 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1110003530 con 0x7f112813b050 2023-10-14T09:18:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112d03b640 1 -- 172.21.15.78:0/3416199402 >> v2:172.21.15.157:3300/0 conn(0x7f11280a8360 msgr2=0x7f11280a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112d03b640 1 --2- 172.21.15.78:0/3416199402 >> v2:172.21.15.157:3300/0 conn(0x7f11280a8360 0x7f11280a87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112d03b640 1 -- 172.21.15.78:0/3416199402 >> v1:172.21.15.78:6789/0 conn(0x7f112813b050 legacy=0x7f1128155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:30.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f112d03b640 1 -- 172.21.15.78:0/3416199402 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1128152130 con 0x7f112806cd70 2023-10-14T09:18:30.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.067+0000 7f111ffff640 1 --2- 172.21.15.78:0/3416199402 >> v2:172.21.15.157:3300/0 conn(0x7f11280a8360 0x7f11280a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f112d03b640 1 --2- 172.21.15.78:0/3416199402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f112806cd70 0x7f112806d200 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f112806dec0 tx=0x7f112001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1a31bfd10b14c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f111f7fe640 1 -- 172.21.15.78:0/3416199402 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11200a5910 con 0x7f112806cd70 2023-10-14T09:18:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f111f7fe640 1 -- 172.21.15.78:0/3416199402 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11200a5a70 con 0x7f112806cd70 2023-10-14T09:18:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f111f7fe640 1 -- 172.21.15.78:0/3416199402 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11200a5e00 con 0x7f112806cd70 2023-10-14T09:18:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f112ea9e640 1 -- 172.21.15.78:0/3416199402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f112806cd70 msgr2=0x7f112806d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f112ea9e640 1 --2- 172.21.15.78:0/3416199402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f112806cd70 0x7f112806d200 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f112806dec0 tx=0x7f112001c850 comp rx=0 tx=0).stop 2023-10-14T09:18:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f112ea9e640 1 -- 172.21.15.78:0/3416199402 shutdown_connections 2023-10-14T09:18:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f112ea9e640 1 --2- 172.21.15.78:0/3416199402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f112806cd70 0x7f112806d200 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f112ea9e640 1 --2- 172.21.15.78:0/3416199402 >> v2:172.21.15.157:3300/0 conn(0x7f11280a8360 0x7f11280a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f112ea9e640 1 -- 172.21.15.78:0/3416199402 >> 172.21.15.78:0/3416199402 conn(0x7f11280c1cc0 msgr2=0x7f11280c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f112ea9e640 1 -- 172.21.15.78:0/3416199402 shutdown_connections 2023-10-14T09:18:30.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f112ea9e640 1 -- 172.21.15.78:0/3416199402 wait complete. 2023-10-14T09:18:30.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f112ea9e640 1 Processor -- start 2023-10-14T09:18:30.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.071+0000 7f112ea9e640 1 -- start start 2023-10-14T09:18:30.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112ea9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f112806cd70 0x7f1128137280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112ea9e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11280a8360 0x7f11280be570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112ea9e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f112813b050 0x7f11280bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112ea9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11281377c0 con 0x7f112806cd70 2023-10-14T09:18:30.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112ea9e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11280c2e10 con 0x7f112813b050 2023-10-14T09:18:30.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112ea9e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1128071ad0 con 0x7f11280a8360 2023-10-14T09:18:30.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112c83a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f112806cd70 0x7f1128137280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112c83a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f112806cd70 0x7f1128137280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50382/0 (socket says 172.21.15.78:50382) 2023-10-14T09:18:30.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112c83a640 1 -- 172.21.15.78:0/1687594156 learned_addr learned my addr 172.21.15.78:0/1687594156 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:30.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112d03b640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f112813b050 0x7f11280bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f111ffff640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11280a8360 0x7f11280be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112c83a640 1 -- 172.21.15.78:0/1687594156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11280a8360 msgr2=0x7f11280be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:30.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112c83a640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11280a8360 0x7f11280be570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112c83a640 1 -- 172.21.15.78:0/1687594156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f112813b050 msgr2=0x7f11280bfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112c83a640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f112813b050 0x7f11280bfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112c83a640 1 -- 172.21.15.78:0/1687594156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1120009a70 con 0x7f112806cd70 2023-10-14T09:18:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112c83a640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f112806cd70 0x7f1128137280 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f112400c4d0 tx=0x7f112400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f111d7fa640 1 -- 172.21.15.78:0/1687594156 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124005cf0 con 0x7f112806cd70 2023-10-14T09:18:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f111d7fa640 1 -- 172.21.15.78:0/1687594156 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1124005e50 con 0x7f112806cd70 2023-10-14T09:18:30.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f111d7fa640 1 -- 172.21.15.78:0/1687594156 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124007270 con 0x7f112806cd70 2023-10-14T09:18:30.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112ea9e640 1 -- 172.21.15.78:0/1687594156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11280717f0 con 0x7f112806cd70 2023-10-14T09:18:30.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f112ea9e640 1 -- 172.21.15.78:0/1687594156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11281ecde0 con 0x7f112806cd70 2023-10-14T09:18:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.075+0000 7f111d7fa640 1 -- 172.21.15.78:0/1687594156 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f11240073d0 con 0x7f112806cd70 2023-10-14T09:18:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f111d7fa640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11140664a0 0x7f1114068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f111d7fa640 1 -- 172.21.15.78:0/1687594156 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f11240833d0 con 0x7f112806cd70 2023-10-14T09:18:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f111ffff640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11140664a0 0x7f1114068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f1131e21000 1 Processor -- start 2023-10-14T09:18:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f1131e21000 1 -- start start 2023-10-14T09:18:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f111ffff640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11140664a0 0x7f1114068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1128139c30 tx=0x7f1118008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f1131e21000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd96d70 0x56117bd58ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f1131e21000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd59530 0x56117bd59910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f1131e21000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd5a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f1131e21000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117bb50cc0 con 0x56117bd59e50 2023-10-14T09:18:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f1131e21000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117bbb3920 con 0x56117bd59530 2023-10-14T09:18:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f1131e21000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x56117bbb0e50 con 0x56117bd96d70 2023-10-14T09:18:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f112d03b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd5a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f112d03b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd5a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50384/0 (socket says 172.21.15.78:50384) 2023-10-14T09:18:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f112d03b640 1 -- 172.21.15.78:0/1610380577 learned_addr learned my addr 172.21.15.78:0/1610380577 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f112c83a640 1 --2- 172.21.15.78:0/1610380577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd96d70 0x56117bd58ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f111ffff640 1 --2- 172.21.15.78:0/1610380577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd59530 0x56117bd59910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f112d03b640 1 -- 172.21.15.78:0/1610380577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd96d70 msgr2=0x56117bd58ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f112d03b640 1 --2- 172.21.15.78:0/1610380577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd96d70 0x56117bd58ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f112d03b640 1 -- 172.21.15.78:0/1610380577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd59530 msgr2=0x56117bd59910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f112d03b640 1 --2- 172.21.15.78:0/1610380577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd59530 0x56117bd59910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f112d03b640 1 -- 172.21.15.78:0/1610380577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56117b8a5890 con 0x56117bd59e50 2023-10-14T09:18:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f112d03b640 1 --2- 172.21.15.78:0/1610380577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd5a230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f112001c890 tx=0x7f1120004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2edc5b1e4ffd98 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f110effd640 1 -- 172.21.15.78:0/1610380577 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11200a5be0 con 0x56117bd59e50 2023-10-14T09:18:30.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f110effd640 1 -- 172.21.15.78:0/1610380577 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11200a5d40 con 0x56117bd59e50 2023-10-14T09:18:30.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f110effd640 1 -- 172.21.15.78:0/1610380577 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11200ad640 con 0x56117bd59e50 2023-10-14T09:18:30.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f1131e21000 1 -- 172.21.15.78:0/1610380577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 msgr2=0x56117bd5a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:30.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.079+0000 7f1131e21000 1 --2- 172.21.15.78:0/1610380577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd5a230 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f112001c890 tx=0x7f1120004ac0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 -- 172.21.15.78:0/1610380577 shutdown_connections 2023-10-14T09:18:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 --2- 172.21.15.78:0/1610380577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd5a230 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 --2- 172.21.15.78:0/1610380577 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd59530 0x56117bd59910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 --2- 172.21.15.78:0/1610380577 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd96d70 0x56117bd58ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 -- 172.21.15.78:0/1610380577 >> 172.21.15.78:0/1610380577 conn(0x56117bd61c90 msgr2=0x56117bd995c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 -- 172.21.15.78:0/1610380577 shutdown_connections 2023-10-14T09:18:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 -- 172.21.15.78:0/1610380577 wait complete. 2023-10-14T09:18:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 -- start start 2023-10-14T09:18:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 Processor -- start 2023-10-14T09:18:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59530 0x56117bd95980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd95ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bd5ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117bbac740 con 0x56117bd59e50 2023-10-14T09:18:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117bb6bd10 con 0x56117bd96d70 2023-10-14T09:18:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x56117bb6b9b0 con 0x56117bd59530 2023-10-14T09:18:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 10 client.0 _ll_register_callbacks cb 0x56117bd47390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f111ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd95ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f111ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd95ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50388/0 (socket says 172.21.15.78:50388) 2023-10-14T09:18:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f111ffff640 1 -- 172.21.15.78:0/2019194297 learned_addr learned my addr 172.21.15.78:0/2019194297 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f112c83a640 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59530 0x56117bd95980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f112d03b640 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bd5ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f111ffff640 1 -- 172.21.15.78:0/2019194297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59530 msgr2=0x56117bd95980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f111ffff640 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59530 0x56117bd95980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f111ffff640 1 -- 172.21.15.78:0/2019194297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 msgr2=0x56117bd5ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f111ffff640 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bd5ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f111ffff640 1 -- 172.21.15.78:0/2019194297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1128152130 con 0x56117bd59e50 2023-10-14T09:18:30.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f112c83a640 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59530 0x56117bd95980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:18:30.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f111ffff640 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd95ec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f11180156f0 tx=0x7f11180046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bcf539a81f07c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:30.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f11077fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:30.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f11077fe640 1 -- 172.21.15.78:0/2019194297 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1118022770 con 0x56117bd59e50 2023-10-14T09:18:30.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f11077fe640 1 -- 172.21.15.78:0/2019194297 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f11180228d0 con 0x56117bd59e50 2023-10-14T09:18:30.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 -- 172.21.15.78:0/2019194297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56117bb60370 con 0x56117bd59e50 2023-10-14T09:18:30.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f11077fe640 1 -- 172.21.15.78:0/2019194297 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1118022a90 con 0x56117bd59e50 2023-10-14T09:18:30.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 10 client.5349 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:30.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 -- 172.21.15.78:0/2019194297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56117bb6e460 con 0x56117bd59e50 2023-10-14T09:18:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f11077fe640 1 -- 172.21.15.78:0/2019194297 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56117bb60370 con 0x56117bd59e50 2023-10-14T09:18:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f11077fe640 1 -- 172.21.15.78:0/2019194297 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f1118028020 con 0x56117bd59e50 2023-10-14T09:18:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 10 client.5349 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 10 client.5349 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 20 client.5349 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x56117bd5d800 0x56117bd5dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 4 client.5349 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:18:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.083+0000 7f1131e21000 1 -- 172.21.15.78:0/2019194297 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56117bb462d0 con 0x56117bd5d800 2023-10-14T09:18:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f112c83a640 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x56117bd5d800 0x56117bd5dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f11077fe640 10 client.5349 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f112c83a640 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x56117bd5d800 0x56117bd5dbe0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a0c8e2614603e02 server_cookie=89ec24ca35185968 in_seq=0 out_seq=0 2023-10-14T09:18:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f11077fe640 1 -- 172.21.15.78:0/2019194297 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56117bb462d0 con 0x56117bd5d800 2023-10-14T09:18:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f11077fe640 10 client.5349 handle_command_reply: tid=0 2023-10-14T09:18:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 1 client.5349 shutdown 2023-10-14T09:18:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 1 -- 172.21.15.78:0/2019194297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 msgr2=0x56117bd95ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd95ec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f11180156f0 tx=0x7f11180046d0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 1 -- 172.21.15.78:0/2019194297 shutdown_connections 2023-10-14T09:18:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x56117bd5d800 0x56117bd5dbe0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bd5ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59e50 0x56117bd95ec0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 1 --2- 172.21.15.78:0/2019194297 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59530 0x56117bd95980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f11077fe640 0 client.5349 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 1 -- 172.21.15.78:0/2019194297 >> 172.21.15.78:0/2019194297 conn(0x56117bd61c90 msgr2=0x56117bd586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 1 -- 172.21.15.78:0/2019194297 shutdown_connections 2023-10-14T09:18:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 1 -- 172.21.15.78:0/2019194297 wait complete. 2023-10-14T09:18:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.087+0000 7f1131e21000 20 client.5349 trim_cache size 0 max 16384 2023-10-14T09:18:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 Processor -- start 2023-10-14T09:18:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 -- start start 2023-10-14T09:18:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bd58760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59e50 0x56117bdabdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bdac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117b866940 con 0x56117bd59530 2023-10-14T09:18:30.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117bd99390 con 0x56117bd96d70 2023-10-14T09:18:30.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x56117bbb6200 con 0x56117bd59e50 2023-10-14T09:18:30.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f112c83a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bd58760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f112c83a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bd58760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50390/0 (socket says 172.21.15.78:50390) 2023-10-14T09:18:30.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f112c83a640 1 -- 172.21.15.78:0/3968223305 learned_addr learned my addr 172.21.15.78:0/3968223305 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:30.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f112d03b640 1 --2- 172.21.15.78:0/3968223305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bdac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f111ffff640 1 --2- 172.21.15.78:0/3968223305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59e50 0x56117bdabdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f112c83a640 1 -- 172.21.15.78:0/3968223305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59e50 msgr2=0x56117bdabdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f112c83a640 1 --2- 172.21.15.78:0/3968223305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59e50 0x56117bdabdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f112c83a640 1 -- 172.21.15.78:0/3968223305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 msgr2=0x56117bdac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f112c83a640 1 --2- 172.21.15.78:0/3968223305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bdac300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f112c83a640 1 -- 172.21.15.78:0/3968223305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56117bb54760 con 0x56117bd59530 2023-10-14T09:18:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f112d03b640 1 --2- 172.21.15.78:0/3968223305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bdac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f112c83a640 1 --2- 172.21.15.78:0/3968223305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bd58760 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1124000f70 tx=0x7f1124014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2508f995cc504f00 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f110f7fe640 1 -- 172.21.15.78:0/3968223305 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124052930 con 0x56117bd59530 2023-10-14T09:18:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f110f7fe640 1 -- 172.21.15.78:0/3968223305 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1124007680 con 0x56117bd59530 2023-10-14T09:18:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f110f7fe640 1 -- 172.21.15.78:0/3968223305 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124053a80 con 0x56117bd59530 2023-10-14T09:18:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 -- 172.21.15.78:0/3968223305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 msgr2=0x56117bd58760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 --2- 172.21.15.78:0/3968223305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bd58760 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1124000f70 tx=0x7f1124014040 comp rx=0 tx=0).stop 2023-10-14T09:18:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 -- 172.21.15.78:0/3968223305 shutdown_connections 2023-10-14T09:18:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 --2- 172.21.15.78:0/3968223305 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bdac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 --2- 172.21.15.78:0/3968223305 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59e50 0x56117bdabdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 --2- 172.21.15.78:0/3968223305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bd58760 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 -- 172.21.15.78:0/3968223305 >> 172.21.15.78:0/3968223305 conn(0x56117bd61c90 msgr2=0x56117bdf31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 -- 172.21.15.78:0/3968223305 shutdown_connections 2023-10-14T09:18:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 -- 172.21.15.78:0/3968223305 wait complete. 2023-10-14T09:18:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 -- start start 2023-10-14T09:18:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.103+0000 7f1131e21000 1 Processor -- start 2023-10-14T09:18:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bdf07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59e50 0x56117bdf8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bdf94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117bbab5d0 con 0x56117bd59530 2023-10-14T09:18:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x56117bb5a6c0 con 0x56117bd96d70 2023-10-14T09:18:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x56117bba9b40 con 0x56117bd59e50 2023-10-14T09:18:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 10 client.0 _ll_register_callbacks cb 0x7f11100036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f112c83a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bdf07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f112c83a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bdf07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50406/0 (socket says 172.21.15.78:50406) 2023-10-14T09:18:30.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f112c83a640 1 -- 172.21.15.78:0/2957729000 learned_addr learned my addr 172.21.15.78:0/2957729000 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:30.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f112d03b640 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bdf94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f111ffff640 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59e50 0x56117bdf8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f112c83a640 1 -- 172.21.15.78:0/2957729000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59e50 msgr2=0x56117bdf8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:30.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f112c83a640 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59e50 0x56117bdf8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f112c83a640 1 -- 172.21.15.78:0/2957729000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 msgr2=0x56117bdf94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f112c83a640 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bdf94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f112c83a640 1 -- 172.21.15.78:0/2957729000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11281ecde0 con 0x56117bd59530 2023-10-14T09:18:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f112c83a640 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bdf07b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1124054290 tx=0x7f11240817a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb72ba716494c6c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f11077fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f11077fe640 1 -- 172.21.15.78:0/2957729000 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124053a80 con 0x56117bd59530 2023-10-14T09:18:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f11077fe640 1 -- 172.21.15.78:0/2957729000 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1124053be0 con 0x56117bd59530 2023-10-14T09:18:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 -- 172.21.15.78:0/2957729000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56117bb446f0 con 0x56117bd59530 2023-10-14T09:18:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f11077fe640 1 -- 172.21.15.78:0/2957729000 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f112405c350 con 0x56117bd59530 2023-10-14T09:18:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 10 client.5355 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 -- 172.21.15.78:0/2957729000 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56117b8a5cc0 con 0x56117bd59530 2023-10-14T09:18:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f11077fe640 1 -- 172.21.15.78:0/2957729000 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56117bb446f0 con 0x56117bd59530 2023-10-14T09:18:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f11077fe640 1 -- 172.21.15.78:0/2957729000 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f112407b470 con 0x56117bd59530 2023-10-14T09:18:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 10 client.5355 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 10 client.5355 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 20 client.5355 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x56117bdf99e0 0x56117bdf9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 4 client.5355 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T09:18:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 -- 172.21.15.78:0/2957729000 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56117bba5720 con 0x56117bdf99e0 2023-10-14T09:18:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f111ffff640 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x56117bdf99e0 0x56117bdf9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f11077fe640 10 client.5355 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f111ffff640 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x56117bdf99e0 0x56117bdf9dc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51269dd837f08246 server_cookie=1902c9a727ff5c3a in_seq=0 out_seq=0 2023-10-14T09:18:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f11077fe640 1 -- 172.21.15.78:0/2957729000 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x56117bba5720 con 0x56117bdf99e0 2023-10-14T09:18:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f11077fe640 10 client.5355 handle_command_reply: tid=0 2023-10-14T09:18:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 client.5355 shutdown 2023-10-14T09:18:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 -- 172.21.15.78:0/2957729000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 msgr2=0x56117bdf07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bdf07b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1124054290 tx=0x7f11240817a0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 -- 172.21.15.78:0/2957729000 shutdown_connections 2023-10-14T09:18:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x56117bdf99e0 0x56117bdf9dc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x56117bd96d70 0x56117bdf94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x56117bd59e50 0x56117bdf8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f11077fe640 0 client.5355 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 --2- 172.21.15.78:0/2957729000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56117bd59530 0x56117bdf07b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 -- 172.21.15.78:0/2957729000 >> 172.21.15.78:0/2957729000 conn(0x56117bd61c90 msgr2=0x56117bda9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 -- 172.21.15.78:0/2957729000 shutdown_connections 2023-10-14T09:18:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.107+0000 7f1131e21000 1 -- 172.21.15.78:0/2957729000 wait complete. 2023-10-14T09:18:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f1131e21000 20 client.5355 trim_cache size 0 max 16384 2023-10-14T09:18:30.130 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:18:30.130 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "1f80be0e-0937-433c-91b2-bf32e5285783", 2023-10-14T09:18:30.131 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-10-14T09:18:30.131 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5109, 2023-10-14T09:18:30.131 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-10-14T09:18:30.131 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-10-14T09:18:30.131 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "testcephfs1", 2023-10-14T09:18:30.131 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 13.482207749000001, 2023-10-14T09:18:30.132 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 17, 2023-10-14T09:18:30.132 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 32, 2023-10-14T09:18:30.132 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 32, 2023-10-14T09:18:30.132 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 21.345659584 2023-10-14T09:18:30.132 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:18:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 -- 172.21.15.78:0/1687594156 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11140664a0 msgr2=0x7f1114068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11140664a0 0x7f1114068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1128139c30 tx=0x7f1118008040 comp rx=0 tx=0).stop 2023-10-14T09:18:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 -- 172.21.15.78:0/1687594156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f112806cd70 msgr2=0x7f1128137280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f112806cd70 0x7f1128137280 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f112400c4d0 tx=0x7f112400c990 comp rx=0 tx=0).stop 2023-10-14T09:18:30.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 -- 172.21.15.78:0/1687594156 shutdown_connections 2023-10-14T09:18:30.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f112813b050 0x7f11280bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f11140664a0 0x7f1114068960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f11280a8360 0x7f11280be570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 --2- 172.21.15.78:0/1687594156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f112806cd70 0x7f1128137280 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:30.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 -- 172.21.15.78:0/1687594156 >> 172.21.15.78:0/1687594156 conn(0x7f11280c1cc0 msgr2=0x7f1128151330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:30.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 -- 172.21.15.78:0/1687594156 shutdown_connections 2023-10-14T09:18:30.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:30.111+0000 7f112ea9e640 1 -- 172.21.15.78:0/1687594156 wait complete. 2023-10-14T09:18:30.136 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T09:18:16.002036+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5109": { "addr": "172.21.15.78:6837/4241140805", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6836", "nonce": 4241140805, "type": "v2" }, { "addr": "172.21.15.78:6837", "nonce": 4241140805, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5109, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T09:18:19.017889+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5109 } } } ], "standbys": [ { "addr": "172.21.15.157:6833/2822193022", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6832", "nonce": 2822193022, "type": "v2" }, { "addr": "172.21.15.157:6833", "nonce": 2822193022, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5002, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.157:6835/488302185", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6834", "nonce": 488302185, "type": "v2" }, { "addr": "172.21.15.157:6835", "nonce": 488302185, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5005, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.78:6835/3378161275", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6834", "nonce": 3378161275, "type": "v2" }, { "addr": "172.21.15.78:6835", "nonce": 3378161275, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5106, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T09:18:30.138 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': 2, 'name': 'b', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T09:18:30.138 INFO:tasks.cephfs.test_failover:current = [{'gid': 5106, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.78:6835/3378161275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3378161275}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3378161275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 5002, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6833/2822193022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6832', 'nonce': 2822193022}, {'type': 'v1', 'addr': '172.21.15.157:6833', 'nonce': 2822193022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 5005, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6835/488302185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 488302185}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 488302185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T09:18:30.139 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T09:18:30.139 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T09:18:35.140 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:35.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2ade09640 1 Processor -- start 2023-10-14T09:18:35.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2ade09640 1 -- start start 2023-10-14T09:18:35.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2ade09640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff2a814ddb0 0x7ff2a80c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:35.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2ade09640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a8153e80 0x7ff2a806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:35.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2ade09640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a806c470 con 0x7ff2a80c6910 2023-10-14T09:18:35.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2ade09640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a80c64f0 con 0x7ff2a814ddb0 2023-10-14T09:18:35.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2ade09640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80c5300 con 0x7ff2a8153e80 2023-10-14T09:18:35.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2a77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff2a814ddb0 0x7ff2a80c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:35.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2a77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff2a814ddb0 0x7ff2a80c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50416/0 (socket says 172.21.15.78:50416) 2023-10-14T09:18:35.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2a77fe640 1 -- 172.21.15.78:0/2842012566 learned_addr learned my addr 172.21.15.78:0/2842012566 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:35.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2a6ffd640 1 --2- 172.21.15.78:0/2842012566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a8153e80 0x7ff2a806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:35.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2a77fe640 1 -- 172.21.15.78:0/2842012566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a8153e80 msgr2=0x7ff2a806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:35.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2a77fe640 1 --2- 172.21.15.78:0/2842012566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a8153e80 0x7ff2a806bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:35.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2a77fe640 1 -- 172.21.15.78:0/2842012566 >> v1:172.21.15.157:6789/0 conn(0x7ff2a80c6910 legacy=0x7ff2a80c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:35.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2a77fe640 1 -- 172.21.15.78:0/2842012566 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a806c750 con 0x7ff2a814ddb0 2023-10-14T09:18:35.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.283+0000 7ff2a6ffd640 1 --2- 172.21.15.78:0/2842012566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a8153e80 0x7ff2a806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:35.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2a77fe640 1 --2- 172.21.15.78:0/2842012566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a814ddb0 0x7ff2a80c7780 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff298009870 tx=0x7ff29801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e6f188ec5da4fe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2a67fc640 1 -- 172.21.15.78:0/2842012566 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980ab600 con 0x7ff2a814ddb0 2023-10-14T09:18:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2a67fc640 1 -- 172.21.15.78:0/2842012566 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2980a7050 con 0x7ff2a814ddb0 2023-10-14T09:18:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2a67fc640 1 -- 172.21.15.78:0/2842012566 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980ab980 con 0x7ff2a814ddb0 2023-10-14T09:18:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2ade09640 1 -- 172.21.15.78:0/2842012566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a814ddb0 msgr2=0x7ff2a80c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:35.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2ade09640 1 --2- 172.21.15.78:0/2842012566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a814ddb0 0x7ff2a80c7780 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff298009870 tx=0x7ff29801c3b0 comp rx=0 tx=0).stop 2023-10-14T09:18:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2ade09640 1 -- 172.21.15.78:0/2842012566 shutdown_connections 2023-10-14T09:18:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2ade09640 1 --2- 172.21.15.78:0/2842012566 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a8153e80 0x7ff2a806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2ade09640 1 --2- 172.21.15.78:0/2842012566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a814ddb0 0x7ff2a80c7780 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2ade09640 1 -- 172.21.15.78:0/2842012566 >> 172.21.15.78:0/2842012566 conn(0x7ff2a80ab1f0 msgr2=0x7ff2a80ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:35.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2ade09640 1 -- 172.21.15.78:0/2842012566 shutdown_connections 2023-10-14T09:18:35.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.287+0000 7ff2ade09640 1 -- 172.21.15.78:0/2842012566 wait complete. 2023-10-14T09:18:35.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2ade09640 1 Processor -- start 2023-10-14T09:18:35.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2ade09640 1 -- start start 2023-10-14T09:18:35.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2ade09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a80c6910 0x7ff2a8157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:35.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2ade09640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a814ddb0 0x7ff2a8155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:35.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2ade09640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a8153e80 0x7ff2a81ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:35.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2ade09640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80bd010 con 0x7ff2a80c6910 2023-10-14T09:18:35.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2ade09640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80bc800 con 0x7ff2a8153e80 2023-10-14T09:18:35.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2ade09640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a8145a70 con 0x7ff2a814ddb0 2023-10-14T09:18:35.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2a77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a80c6910 0x7ff2a8157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:35.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2a77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a80c6910 0x7ff2a8157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50428/0 (socket says 172.21.15.78:50428) 2023-10-14T09:18:35.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2a77fe640 1 -- 172.21.15.78:0/3323229375 learned_addr learned my addr 172.21.15.78:0/3323229375 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:35.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2a77fe640 1 -- 172.21.15.78:0/3323229375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a814ddb0 msgr2=0x7ff2a8155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:35.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2a77fe640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a814ddb0 0x7ff2a8155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:35.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2a77fe640 1 -- 172.21.15.78:0/3323229375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a8153e80 msgr2=0x7ff2a81ef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:35.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2a77fe640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a8153e80 0x7ff2a81ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2a77fe640 1 -- 172.21.15.78:0/3323229375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980094d0 con 0x7ff2a80c6910 2023-10-14T09:18:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2a77fe640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a80c6910 0x7ff2a8157df0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff29801aa60 tx=0x7ff298019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff28ffff640 1 -- 172.21.15.78:0/3323229375 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980b3890 con 0x7ff2a80c6910 2023-10-14T09:18:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff28ffff640 1 -- 172.21.15.78:0/3323229375 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2980b39f0 con 0x7ff2a80c6910 2023-10-14T09:18:35.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff28ffff640 1 -- 172.21.15.78:0/3323229375 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980b3d80 con 0x7ff2a80c6910 2023-10-14T09:18:35.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2ade09640 1 -- 172.21.15.78:0/3323229375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a81f0310 con 0x7ff2a80c6910 2023-10-14T09:18:35.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.291+0000 7ff2ade09640 1 -- 172.21.15.78:0/3323229375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a80bcd30 con 0x7ff2a80c6910 2023-10-14T09:18:35.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.295+0000 7ff2ade09640 1 -- 172.21.15.78:0/3323229375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a8074180 con 0x7ff2a80c6910 2023-10-14T09:18:35.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.295+0000 7ff28ffff640 1 -- 172.21.15.78:0/3323229375 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff2980b2070 con 0x7ff2a80c6910 2023-10-14T09:18:35.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.295+0000 7ff28ffff640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff2940664a0 0x7ff294068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:35.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.295+0000 7ff28ffff640 1 -- 172.21.15.78:0/3323229375 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7ff29811e240 con 0x7ff2a80c6910 2023-10-14T09:18:35.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.295+0000 7ff2a6ffd640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff2940664a0 0x7ff294068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:35.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.295+0000 7ff2a6ffd640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff2940664a0 0x7ff294068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80a94f0 tx=0x7ff29c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:35.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.299+0000 7ff28ffff640 1 -- 172.21.15.78:0/3323229375 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff2980eb690 con 0x7ff2a80c6910 2023-10-14T09:18:35.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.478+0000 7ff2ade09640 1 -- 172.21.15.78:0/3323229375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2a80c7560 con 0x7ff2a80c6910 2023-10-14T09:18:35.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.478+0000 7ff28ffff640 1 -- 172.21.15.78:0/3323229375 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7ff2980eecb0 con 0x7ff2a80c6910 2023-10-14T09:18:35.486 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:35.486 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:18:35.486 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:18:35.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 -- 172.21.15.78:0/3323229375 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff2940664a0 msgr2=0x7ff294068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:35.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff2940664a0 0x7ff294068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80a94f0 tx=0x7ff29c008040 comp rx=0 tx=0).stop 2023-10-14T09:18:35.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 -- 172.21.15.78:0/3323229375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a80c6910 msgr2=0x7ff2a8157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:35.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a80c6910 0x7ff2a8157df0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff29801aa60 tx=0x7ff298019150 comp rx=0 tx=0).stop 2023-10-14T09:18:35.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 -- 172.21.15.78:0/3323229375 shutdown_connections 2023-10-14T09:18:35.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff2a8153e80 0x7ff2a81ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:35.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff2940664a0 0x7ff294068960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:35.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff2a814ddb0 0x7ff2a8155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:35.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 --2- 172.21.15.78:0/3323229375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2a80c6910 0x7ff2a8157df0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:35.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 -- 172.21.15.78:0/3323229375 >> 172.21.15.78:0/3323229375 conn(0x7ff2a80ab1f0 msgr2=0x7ff2a814cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:35.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 -- 172.21.15.78:0/3323229375 shutdown_connections 2023-10-14T09:18:35.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:35.482+0000 7ff2ade09640 1 -- 172.21.15.78:0/3323229375 wait complete. 2023-10-14T09:18:35.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T09:18:16.002036+0000', 'modified': '2023-10-14T09:18:19.017889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5109}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5109': {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T09:18:35.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T09:18:35.911 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T09:18:36.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12f65d9640 1 Processor -- start 2023-10-14T09:18:36.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12f65d9640 1 -- start start 2023-10-14T09:18:36.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12f65d9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12f014e0f0 0x7f12f0152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12f65d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12f014ed10 0x7f12f014f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12f65d9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f01531d0 con 0x7f12f014f700 2023-10-14T09:18:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12f65d9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f0153e50 con 0x7f12f014e0f0 2023-10-14T09:18:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12f65d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f01534b0 con 0x7f12f014ed10 2023-10-14T09:18:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12effff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12f014e0f0 0x7f12f0152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12f4b76640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f12f014f700 0x7f12f0150a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53770/0 (socket says 172.21.15.78:53770) 2023-10-14T09:18:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12f4b76640 1 -- 172.21.15.78:0/96568647 learned_addr learned my addr 172.21.15.78:0/96568647 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/96568647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12f014ed10 0x7f12f014f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12effff640 1 -- 172.21.15.78:0/96568647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12f014ed10 msgr2=0x7f12f014f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12effff640 1 --2- 172.21.15.78:0/96568647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12f014ed10 0x7f12f014f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12effff640 1 -- 172.21.15.78:0/96568647 >> v1:172.21.15.78:6789/0 conn(0x7f12f014f700 legacy=0x7f12f0150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12effff640 1 -- 172.21.15.78:0/96568647 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f0153790 con 0x7f12f014e0f0 2023-10-14T09:18:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.046+0000 7f12eeffd640 1 -- 172.21.15.78:0/96568647 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875162372 0 0) 0x7f12f01531d0 con 0x7f12f014f700 2023-10-14T09:18:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12effff640 1 --2- 172.21.15.78:0/96568647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f014e0f0 0x7f12f0152960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f12e00097c0 tx=0x7f12e001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dec9283158478f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12eeffd640 1 -- 172.21.15.78:0/96568647 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00ab600 con 0x7f12f014e0f0 2023-10-14T09:18:36.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12eeffd640 1 -- 172.21.15.78:0/96568647 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e00a7050 con 0x7f12f014e0f0 2023-10-14T09:18:36.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12eeffd640 1 -- 172.21.15.78:0/96568647 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00ab980 con 0x7f12f014e0f0 2023-10-14T09:18:36.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12f65d9640 1 -- 172.21.15.78:0/96568647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f014e0f0 msgr2=0x7f12f0152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:36.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12f65d9640 1 --2- 172.21.15.78:0/96568647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f014e0f0 0x7f12f0152960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f12e00097c0 tx=0x7f12e001c3f0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12f65d9640 1 -- 172.21.15.78:0/96568647 shutdown_connections 2023-10-14T09:18:36.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12f65d9640 1 --2- 172.21.15.78:0/96568647 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12f014ed10 0x7f12f014f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12f65d9640 1 --2- 172.21.15.78:0/96568647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f014e0f0 0x7f12f0152960 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12f65d9640 1 -- 172.21.15.78:0/96568647 >> 172.21.15.78:0/96568647 conn(0x7f12f00c1cc0 msgr2=0x7f12f00c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:36.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12f65d9640 1 -- 172.21.15.78:0/96568647 shutdown_connections 2023-10-14T09:18:36.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.050+0000 7f12f65d9640 1 -- 172.21.15.78:0/96568647 wait complete. 2023-10-14T09:18:36.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f65d9640 1 Processor -- start 2023-10-14T09:18:36.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f65d9640 1 -- start start 2023-10-14T09:18:36.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f65d9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12f014e0f0 0x7f12f014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f65d9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12f014ed10 0x7f12f0140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f65d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f014f700 0x7f12f0140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f65d9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f015cd90 con 0x7f12f014f700 2023-10-14T09:18:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f65d9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f01434c0 con 0x7f12f014ed10 2023-10-14T09:18:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f65d9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f015c3f0 con 0x7f12f014e0f0 2023-10-14T09:18:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f4b76640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f014f700 0x7f12f0140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f4b76640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f014f700 0x7f12f0140ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50446/0 (socket says 172.21.15.78:50446) 2023-10-14T09:18:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f4b76640 1 -- 172.21.15.78:0/2051165990 learned_addr learned my addr 172.21.15.78:0/2051165990 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12effff640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12f014e0f0 0x7f12f014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12f014ed10 0x7f12f0140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f4b76640 1 -- 172.21.15.78:0/2051165990 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12f014e0f0 msgr2=0x7f12f014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f4b76640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12f014e0f0 0x7f12f014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f4b76640 1 -- 172.21.15.78:0/2051165990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12f014ed10 msgr2=0x7f12f0140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f4b76640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12f014ed10 0x7f12f0140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f4b76640 1 -- 172.21.15.78:0/2051165990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e0009420 con 0x7f12f014f700 2023-10-14T09:18:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f4b76640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f014f700 0x7f12f0140ed0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c780 tx=0x7f12e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12ecff9640 1 -- 172.21.15.78:0/2051165990 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e800ce90 con 0x7f12f014f700 2023-10-14T09:18:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12ecff9640 1 -- 172.21.15.78:0/2051165990 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e800a640 con 0x7f12f014f700 2023-10-14T09:18:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12ecff9640 1 -- 172.21.15.78:0/2051165990 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e800a9d0 con 0x7f12f014f700 2023-10-14T09:18:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f65d9640 1 -- 172.21.15.78:0/2051165990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f015c6d0 con 0x7f12f014f700 2023-10-14T09:18:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.054+0000 7f12f65d9640 1 -- 172.21.15.78:0/2051165990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f0141410 con 0x7f12f014f700 2023-10-14T09:18:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12ecff9640 1 -- 172.21.15.78:0/2051165990 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f12e800ab30 con 0x7f12f014f700 2023-10-14T09:18:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12ecff9640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f12dc0664a0 0x7f12dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12ecff9640 1 -- 172.21.15.78:0/2051165990 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f12e8083340 con 0x7f12f014f700 2023-10-14T09:18:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12effff640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f12dc0664a0 0x7f12dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12f9965000 1 Processor -- start 2023-10-14T09:18:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12f9965000 1 -- start start 2023-10-14T09:18:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12effff640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f12dc0664a0 0x7f12dc068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f12e00ad000 tx=0x7f12e0004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12f9965000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a0bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12f9965000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a0c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12f9965000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a0d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12f9965000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c6803cc0 con 0x55e4c6a0c530 2023-10-14T09:18:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12f9965000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c6866920 con 0x55e4c6a49d70 2023-10-14T09:18:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.058+0000 7f12f9965000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4c6863e50 con 0x55e4c6a0ce50 2023-10-14T09:18:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12ef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a0c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12ef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a0c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50460/0 (socket says 172.21.15.78:50460) 2023-10-14T09:18:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12ef7fe640 1 -- 172.21.15.78:0/4134430164 learned_addr learned my addr 172.21.15.78:0/4134430164 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12effff640 1 --2- 172.21.15.78:0/4134430164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a0bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f4b76640 1 --2- 172.21.15.78:0/4134430164 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a0d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12ef7fe640 1 -- 172.21.15.78:0/4134430164 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 msgr2=0x55e4c6a0d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/4134430164 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a0d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12ef7fe640 1 -- 172.21.15.78:0/4134430164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 msgr2=0x55e4c6a0bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/4134430164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a0bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12ef7fe640 1 -- 172.21.15.78:0/4134430164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4c6558890 con 0x55e4c6a0c530 2023-10-14T09:18:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/4134430164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a0c910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009b40 tx=0x7f12e4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b2f2328bad99e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12d67fc640 1 -- 172.21.15.78:0/4134430164 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4011c20 con 0x55e4c6a0c530 2023-10-14T09:18:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12d67fc640 1 -- 172.21.15.78:0/4134430164 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e4011d80 con 0x55e4c6a0c530 2023-10-14T09:18:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12d67fc640 1 -- 172.21.15.78:0/4134430164 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4015660 con 0x55e4c6a0c530 2023-10-14T09:18:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 -- 172.21.15.78:0/4134430164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 msgr2=0x55e4c6a0c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 --2- 172.21.15.78:0/4134430164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a0c910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009b40 tx=0x7f12e4009190 comp rx=0 tx=0).stop 2023-10-14T09:18:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 -- 172.21.15.78:0/4134430164 shutdown_connections 2023-10-14T09:18:36.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 --2- 172.21.15.78:0/4134430164 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a0d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 --2- 172.21.15.78:0/4134430164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a0c910 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 --2- 172.21.15.78:0/4134430164 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a0bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 -- 172.21.15.78:0/4134430164 >> 172.21.15.78:0/4134430164 conn(0x55e4c6a14c90 msgr2=0x55e4c6a4c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:36.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 -- 172.21.15.78:0/4134430164 shutdown_connections 2023-10-14T09:18:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 -- 172.21.15.78:0/4134430164 wait complete. 2023-10-14T09:18:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 -- start start 2023-10-14T09:18:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 Processor -- start 2023-10-14T09:18:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a48980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a48ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a0fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c685f740 con 0x55e4c6a0c530 2023-10-14T09:18:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c681ed10 con 0x55e4c6a49d70 2023-10-14T09:18:36.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4c681e9b0 con 0x55e4c6a0ce50 2023-10-14T09:18:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f9965000 10 client.0 _ll_register_callbacks cb 0x55e4c69fa390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a48980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a48980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50468/0 (socket says 172.21.15.78:50468) 2023-10-14T09:18:36.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12effff640 1 -- 172.21.15.78:0/1778125551 learned_addr learned my addr 172.21.15.78:0/1778125551 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a48ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.062+0000 7f12f4b76640 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a0fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12effff640 1 -- 172.21.15.78:0/1778125551 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 msgr2=0x55e4c6a48ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12effff640 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a48ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12effff640 1 -- 172.21.15.78:0/1778125551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 msgr2=0x55e4c6a0fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:36.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12effff640 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a0fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12effff640 1 -- 172.21.15.78:0/1778125551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e4009770 con 0x55e4c6a0c530 2023-10-14T09:18:36.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12effff640 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a48980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f12e00097c0 tx=0x7f12e0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd9d90d7b0d0373 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:36.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:36.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ceffd640 1 -- 172.21.15.78:0/1778125551 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00b6950 con 0x55e4c6a0c530 2023-10-14T09:18:36.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ceffd640 1 -- 172.21.15.78:0/1778125551 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f12e00b6ab0 con 0x55e4c6a0c530 2023-10-14T09:18:36.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 -- 172.21.15.78:0/1778125551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4c6813370 con 0x55e4c6a0c530 2023-10-14T09:18:36.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ceffd640 1 -- 172.21.15.78:0/1778125551 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12e00b6c70 con 0x55e4c6a0c530 2023-10-14T09:18:36.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 10 client.5376 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:36.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 -- 172.21.15.78:0/1778125551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e4c6821460 con 0x55e4c6a0c530 2023-10-14T09:18:36.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ceffd640 1 -- 172.21.15.78:0/1778125551 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e4c6813370 con 0x55e4c6a0c530 2023-10-14T09:18:36.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ceffd640 1 -- 172.21.15.78:0/1778125551 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f12e00c3440 con 0x55e4c6a0c530 2023-10-14T09:18:36.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 10 client.5376 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:36.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 10 client.5376 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:36.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 20 client.5376 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:36.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55e4c6a107d0 0x55e4c6a10bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 4 client.5376 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:18:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 -- 172.21.15.78:0/1778125551 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4c67f92d0 con 0x55e4c6a107d0 2023-10-14T09:18:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55e4c6a107d0 0x55e4c6a10bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ceffd640 10 client.5376 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55e4c6a107d0 0x55e4c6a10bb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=261c79259639dfbb server_cookie=cd7ca6822f408e3 in_seq=0 out_seq=0 2023-10-14T09:18:36.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ceffd640 1 -- 172.21.15.78:0/1778125551 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e4c67f92d0 con 0x55e4c6a107d0 2023-10-14T09:18:36.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ceffd640 10 client.5376 handle_command_reply: tid=0 2023-10-14T09:18:36.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 client.5376 shutdown 2023-10-14T09:18:36.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 -- 172.21.15.78:0/1778125551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 msgr2=0x55e4c6a48980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a48980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f12e00097c0 tx=0x7f12e0019190 comp rx=0 tx=0).stop 2023-10-14T09:18:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 -- 172.21.15.78:0/1778125551 shutdown_connections 2023-10-14T09:18:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55e4c6a107d0 0x55e4c6a10bb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a0fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a48ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 --2- 172.21.15.78:0/1778125551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a48980 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 -- 172.21.15.78:0/1778125551 >> 172.21.15.78:0/1778125551 conn(0x55e4c6a14c90 msgr2=0x55e4c6a0b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12ceffd640 0 client.5376 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 -- 172.21.15.78:0/1778125551 shutdown_connections 2023-10-14T09:18:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 1 -- 172.21.15.78:0/1778125551 wait complete. 2023-10-14T09:18:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.066+0000 7f12f9965000 20 client.5376 trim_cache size 0 max 16384 2023-10-14T09:18:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.082+0000 7f12f9965000 1 Processor -- start 2023-10-14T09:18:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.082+0000 7f12f9965000 1 -- start start 2023-10-14T09:18:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0c530 0x55e4c6a12bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a0ce50 0x55e4c6a13100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a49d70 0x55e4c6a13640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c6519940 con 0x55e4c6a49d70 2023-10-14T09:18:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c65591b0 con 0x55e4c6a0ce50 2023-10-14T09:18:36.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4c680d6c0 con 0x55e4c6a0c530 2023-10-14T09:18:36.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f4b76640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a49d70 0x55e4c6a13640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f4b76640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a49d70 0x55e4c6a13640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50474/0 (socket says 172.21.15.78:50474) 2023-10-14T09:18:36.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f4b76640 1 -- 172.21.15.78:0/2910624915 learned_addr learned my addr 172.21.15.78:0/2910624915 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:36.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12effff640 1 --2- 172.21.15.78:0/2910624915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0c530 0x55e4c6a12bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/2910624915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a0ce50 0x55e4c6a13100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f4b76640 1 -- 172.21.15.78:0/2910624915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0c530 msgr2=0x55e4c6a12bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:36.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f4b76640 1 --2- 172.21.15.78:0/2910624915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0c530 0x55e4c6a12bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f4b76640 1 -- 172.21.15.78:0/2910624915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a0ce50 msgr2=0x55e4c6a13100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:36.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f4b76640 1 --2- 172.21.15.78:0/2910624915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a0ce50 0x55e4c6a13100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f4b76640 1 -- 172.21.15.78:0/2910624915 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4c6807760 con 0x55e4c6a49d70 2023-10-14T09:18:36.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12effff640 1 --2- 172.21.15.78:0/2910624915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0c530 0x55e4c6a12bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:36.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/2910624915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a0ce50 0x55e4c6a13100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:36.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f4b76640 1 --2- 172.21.15.78:0/2910624915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a49d70 0x55e4c6a13640 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f12e805c2c0 tx=0x7f12e8058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3ba28d596f3837 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:36.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12d6ffd640 1 -- 172.21.15.78:0/2910624915 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8052630 con 0x55e4c6a49d70 2023-10-14T09:18:36.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12d6ffd640 1 -- 172.21.15.78:0/2910624915 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8052890 con 0x55e4c6a49d70 2023-10-14T09:18:36.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12d6ffd640 1 -- 172.21.15.78:0/2910624915 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8050c00 con 0x55e4c6a49d70 2023-10-14T09:18:36.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 -- 172.21.15.78:0/2910624915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a49d70 msgr2=0x55e4c6a13640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:36.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 --2- 172.21.15.78:0/2910624915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a49d70 0x55e4c6a13640 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f12e805c2c0 tx=0x7f12e8058040 comp rx=0 tx=0).stop 2023-10-14T09:18:36.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 -- 172.21.15.78:0/2910624915 shutdown_connections 2023-10-14T09:18:36.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 --2- 172.21.15.78:0/2910624915 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a49d70 0x55e4c6a13640 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 --2- 172.21.15.78:0/2910624915 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a0ce50 0x55e4c6a13100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 --2- 172.21.15.78:0/2910624915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0c530 0x55e4c6a12bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 -- 172.21.15.78:0/2910624915 >> 172.21.15.78:0/2910624915 conn(0x55e4c6a14c90 msgr2=0x55e4c6a0a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 -- 172.21.15.78:0/2910624915 shutdown_connections 2023-10-14T09:18:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 -- 172.21.15.78:0/2910624915 wait complete. 2023-10-14T09:18:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 -- start start 2023-10-14T09:18:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.086+0000 7f12f9965000 1 Processor -- start 2023-10-14T09:18:36.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a63940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a643f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a73ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c685b0b0 con 0x55e4c6a0c530 2023-10-14T09:18:36.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4c6835a10 con 0x55e4c6a49d70 2023-10-14T09:18:36.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4c6863740 con 0x55e4c6a0ce50 2023-10-14T09:18:36.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 10 client.0 _ll_register_callbacks cb 0x7f12e4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:36.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a63940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a63940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50476/0 (socket says 172.21.15.78:50476) 2023-10-14T09:18:36.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12effff640 1 -- 172.21.15.78:0/855190149 learned_addr learned my addr 172.21.15.78:0/855190149 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:36.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f4b76640 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a73ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12effff640 1 -- 172.21.15.78:0/855190149 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 msgr2=0x55e4c6a643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12effff640 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12effff640 1 -- 172.21.15.78:0/855190149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 msgr2=0x55e4c6a73ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:36.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12effff640 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a73ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12effff640 1 -- 172.21.15.78:0/855190149 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f0141410 con 0x55e4c6a0c530 2023-10-14T09:18:36.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f4b76640 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a73ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:36.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12effff640 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a63940 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c10 tx=0x7f12e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e948287fdb98f66d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ceffd640 1 -- 172.21.15.78:0/855190149 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00c3a20 con 0x55e4c6a0c530 2023-10-14T09:18:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ceffd640 1 -- 172.21.15.78:0/855190149 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f12e00c3440 con 0x55e4c6a0c530 2023-10-14T09:18:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 -- 172.21.15.78:0/855190149 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4c67f76f0 con 0x55e4c6a0c530 2023-10-14T09:18:36.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ceffd640 1 -- 172.21.15.78:0/855190149 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12e00b6ce0 con 0x55e4c6a0c530 2023-10-14T09:18:36.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 10 client.5382 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:36.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 -- 172.21.15.78:0/855190149 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e4c6558cc0 con 0x55e4c6a0c530 2023-10-14T09:18:36.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ceffd640 1 -- 172.21.15.78:0/855190149 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e4c67f76f0 con 0x55e4c6a0c530 2023-10-14T09:18:36.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ceffd640 1 -- 172.21.15.78:0/855190149 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f12e00d43f0 con 0x55e4c6a0c530 2023-10-14T09:18:36.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 10 client.5382 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:36.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 10 client.5382 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:36.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 20 client.5382 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:36.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55e4c6a741e0 0x55e4c6a745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:36.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 4 client.5382 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T09:18:36.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 -- 172.21.15.78:0/855190149 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e4c6858720 con 0x55e4c6a741e0 2023-10-14T09:18:36.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55e4c6a741e0 0x55e4c6a745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:36.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ceffd640 10 client.5382 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:36.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ef7fe640 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55e4c6a741e0 0x55e4c6a745c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=834aebc84a51d207 server_cookie=e1d9d1d3bf59183 in_seq=0 out_seq=0 2023-10-14T09:18:36.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ceffd640 1 -- 172.21.15.78:0/855190149 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x55e4c6858720 con 0x55e4c6a741e0 2023-10-14T09:18:36.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ceffd640 10 client.5382 handle_command_reply: tid=0 2023-10-14T09:18:36.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 client.5382 shutdown 2023-10-14T09:18:36.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 -- 172.21.15.78:0/855190149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 msgr2=0x55e4c6a63940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:36.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a63940 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f12e0000c10 tx=0x7f12e0008040 comp rx=0 tx=0).stop 2023-10-14T09:18:36.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 -- 172.21.15.78:0/855190149 shutdown_connections 2023-10-14T09:18:36.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55e4c6a741e0 0x55e4c6a745c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55e4c6a49d70 0x55e4c6a73ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55e4c6a0ce50 0x55e4c6a643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12ceffd640 0 client.5382 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:36.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 --2- 172.21.15.78:0/855190149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e4c6a0c530 0x55e4c6a63940 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 -- 172.21.15.78:0/855190149 >> 172.21.15.78:0/855190149 conn(0x55e4c6a14c90 msgr2=0x55e4c6a13660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:36.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 -- 172.21.15.78:0/855190149 shutdown_connections 2023-10-14T09:18:36.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 1 -- 172.21.15.78:0/855190149 wait complete. 2023-10-14T09:18:36.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.090+0000 7f12f9965000 20 client.5382 trim_cache size 0 max 16384 2023-10-14T09:18:36.120 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:18:36.121 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "1f80be0e-0937-433c-91b2-bf32e5285783", 2023-10-14T09:18:36.121 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-10-14T09:18:36.121 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5109, 2023-10-14T09:18:36.122 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-10-14T09:18:36.122 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-10-14T09:18:36.122 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "testcephfs1", 2023-10-14T09:18:36.122 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 19.465905513999999, 2023-10-14T09:18:36.123 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 17, 2023-10-14T09:18:36.123 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 32, 2023-10-14T09:18:36.123 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 32, 2023-10-14T09:18:36.123 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 27.329357547000001 2023-10-14T09:18:36.124 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:18:36.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 -- 172.21.15.78:0/2051165990 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f12dc0664a0 msgr2=0x7f12dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:36.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f12dc0664a0 0x7f12dc068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f12e00ad000 tx=0x7f12e0004740 comp rx=0 tx=0).stop 2023-10-14T09:18:36.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 -- 172.21.15.78:0/2051165990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f014f700 msgr2=0x7f12f0140ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:36.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f014f700 0x7f12f0140ed0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f12e800c780 tx=0x7f12e800cc40 comp rx=0 tx=0).stop 2023-10-14T09:18:36.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 -- 172.21.15.78:0/2051165990 shutdown_connections 2023-10-14T09:18:36.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12f014f700 0x7f12f0140ed0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12f014ed10 0x7f12f0140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f12dc0664a0 0x7f12dc068960 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 --2- 172.21.15.78:0/2051165990 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f12f014e0f0 0x7f12f014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:36.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 -- 172.21.15.78:0/2051165990 >> 172.21.15.78:0/2051165990 conn(0x7f12f00c1cc0 msgr2=0x7f12f015a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:36.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 -- 172.21.15.78:0/2051165990 shutdown_connections 2023-10-14T09:18:36.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:36.094+0000 7f12f65d9640 1 -- 172.21.15.78:0/2051165990 wait complete. 2023-10-14T09:18:36.128 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T09:18:16.002036+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5109": { "addr": "172.21.15.78:6837/4241140805", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6836", "nonce": 4241140805, "type": "v2" }, { "addr": "172.21.15.78:6837", "nonce": 4241140805, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5109, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T09:18:19.017889+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5109 } } } ], "standbys": [ { "addr": "172.21.15.157:6833/2822193022", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6832", "nonce": 2822193022, "type": "v2" }, { "addr": "172.21.15.157:6833", "nonce": 2822193022, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5002, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.157:6835/488302185", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6834", "nonce": 488302185, "type": "v2" }, { "addr": "172.21.15.157:6835", "nonce": 488302185, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5005, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.78:6835/3378161275", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6834", "nonce": 3378161275, "type": "v2" }, { "addr": "172.21.15.78:6835", "nonce": 3378161275, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5106, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T09:18:36.129 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': 2, 'name': 'b', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T09:18:36.130 INFO:tasks.cephfs.test_failover:current = [{'gid': 5106, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.78:6835/3378161275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3378161275}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3378161275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 5002, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6833/2822193022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6832', 'nonce': 2822193022}, {'type': 'v1', 'addr': '172.21.15.157:6833', 'nonce': 2822193022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 5005, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6835/488302185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 488302185}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 488302185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T09:18:36.130 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T09:18:36.131 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T09:18:41.132 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b2850f640 1 Processor -- start 2023-10-14T09:18:41.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b2850f640 1 -- start start 2023-10-14T09:18:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b2850f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b20153e80 0x7f9b200c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b2850f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b200c6910 0x7f9b200c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:41.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b2850f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2006c470 con 0x7f9b2014ddb0 2023-10-14T09:18:41.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b2850f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b200c64f0 con 0x7f9b20153e80 2023-10-14T09:18:41.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b2850f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b200c5300 con 0x7f9b200c6910 2023-10-14T09:18:41.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b25aaa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b20153e80 0x7f9b200c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:41.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b25aaa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b20153e80 0x7f9b200c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41698/0 (socket says 172.21.15.78:41698) 2023-10-14T09:18:41.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b25aaa640 1 -- 172.21.15.78:0/476766346 learned_addr learned my addr 172.21.15.78:0/476766346 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:41.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b26aac640 1 --2- 172.21.15.78:0/476766346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b200c6910 0x7f9b200c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:41.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b25aaa640 1 -- 172.21.15.78:0/476766346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b200c6910 msgr2=0x7f9b200c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:41.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b25aaa640 1 --2- 172.21.15.78:0/476766346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b200c6910 0x7f9b200c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:41.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b25aaa640 1 -- 172.21.15.78:0/476766346 >> v1:172.21.15.157:6789/0 conn(0x7f9b2014ddb0 legacy=0x7f9b2006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:41.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.274+0000 7f9b25aaa640 1 -- 172.21.15.78:0/476766346 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2006c750 con 0x7f9b20153e80 2023-10-14T09:18:41.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b25aaa640 1 --2- 172.21.15.78:0/476766346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b20153e80 0x7f9b200c7780 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9b10009870 tx=0x7f9b1001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb058a61c56da7e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:41.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b252a9640 1 -- 172.21.15.78:0/476766346 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b100ac640 con 0x7f9b20153e80 2023-10-14T09:18:41.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b252a9640 1 -- 172.21.15.78:0/476766346 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b100ac7a0 con 0x7f9b20153e80 2023-10-14T09:18:41.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b252a9640 1 -- 172.21.15.78:0/476766346 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b100acb30 con 0x7f9b20153e80 2023-10-14T09:18:41.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b2850f640 1 -- 172.21.15.78:0/476766346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b20153e80 msgr2=0x7f9b200c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:41.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b2850f640 1 --2- 172.21.15.78:0/476766346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b20153e80 0x7f9b200c7780 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9b10009870 tx=0x7f9b1001c420 comp rx=0 tx=0).stop 2023-10-14T09:18:41.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b2850f640 1 -- 172.21.15.78:0/476766346 shutdown_connections 2023-10-14T09:18:41.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b2850f640 1 --2- 172.21.15.78:0/476766346 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b200c6910 0x7f9b200c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:41.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b2850f640 1 --2- 172.21.15.78:0/476766346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b20153e80 0x7f9b200c7780 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:41.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b2850f640 1 -- 172.21.15.78:0/476766346 >> 172.21.15.78:0/476766346 conn(0x7f9b200ab1f0 msgr2=0x7f9b200ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:41.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b2850f640 1 -- 172.21.15.78:0/476766346 shutdown_connections 2023-10-14T09:18:41.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.278+0000 7f9b2850f640 1 -- 172.21.15.78:0/476766346 wait complete. 2023-10-14T09:18:41.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b2850f640 1 Processor -- start 2023-10-14T09:18:41.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b2850f640 1 -- start start 2023-10-14T09:18:41.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b2850f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b200c6910 0x7f9b201523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:41.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b2850f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b2014ddb0 0x7f9b20152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:41.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b2850f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b20153e80 0x7f9b201efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:41.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b2850f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b201ece40 con 0x7f9b2014ddb0 2023-10-14T09:18:41.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b2850f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b201ed050 con 0x7f9b20153e80 2023-10-14T09:18:41.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b2850f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b200c3110 con 0x7f9b200c6910 2023-10-14T09:18:41.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b25aaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b2014ddb0 0x7f9b20152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:41.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b25aaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b2014ddb0 0x7f9b20152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41710/0 (socket says 172.21.15.78:41710) 2023-10-14T09:18:41.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b25aaa640 1 -- 172.21.15.78:0/4230259421 learned_addr learned my addr 172.21.15.78:0/4230259421 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:41.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b262ab640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b200c6910 0x7f9b201523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:41.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b26aac640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b20153e80 0x7f9b201efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:41.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b25aaa640 1 -- 172.21.15.78:0/4230259421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b200c6910 msgr2=0x7f9b201523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:41.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b25aaa640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b200c6910 0x7f9b201523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:41.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b25aaa640 1 -- 172.21.15.78:0/4230259421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b20153e80 msgr2=0x7f9b201efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:41.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b25aaa640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b20153e80 0x7f9b201efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:41.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b25aaa640 1 -- 172.21.15.78:0/4230259421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b100094d0 con 0x7f9b2014ddb0 2023-10-14T09:18:41.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b26aac640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b20153e80 0x7f9b201efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:41.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b25aaa640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b2014ddb0 0x7f9b20152920 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9b100af040 tx=0x7f9b100191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:41.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b16ffd640 1 -- 172.21.15.78:0/4230259421 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b100b9070 con 0x7f9b2014ddb0 2023-10-14T09:18:41.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b16ffd640 1 -- 172.21.15.78:0/4230259421 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b100b5440 con 0x7f9b2014ddb0 2023-10-14T09:18:41.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b16ffd640 1 -- 172.21.15.78:0/4230259421 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b100b57f0 con 0x7f9b2014ddb0 2023-10-14T09:18:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b2850f640 1 -- 172.21.15.78:0/4230259421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b200c33f0 con 0x7f9b2014ddb0 2023-10-14T09:18:41.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.282+0000 7f9b2850f640 1 -- 172.21.15.78:0/4230259421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2014bac0 con 0x7f9b2014ddb0 2023-10-14T09:18:41.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.286+0000 7f9b2850f640 1 -- 172.21.15.78:0/4230259421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b200c3580 con 0x7f9b2014ddb0 2023-10-14T09:18:41.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.286+0000 7f9b16ffd640 1 -- 172.21.15.78:0/4230259421 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9b100b3070 con 0x7f9b2014ddb0 2023-10-14T09:18:41.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.286+0000 7f9b16ffd640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b040664a0 0x7f9b04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:41.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.286+0000 7f9b16ffd640 1 -- 172.21.15.78:0/4230259421 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f9b1011d680 con 0x7f9b2014ddb0 2023-10-14T09:18:41.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.286+0000 7f9b262ab640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b040664a0 0x7f9b04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:41.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.286+0000 7f9b262ab640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b040664a0 0x7f9b04068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c007fd0 tx=0x7f9b1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:41.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.290+0000 7f9b16ffd640 1 -- 172.21.15.78:0/4230259421 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b100eaad0 con 0x7f9b2014ddb0 2023-10-14T09:18:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.470+0000 7f9b2850f640 1 -- 172.21.15.78:0/4230259421 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b20074180 con 0x7f9b2014ddb0 2023-10-14T09:18:41.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.470+0000 7f9b16ffd640 1 -- 172.21.15.78:0/4230259421 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f9b100ee0f0 con 0x7f9b2014ddb0 2023-10-14T09:18:41.478 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:41.479 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:18:41.480 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:18:41.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 -- 172.21.15.78:0/4230259421 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b040664a0 msgr2=0x7f9b04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:41.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b040664a0 0x7f9b04068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c007fd0 tx=0x7f9b1c009040 comp rx=0 tx=0).stop 2023-10-14T09:18:41.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 -- 172.21.15.78:0/4230259421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b2014ddb0 msgr2=0x7f9b20152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:41.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b2014ddb0 0x7f9b20152920 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9b100af040 tx=0x7f9b100191c0 comp rx=0 tx=0).stop 2023-10-14T09:18:41.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 -- 172.21.15.78:0/4230259421 shutdown_connections 2023-10-14T09:18:41.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b20153e80 0x7f9b201efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:41.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b2014ddb0 0x7f9b20152920 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:41.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b040664a0 0x7f9b04068960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:41.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 --2- 172.21.15.78:0/4230259421 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b200c6910 0x7f9b201523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:41.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 -- 172.21.15.78:0/4230259421 >> 172.21.15.78:0/4230259421 conn(0x7f9b200ab1f0 msgr2=0x7f9b200a9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:41.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 -- 172.21.15.78:0/4230259421 shutdown_connections 2023-10-14T09:18:41.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:41.474+0000 7f9b2850f640 1 -- 172.21.15.78:0/4230259421 wait complete. 2023-10-14T09:18:41.901 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T09:18:16.002036+0000', 'modified': '2023-10-14T09:18:19.017889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5109}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5109': {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T09:18:41.902 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T09:18:41.903 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T09:18:42.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.034+0000 7f7649c17640 1 Processor -- start 2023-10-14T09:18:42.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.034+0000 7f7649c17640 1 -- start start 2023-10-14T09:18:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.034+0000 7f7649c17640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f764413b050 0x7f7644155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.034+0000 7f7649c17640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7644152a60 con 0x7f76440a8360 2023-10-14T09:18:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f7649c17640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7644155fb0 con 0x7f76440a87c0 2023-10-14T09:18:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f7649c17640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76440a9340 con 0x7f764413b050 2023-10-14T09:18:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f763bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f76440a8360 0x7f764406cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:60058/0 (socket says 172.21.15.78:60058) 2023-10-14T09:18:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f763bfff640 1 -- 172.21.15.78:0/2964711834 learned_addr learned my addr 172.21.15.78:0/2964711834 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f76437fe640 1 --2- 172.21.15.78:0/2964711834 >> v2:172.21.15.157:3300/0 conn(0x7f764413b050 0x7f7644155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f7642ffd640 1 -- 172.21.15.78:0/2964711834 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011869702 0 0) 0x7f7644152a60 con 0x7f76440a8360 2023-10-14T09:18:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f7642ffd640 1 -- 172.21.15.78:0/2964711834 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7630003530 con 0x7f76440a8360 2023-10-14T09:18:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f7642ffd640 1 -- 172.21.15.78:0/2964711834 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397545007 0 0) 0x7f7644155fb0 con 0x7f76440a87c0 2023-10-14T09:18:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f7642ffd640 1 -- 172.21.15.78:0/2964711834 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7644152a60 con 0x7f76440a87c0 2023-10-14T09:18:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f76437fe640 1 -- 172.21.15.78:0/2964711834 >> v1:172.21.15.157:6789/0 conn(0x7f76440a87c0 legacy=0x7f764406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f76437fe640 1 -- 172.21.15.78:0/2964711834 >> v1:172.21.15.78:6789/0 conn(0x7f76440a8360 legacy=0x7f764406cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f76437fe640 1 -- 172.21.15.78:0/2964711834 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644151e50 con 0x7f764413b050 2023-10-14T09:18:42.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.038+0000 7f76437fe640 1 --2- 172.21.15.78:0/2964711834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f764413b050 0x7f7644155a70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f76340097c0 tx=0x7f763401c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb5e2d713ab5e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:42.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7642ffd640 1 -- 172.21.15.78:0/2964711834 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76340ab600 con 0x7f764413b050 2023-10-14T09:18:42.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7642ffd640 1 -- 172.21.15.78:0/2964711834 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76340a7050 con 0x7f764413b050 2023-10-14T09:18:42.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7642ffd640 1 -- 172.21.15.78:0/2964711834 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76340ab980 con 0x7f764413b050 2023-10-14T09:18:42.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 -- 172.21.15.78:0/2964711834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f764413b050 msgr2=0x7f7644155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:42.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 --2- 172.21.15.78:0/2964711834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f764413b050 0x7f7644155a70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f76340097c0 tx=0x7f763401c360 comp rx=0 tx=0).stop 2023-10-14T09:18:42.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 -- 172.21.15.78:0/2964711834 shutdown_connections 2023-10-14T09:18:42.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 --2- 172.21.15.78:0/2964711834 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f764413b050 0x7f7644155a70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 -- 172.21.15.78:0/2964711834 >> 172.21.15.78:0/2964711834 conn(0x7f76440c1cc0 msgr2=0x7f76440c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:42.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 -- 172.21.15.78:0/2964711834 shutdown_connections 2023-10-14T09:18:42.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 -- 172.21.15.78:0/2964711834 wait complete. 2023-10-14T09:18:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 Processor -- start 2023-10-14T09:18:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 -- start start 2023-10-14T09:18:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76440a8360 0x7f76441ec1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76440a87c0 0x7f7644132650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f764413b050 0x7f7644138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764414a970 con 0x7f76440a87c0 2023-10-14T09:18:42.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7644155f50 con 0x7f76440a8360 2023-10-14T09:18:42.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7649c17640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76441f03d0 con 0x7f764413b050 2023-10-14T09:18:42.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f763bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76440a87c0 0x7f7644132650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f763bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76440a87c0 0x7f7644132650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41724/0 (socket says 172.21.15.78:41724) 2023-10-14T09:18:42.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f763bfff640 1 -- 172.21.15.78:0/2123742450 learned_addr learned my addr 172.21.15.78:0/2123742450 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:42.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f76437fe640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76440a8360 0x7f76441ec1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.042+0000 7f7643fff640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f764413b050 0x7f7644138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f763bfff640 1 -- 172.21.15.78:0/2123742450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f764413b050 msgr2=0x7f7644138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:42.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f763bfff640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f764413b050 0x7f7644138b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f763bfff640 1 -- 172.21.15.78:0/2123742450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76440a8360 msgr2=0x7f76441ec1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:42.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f763bfff640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76440a8360 0x7f76441ec1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f763bfff640 1 -- 172.21.15.78:0/2123742450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7634009420 con 0x7f76440a87c0 2023-10-14T09:18:42.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f763bfff640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76440a87c0 0x7f7644132650 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c420 tx=0x7f762c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f7640ff9640 1 -- 172.21.15.78:0/2123742450 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c005cf0 con 0x7f76440a87c0 2023-10-14T09:18:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f7640ff9640 1 -- 172.21.15.78:0/2123742450 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c005e50 con 0x7f76440a87c0 2023-10-14T09:18:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f7640ff9640 1 -- 172.21.15.78:0/2123742450 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c007310 con 0x7f76440a87c0 2023-10-14T09:18:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f7649c17640 1 -- 172.21.15.78:0/2123742450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76441ef800 con 0x7f76440a87c0 2023-10-14T09:18:42.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f7649c17640 1 -- 172.21.15.78:0/2123742450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76441efd80 con 0x7f76440a87c0 2023-10-14T09:18:42.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f7640ff9640 1 -- 172.21.15.78:0/2123742450 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f762c007470 con 0x7f76440a87c0 2023-10-14T09:18:42.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.046+0000 7f7640ff9640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76240664a0 0x7f7624068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f7640ff9640 1 -- 172.21.15.78:0/2123742450 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f762c083390 con 0x7f76440a87c0 2023-10-14T09:18:42.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f76437fe640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76240664a0 0x7f7624068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 Processor -- start 2023-10-14T09:18:42.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 -- start start 2023-10-14T09:18:42.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f76437fe640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76240664a0 0x7f7624068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f76340ad000 tx=0x7f7634008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:42.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0df0d70 0x5588a0db2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3530 0x5588a0db3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3e50 0x5588a0db4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0baacc0 con 0x5588a0db3530 2023-10-14T09:18:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0c0d920 con 0x5588a0df0d70 2023-10-14T09:18:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588a0c0ae50 con 0x5588a0db3e50 2023-10-14T09:18:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f763bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3530 0x5588a0db3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f763bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3530 0x5588a0db3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41734/0 (socket says 172.21.15.78:41734) 2023-10-14T09:18:42.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f763bfff640 1 -- 172.21.15.78:0/787813173 learned_addr learned my addr 172.21.15.78:0/787813173 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f7643fff640 1 --2- 172.21.15.78:0/787813173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3e50 0x5588a0db4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f76437fe640 1 --2- 172.21.15.78:0/787813173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0df0d70 0x5588a0db2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f763bfff640 1 -- 172.21.15.78:0/787813173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3e50 msgr2=0x5588a0db4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f763bfff640 1 --2- 172.21.15.78:0/787813173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3e50 0x5588a0db4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f763bfff640 1 -- 172.21.15.78:0/787813173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0df0d70 msgr2=0x5588a0db2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:42.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f763bfff640 1 --2- 172.21.15.78:0/787813173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0df0d70 0x5588a0db2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f763bfff640 1 -- 172.21.15.78:0/787813173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588a08ff890 con 0x5588a0db3530 2023-10-14T09:18:42.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f763bfff640 1 --2- 172.21.15.78:0/787813173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3530 0x5588a0db3910 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f762c007fd0 tx=0x7f762c054730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8038e0adab6c09b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:42.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f76397fa640 1 -- 172.21.15.78:0/787813173 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c052730 con 0x5588a0db3530 2023-10-14T09:18:42.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f76397fa640 1 -- 172.21.15.78:0/787813173 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c052990 con 0x5588a0db3530 2023-10-14T09:18:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f76397fa640 1 -- 172.21.15.78:0/787813173 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c050d00 con 0x5588a0db3530 2023-10-14T09:18:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 -- 172.21.15.78:0/787813173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3530 msgr2=0x5588a0db3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 --2- 172.21.15.78:0/787813173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3530 0x5588a0db3910 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f762c007fd0 tx=0x7f762c054730 comp rx=0 tx=0).stop 2023-10-14T09:18:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 -- 172.21.15.78:0/787813173 shutdown_connections 2023-10-14T09:18:42.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 --2- 172.21.15.78:0/787813173 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3e50 0x5588a0db4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 --2- 172.21.15.78:0/787813173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3530 0x5588a0db3910 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 --2- 172.21.15.78:0/787813173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0df0d70 0x5588a0db2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 -- 172.21.15.78:0/787813173 >> 172.21.15.78:0/787813173 conn(0x5588a0dbbc90 msgr2=0x5588a0df35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 -- 172.21.15.78:0/787813173 shutdown_connections 2023-10-14T09:18:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.050+0000 7f764cfa0000 1 -- 172.21.15.78:0/787813173 wait complete. 2023-10-14T09:18:42.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 -- start start 2023-10-14T09:18:42.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 Processor -- start 2023-10-14T09:18:42.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3530 0x5588a0def980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3e50 0x5588a0defec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0db6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0c06740 con 0x5588a0df0d70 2023-10-14T09:18:42.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0bc5d10 con 0x5588a0db3e50 2023-10-14T09:18:42.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588a0bc59b0 con 0x5588a0db3530 2023-10-14T09:18:42.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 10 client.0 _ll_register_callbacks cb 0x5588a0da1390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:42.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f7643fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0db6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f7643fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0db6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41740/0 (socket says 172.21.15.78:41740) 2023-10-14T09:18:42.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f7643fff640 1 -- 172.21.15.78:0/2415745581 learned_addr learned my addr 172.21.15.78:0/2415745581 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:42.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f76437fe640 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3530 0x5588a0def980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f763bfff640 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3e50 0x5588a0defec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f7643fff640 1 -- 172.21.15.78:0/2415745581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3530 msgr2=0x5588a0def980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:42.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f7643fff640 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3530 0x5588a0def980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f7643fff640 1 -- 172.21.15.78:0/2415745581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3e50 msgr2=0x5588a0defec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:42.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f7643fff640 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3e50 0x5588a0defec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f7643fff640 1 -- 172.21.15.78:0/2415745581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76441efd80 con 0x5588a0df0d70 2023-10-14T09:18:42.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f7643fff640 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0db6a60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f763c012890 tx=0x7f763c012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e6ca60364961cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:42.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f76227fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:42.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f76227fc640 1 -- 172.21.15.78:0/2415745581 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c002080 con 0x5588a0df0d70 2023-10-14T09:18:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f76227fc640 1 -- 172.21.15.78:0/2415745581 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f763c003b90 con 0x5588a0df0d70 2023-10-14T09:18:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 -- 172.21.15.78:0/2415745581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588a0bba370 con 0x5588a0df0d70 2023-10-14T09:18:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f76227fc640 1 -- 172.21.15.78:0/2415745581 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f763c003da0 con 0x5588a0df0d70 2023-10-14T09:18:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 10 client.5400 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:42.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 -- 172.21.15.78:0/2415745581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5588a0bc8460 con 0x5588a0df0d70 2023-10-14T09:18:42.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f76227fc640 1 -- 172.21.15.78:0/2415745581 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588a0bba370 con 0x5588a0df0d70 2023-10-14T09:18:42.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f76227fc640 1 -- 172.21.15.78:0/2415745581 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f763c0107c0 con 0x5588a0df0d70 2023-10-14T09:18:42.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 10 client.5400 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:42.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 10 client.5400 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:42.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 20 client.5400 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:42.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x5588a0db77a0 0x5588a0db7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 4 client.5400 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:18:42.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f764cfa0000 1 -- 172.21.15.78:0/2415745581 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588a0ba02d0 con 0x5588a0db77a0 2023-10-14T09:18:42.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f76437fe640 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x5588a0db77a0 0x5588a0db7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f76437fe640 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x5588a0db77a0 0x5588a0db7b80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26b3b5caa5f9d708 server_cookie=c76af737e1703995 in_seq=0 out_seq=0 2023-10-14T09:18:42.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.054+0000 7f76227fc640 10 client.5400 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:42.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f76227fc640 1 -- 172.21.15.78:0/2415745581 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5588a0ba02d0 con 0x5588a0db77a0 2023-10-14T09:18:42.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f76227fc640 10 client.5400 handle_command_reply: tid=0 2023-10-14T09:18:42.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 1 client.5400 shutdown 2023-10-14T09:18:42.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 1 -- 172.21.15.78:0/2415745581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 msgr2=0x5588a0db6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:42.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0db6a60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f763c012890 tx=0x7f763c012d50 comp rx=0 tx=0).stop 2023-10-14T09:18:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 1 -- 172.21.15.78:0/2415745581 shutdown_connections 2023-10-14T09:18:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x5588a0db77a0 0x5588a0db7b80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0db6a60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3e50 0x5588a0defec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f76227fc640 0 client.5400 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 1 --2- 172.21.15.78:0/2415745581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3530 0x5588a0def980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 1 -- 172.21.15.78:0/2415745581 >> 172.21.15.78:0/2415745581 conn(0x5588a0dbbc90 msgr2=0x5588a0db26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 1 -- 172.21.15.78:0/2415745581 shutdown_connections 2023-10-14T09:18:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 1 -- 172.21.15.78:0/2415745581 wait complete. 2023-10-14T09:18:42.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.058+0000 7f764cfa0000 20 client.5400 trim_cache size 0 max 16384 2023-10-14T09:18:42.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.070+0000 7f764cfa0000 1 Processor -- start 2023-10-14T09:18:42.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 -- start start 2023-10-14T09:18:42.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3530 0x5588a0e07dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3e50 0x5588a0e08310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0df0d70 0x5588a0e08850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a08c0940 con 0x5588a0db3e50 2023-10-14T09:18:42.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0bc54d0 con 0x5588a0db3530 2023-10-14T09:18:42.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588a0c0a740 con 0x5588a0df0d70 2023-10-14T09:18:42.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f763bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3e50 0x5588a0e08310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f763bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3e50 0x5588a0e08310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41744/0 (socket says 172.21.15.78:41744) 2023-10-14T09:18:42.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f763bfff640 1 -- 172.21.15.78:0/4040971443 learned_addr learned my addr 172.21.15.78:0/4040971443 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:42.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f763bfff640 1 -- 172.21.15.78:0/4040971443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0df0d70 msgr2=0x5588a0e08850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:42.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f7643fff640 1 --2- 172.21.15.78:0/4040971443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0df0d70 0x5588a0e08850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f76437fe640 1 --2- 172.21.15.78:0/4040971443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3530 0x5588a0e07dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f763bfff640 1 --2- 172.21.15.78:0/4040971443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0df0d70 0x5588a0e08850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f763bfff640 1 -- 172.21.15.78:0/4040971443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3530 msgr2=0x5588a0e07dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:42.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f763bfff640 1 --2- 172.21.15.78:0/4040971443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3530 0x5588a0e07dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f763bfff640 1 -- 172.21.15.78:0/4040971443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588a0bae760 con 0x5588a0db3e50 2023-10-14T09:18:42.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f7643fff640 1 --2- 172.21.15.78:0/4040971443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0df0d70 0x5588a0e08850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:42.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f76437fe640 1 --2- 172.21.15.78:0/4040971443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3530 0x5588a0e07dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:18:42.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f763bfff640 1 --2- 172.21.15.78:0/4040971443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3e50 0x5588a0e08310 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f762c000f70 tx=0x7f762c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15401f9c74b69030 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:42.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f7639ffb640 1 -- 172.21.15.78:0/4040971443 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c080070 con 0x5588a0db3e50 2023-10-14T09:18:42.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f7639ffb640 1 -- 172.21.15.78:0/4040971443 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c007720 con 0x5588a0db3e50 2023-10-14T09:18:42.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f7639ffb640 1 -- 172.21.15.78:0/4040971443 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c052990 con 0x5588a0db3e50 2023-10-14T09:18:42.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 -- 172.21.15.78:0/4040971443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3e50 msgr2=0x5588a0e08310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:42.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 --2- 172.21.15.78:0/4040971443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3e50 0x5588a0e08310 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f762c000f70 tx=0x7f762c014000 comp rx=0 tx=0).stop 2023-10-14T09:18:42.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 -- 172.21.15.78:0/4040971443 shutdown_connections 2023-10-14T09:18:42.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 --2- 172.21.15.78:0/4040971443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0df0d70 0x5588a0e08850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 --2- 172.21.15.78:0/4040971443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0db3e50 0x5588a0e08310 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 --2- 172.21.15.78:0/4040971443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3530 0x5588a0e07dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 -- 172.21.15.78:0/4040971443 >> 172.21.15.78:0/4040971443 conn(0x5588a0dbbc90 msgr2=0x5588a0db1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:42.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 -- 172.21.15.78:0/4040971443 shutdown_connections 2023-10-14T09:18:42.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 -- 172.21.15.78:0/4040971443 wait complete. 2023-10-14T09:18:42.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 -- start start 2023-10-14T09:18:42.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.074+0000 7f764cfa0000 1 Processor -- start 2023-10-14T09:18:42.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3530 0x5588a0e19080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3e50 0x5588a0e195c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0e19b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0bb46c0 con 0x5588a0df0d70 2023-10-14T09:18:42.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588a0c03b40 con 0x5588a0db3e50 2023-10-14T09:18:42.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588a0c03f50 con 0x5588a0db3530 2023-10-14T09:18:42.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 10 client.0 _ll_register_callbacks cb 0x7f763c007ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:42.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f7643fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0e19b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f7643fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0e19b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41752/0 (socket says 172.21.15.78:41752) 2023-10-14T09:18:42.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f7643fff640 1 -- 172.21.15.78:0/3940339398 learned_addr learned my addr 172.21.15.78:0/3940339398 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:42.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f763bfff640 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3e50 0x5588a0e195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76437fe640 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3530 0x5588a0e19080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f7643fff640 1 -- 172.21.15.78:0/3940339398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3530 msgr2=0x5588a0e19080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:42.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f7643fff640 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3530 0x5588a0e19080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f7643fff640 1 -- 172.21.15.78:0/3940339398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3e50 msgr2=0x5588a0e195c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:42.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f7643fff640 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3e50 0x5588a0e195c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f7643fff640 1 -- 172.21.15.78:0/3940339398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588a08ff890 con 0x5588a0df0d70 2023-10-14T09:18:42.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f763bfff640 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3e50 0x5588a0e195c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:18:42.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f7643fff640 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0e19b00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f763c001a20 tx=0x7f763c0014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04091283cf4d3aa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:42.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76227fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:42.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76227fc640 1 -- 172.21.15.78:0/3940339398 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c003b90 con 0x5588a0df0d70 2023-10-14T09:18:42.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 -- 172.21.15.78:0/3940339398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588a0b9e6f0 con 0x5588a0df0d70 2023-10-14T09:18:42.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76227fc640 1 -- 172.21.15.78:0/3940339398 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f763c003cf0 con 0x5588a0df0d70 2023-10-14T09:18:42.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76227fc640 1 -- 172.21.15.78:0/3940339398 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f763c010610 con 0x5588a0df0d70 2023-10-14T09:18:42.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 10 client.5406 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:42.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 -- 172.21.15.78:0/3940339398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5588a08ffcc0 con 0x5588a0df0d70 2023-10-14T09:18:42.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76227fc640 1 -- 172.21.15.78:0/3940339398 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588a0b9e6f0 con 0x5588a0df0d70 2023-10-14T09:18:42.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76227fc640 1 -- 172.21.15.78:0/3940339398 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f763c005070 con 0x5588a0df0d70 2023-10-14T09:18:42.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 10 client.5406 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:42.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 10 client.5406 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:42.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 20 client.5406 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:42.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x5588a0e5b290 0x5588a0e5d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:42.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 4 client.5406 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T09:18:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 -- 172.21.15.78:0/3940339398 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5588a0bff720 con 0x5588a0e5b290 2023-10-14T09:18:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76437fe640 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x5588a0e5b290 0x5588a0e5d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76437fe640 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x5588a0e5b290 0x5588a0e5d680 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1273b4530ab8ed92 server_cookie=2ab619ed07e8749e in_seq=0 out_seq=0 2023-10-14T09:18:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76227fc640 10 client.5406 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76227fc640 1 -- 172.21.15.78:0/3940339398 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5588a0bff720 con 0x5588a0e5b290 2023-10-14T09:18:42.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76227fc640 10 client.5406 handle_command_reply: tid=0 2023-10-14T09:18:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 client.5406 shutdown 2023-10-14T09:18:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 -- 172.21.15.78:0/3940339398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 msgr2=0x5588a0e19b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0e19b00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f763c001a20 tx=0x7f763c0014e0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 -- 172.21.15.78:0/3940339398 shutdown_connections 2023-10-14T09:18:42.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x5588a0e5b290 0x5588a0e5d680 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5588a0df0d70 0x5588a0e19b00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x5588a0db3e50 0x5588a0e195c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f76227fc640 0 client.5406 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 --2- 172.21.15.78:0/3940339398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x5588a0db3530 0x5588a0e19080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 -- 172.21.15.78:0/3940339398 >> 172.21.15.78:0/3940339398 conn(0x5588a0dbbc90 msgr2=0x5588a0db1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:42.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 -- 172.21.15.78:0/3940339398 shutdown_connections 2023-10-14T09:18:42.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.078+0000 7f764cfa0000 1 -- 172.21.15.78:0/3940339398 wait complete. 2023-10-14T09:18:42.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f764cfa0000 20 client.5406 trim_cache size 0 max 16384 2023-10-14T09:18:42.100 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:18:42.100 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "1f80be0e-0937-433c-91b2-bf32e5285783", 2023-10-14T09:18:42.101 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-10-14T09:18:42.101 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5109, 2023-10-14T09:18:42.101 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-10-14T09:18:42.101 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-10-14T09:18:42.101 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "testcephfs1", 2023-10-14T09:18:42.101 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 25.454239376, 2023-10-14T09:18:42.102 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 17, 2023-10-14T09:18:42.102 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 32, 2023-10-14T09:18:42.102 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 32, 2023-10-14T09:18:42.102 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 33.317691265000001 2023-10-14T09:18:42.102 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:18:42.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 -- 172.21.15.78:0/2123742450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76240664a0 msgr2=0x7f7624068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:42.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76240664a0 0x7f7624068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f76340ad000 tx=0x7f7634008040 comp rx=0 tx=0).stop 2023-10-14T09:18:42.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 -- 172.21.15.78:0/2123742450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76440a87c0 msgr2=0x7f7644132650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:42.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76440a87c0 0x7f7644132650 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c420 tx=0x7f762c00c8e0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 -- 172.21.15.78:0/2123742450 shutdown_connections 2023-10-14T09:18:42.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76240664a0 0x7f7624068960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f764413b050 0x7f7644138b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76440a87c0 0x7f7644132650 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 --2- 172.21.15.78:0/2123742450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76440a8360 0x7f76441ec1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:42.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 -- 172.21.15.78:0/2123742450 >> 172.21.15.78:0/2123742450 conn(0x7f76440c1cc0 msgr2=0x7f76440be570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:42.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 -- 172.21.15.78:0/2123742450 shutdown_connections 2023-10-14T09:18:42.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:42.082+0000 7f7649c17640 1 -- 172.21.15.78:0/2123742450 wait complete. 2023-10-14T09:18:42.106 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T09:18:16.002036+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5109": { "addr": "172.21.15.78:6837/4241140805", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6836", "nonce": 4241140805, "type": "v2" }, { "addr": "172.21.15.78:6837", "nonce": 4241140805, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5109, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T09:18:19.017889+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5109 } } } ], "standbys": [ { "addr": "172.21.15.157:6833/2822193022", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6832", "nonce": 2822193022, "type": "v2" }, { "addr": "172.21.15.157:6833", "nonce": 2822193022, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5002, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.157:6835/488302185", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6834", "nonce": 488302185, "type": "v2" }, { "addr": "172.21.15.157:6835", "nonce": 488302185, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5005, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.78:6835/3378161275", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6834", "nonce": 3378161275, "type": "v2" }, { "addr": "172.21.15.78:6835", "nonce": 3378161275, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5106, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T09:18:42.107 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': 2, 'name': 'b', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T09:18:42.107 INFO:tasks.cephfs.test_failover:current = [{'gid': 5106, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.78:6835/3378161275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3378161275}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3378161275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 5002, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6833/2822193022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6832', 'nonce': 2822193022}, {'type': 'v1', 'addr': '172.21.15.157:6833', 'nonce': 2822193022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 5005, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6835/488302185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 488302185}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 488302185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T09:18:42.108 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T09:18:42.108 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T09:18:47.110 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:47.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.250+0000 7fc2fa468640 1 Processor -- start 2023-10-14T09:18:47.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.250+0000 7fc2fa468640 1 -- start start 2023-10-14T09:18:47.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2fa468640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f414ed10 0x7fc2f414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:47.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2fa468640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc2f414f700 0x7fc2f4150a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:47.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2fa468640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f41531d0 con 0x7fc2f414e0f0 2023-10-14T09:18:47.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2fa468640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f4153e50 con 0x7fc2f414f700 2023-10-14T09:18:47.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2fa468640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41534b0 con 0x7fc2f414ed10 2023-10-14T09:18:47.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f3fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc2f414e0f0 0x7fc2f4152960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57204/0 (socket says 172.21.15.78:57204) 2023-10-14T09:18:47.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f3fff640 1 -- 172.21.15.78:0/3595308090 learned_addr learned my addr 172.21.15.78:0/3595308090 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:47.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f8a05640 1 --2- 172.21.15.78:0/3595308090 >> v2:172.21.15.157:3300/0 conn(0x7fc2f414f700 0x7fc2f4150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:47.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f37fe640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f414ed10 0x7fc2f414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:47.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743260619 0 0) 0x7fc2f41531d0 con 0x7fc2f414e0f0 2023-10-14T09:18:47.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2dc003530 con 0x7fc2f414e0f0 2023-10-14T09:18:47.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3135818206 0 0) 0x7fc2dc003530 con 0x7fc2f414e0f0 2023-10-14T09:18:47.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f414ed10 msgr2=0x7fc2f414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:47.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f414ed10 0x7fc2f414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:47.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 >> v2:172.21.15.157:3300/0 conn(0x7fc2f414f700 msgr2=0x7fc2f4150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:47.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 --2- 172.21.15.78:0/3595308090 >> v2:172.21.15.157:3300/0 conn(0x7fc2f414f700 0x7fc2f4150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:47.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4153790 con 0x7fc2f414e0f0 2023-10-14T09:18:47.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7fc2e4001680 con 0x7fc2f414e0f0 2023-10-14T09:18:47.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 >> v1:172.21.15.78:6789/0 conn(0x7fc2f414e0f0 legacy=0x7fc2f4152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:47.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 0x7fc2dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:47.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2dc0047d0 0x7fc2dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:47.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f414ed10 0x7fc2dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:47.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4153e50 con 0x7fc2dc003980 2023-10-14T09:18:47.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41534b0 con 0x7fc2dc0047d0 2023-10-14T09:18:47.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00b9c0 con 0x7fc2f414ed10 2023-10-14T09:18:47.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f3fff640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 0x7fc2dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:47.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f37fe640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2dc0047d0 0x7fc2dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:47.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f8a05640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f414ed10 0x7fc2dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:47.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f3fff640 1 -- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f414ed10 msgr2=0x7fc2dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:47.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f3fff640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f414ed10 0x7fc2dc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:47.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f3fff640 1 -- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2dc0047d0 msgr2=0x7fc2dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:47.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f3fff640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2dc0047d0 0x7fc2dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:47.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f3fff640 1 -- 172.21.15.78:0/3595308090 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc003530 con 0x7fc2dc003980 2023-10-14T09:18:47.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.254+0000 7fc2f37fe640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2dc0047d0 0x7fc2dc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:47.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.258+0000 7fc2f3fff640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 0x7fc2dc003da0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c240 tx=0x7fc2e401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d70b63eafd95840 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:47.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.258+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40058e0 con 0x7fc2dc003980 2023-10-14T09:18:47.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.258+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4005a40 con 0x7fc2dc003980 2023-10-14T09:18:47.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.258+0000 7fc2f2ffd640 1 -- 172.21.15.78:0/3595308090 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4005df0 con 0x7fc2dc003980 2023-10-14T09:18:47.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.258+0000 7fc2fa468640 1 -- 172.21.15.78:0/3595308090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 msgr2=0x7fc2dc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:47.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.258+0000 7fc2fa468640 1 --2- 172.21.15.78:0/3595308090 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 0x7fc2dc003da0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c240 tx=0x7fc2e401cc00 comp rx=0 tx=0).stop 2023-10-14T09:18:47.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.258+0000 7fc2f8a05640 1 -- 172.21.15.78:0/3595308090 reap_dead start 2023-10-14T09:18:47.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.258+0000 7fc2fa468640 1 -- 172.21.15.78:0/3595308090 shutdown_connections 2023-10-14T09:18:47.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.258+0000 7fc2fa468640 1 -- 172.21.15.78:0/3595308090 >> 172.21.15.78:0/3595308090 conn(0x7fc2f40c1cc0 msgr2=0x7fc2f40c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:47.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.258+0000 7fc2fa468640 1 -- 172.21.15.78:0/3595308090 shutdown_connections 2023-10-14T09:18:47.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.258+0000 7fc2fa468640 1 -- 172.21.15.78:0/3595308090 wait complete. 2023-10-14T09:18:47.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2fa468640 1 Processor -- start 2023-10-14T09:18:47.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2fa468640 1 -- start start 2023-10-14T09:18:47.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2fa468640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 0x7fc2f415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:47.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2fa468640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f406da70 0x7fc2f4144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:47.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2fa468640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2f41453b0 0x7fc2f41ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:47.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2fa468640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40708c0 con 0x7fc2dc003980 2023-10-14T09:18:47.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2fa468640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41f0600 con 0x7fc2f41453b0 2023-10-14T09:18:47.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2fa468640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41f0b30 con 0x7fc2f406da70 2023-10-14T09:18:47.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 0x7fc2f415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:47.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 0x7fc2f415a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54134/0 (socket says 172.21.15.78:54134) 2023-10-14T09:18:47.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f3fff640 1 -- 172.21.15.78:0/1005115881 learned_addr learned my addr 172.21.15.78:0/1005115881 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:47.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f8a05640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2f41453b0 0x7fc2f41ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:47.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f37fe640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f406da70 0x7fc2f4144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:47.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f3fff640 1 -- 172.21.15.78:0/1005115881 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f406da70 msgr2=0x7fc2f4144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:47.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f3fff640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f406da70 0x7fc2f4144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:47.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f3fff640 1 -- 172.21.15.78:0/1005115881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2f41453b0 msgr2=0x7fc2f41ec680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:47.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f3fff640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2f41453b0 0x7fc2f41ec680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:47.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f3fff640 1 -- 172.21.15.78:0/1005115881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4070100 con 0x7fc2dc003980 2023-10-14T09:18:47.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f3fff640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 0x7fc2f415a850 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40ab040 tx=0x7fc2dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:47.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f0ff9640 1 -- 172.21.15.78:0/1005115881 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40047f0 con 0x7fc2dc003980 2023-10-14T09:18:47.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f0ff9640 1 -- 172.21.15.78:0/1005115881 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4004950 con 0x7fc2dc003980 2023-10-14T09:18:47.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2fa468640 1 -- 172.21.15.78:0/1005115881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f406d6a0 con 0x7fc2dc003980 2023-10-14T09:18:47.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2f0ff9640 1 -- 172.21.15.78:0/1005115881 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4004d00 con 0x7fc2dc003980 2023-10-14T09:18:47.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2fa468640 1 -- 172.21.15.78:0/1005115881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f415b170 con 0x7fc2dc003980 2023-10-14T09:18:47.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.262+0000 7fc2fa468640 1 -- 172.21.15.78:0/1005115881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f4074180 con 0x7fc2dc003980 2023-10-14T09:18:47.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.266+0000 7fc2f0ff9640 1 -- 172.21.15.78:0/1005115881 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc2e4007070 con 0x7fc2dc003980 2023-10-14T09:18:47.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.266+0000 7fc2f0ff9640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc2e00664a0 0x7fc2e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:47.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.266+0000 7fc2f0ff9640 1 -- 172.21.15.78:0/1005115881 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fc2e411d7a0 con 0x7fc2dc003980 2023-10-14T09:18:47.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.266+0000 7fc2f37fe640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc2e00664a0 0x7fc2e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:47.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.266+0000 7fc2f37fe640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc2e00664a0 0x7fc2e0068960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4148a80 tx=0x7fc2e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:47.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.270+0000 7fc2f0ff9640 1 -- 172.21.15.78:0/1005115881 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2e40eabf0 con 0x7fc2dc003980 2023-10-14T09:18:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.454+0000 7fc2fa468640 1 -- 172.21.15.78:0/1005115881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2f40c2820 con 0x7fc2dc003980 2023-10-14T09:18:47.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2f0ff9640 1 -- 172.21.15.78:0/1005115881 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fc2e4004e60 con 0x7fc2dc003980 2023-10-14T09:18:47.463 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:47.463 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:18:47.463 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:18:47.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 -- 172.21.15.78:0/1005115881 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc2e00664a0 msgr2=0x7fc2e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc2e00664a0 0x7fc2e0068960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4148a80 tx=0x7fc2e8008040 comp rx=0 tx=0).stop 2023-10-14T09:18:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 -- 172.21.15.78:0/1005115881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 msgr2=0x7fc2f415a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 0x7fc2f415a850 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40ab040 tx=0x7fc2dc005800 comp rx=0 tx=0).stop 2023-10-14T09:18:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 -- 172.21.15.78:0/1005115881 shutdown_connections 2023-10-14T09:18:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2f41453b0 0x7fc2f41ec680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc2e00664a0 0x7fc2e0068960 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc2f406da70 0x7fc2f4144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 --2- 172.21.15.78:0/1005115881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2dc003980 0x7fc2f415a850 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 -- 172.21.15.78:0/1005115881 >> 172.21.15.78:0/1005115881 conn(0x7fc2f40c1cc0 msgr2=0x7fc2f414fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 -- 172.21.15.78:0/1005115881 shutdown_connections 2023-10-14T09:18:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:47.458+0000 7fc2fa468640 1 -- 172.21.15.78:0/1005115881 wait complete. 2023-10-14T09:18:47.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T09:18:16.002036+0000', 'modified': '2023-10-14T09:18:19.017889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5109}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5109': {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T09:18:47.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T09:18:47.887 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T09:18:48.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.018+0000 7f3d71205640 1 Processor -- start 2023-10-14T09:18:48.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.018+0000 7f3d71205640 1 -- start start 2023-10-14T09:18:48.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d71205640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d6c0c4440 0x7f3d6c0aad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d71205640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0c48b0 0x7f3d6c069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d71205640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c152820 con 0x7f3d6c155630 2023-10-14T09:18:48.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d71205640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c0c50c0 con 0x7f3d6c0c4440 2023-10-14T09:18:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d71205640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c151ef0 con 0x7f3d6c0c48b0 2023-10-14T09:18:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d6a59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d6c0c4440 0x7f3d6c0aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d6ad9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3d6c155630 0x7f3d6c155a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57220/0 (socket says 172.21.15.78:57220) 2023-10-14T09:18:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d6ad9d640 1 -- 172.21.15.78:0/3649908123 learned_addr learned my addr 172.21.15.78:0/3649908123 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:48.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/3649908123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0c48b0 0x7f3d6c069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d6a59c640 1 -- 172.21.15.78:0/3649908123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0c48b0 msgr2=0x7f3d6c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d6a59c640 1 --2- 172.21.15.78:0/3649908123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0c48b0 0x7f3d6c069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d6a59c640 1 -- 172.21.15.78:0/3649908123 >> v1:172.21.15.78:6789/0 conn(0x7f3d6c155630 legacy=0x7f3d6c155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:48.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d6a59c640 1 -- 172.21.15.78:0/3649908123 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c1521d0 con 0x7f3d6c0c4440 2023-10-14T09:18:48.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.022+0000 7f3d69d9b640 1 -- 172.21.15.78:0/3649908123 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369137939 0 0) 0x7f3d6c152820 con 0x7f3d6c155630 2023-10-14T09:18:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d6a59c640 1 --2- 172.21.15.78:0/3649908123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d6c0c4440 0x7f3d6c0aad90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3d600097c0 tx=0x7f3d6001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62eacae0bdb1341a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:48.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d69d9b640 1 -- 172.21.15.78:0/3649908123 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600ad640 con 0x7f3d6c0c4440 2023-10-14T09:18:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d69d9b640 1 -- 172.21.15.78:0/3649908123 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c151ce0 con 0x7f3d6c0c4440 2023-10-14T09:18:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d69d9b640 1 -- 172.21.15.78:0/3649908123 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600ad9c0 con 0x7f3d6c0c4440 2023-10-14T09:18:48.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d71205640 1 -- 172.21.15.78:0/3649908123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d6c0c4440 msgr2=0x7f3d6c0aad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d71205640 1 --2- 172.21.15.78:0/3649908123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d6c0c4440 0x7f3d6c0aad90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3d600097c0 tx=0x7f3d6001c3f0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d71205640 1 -- 172.21.15.78:0/3649908123 shutdown_connections 2023-10-14T09:18:48.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d71205640 1 --2- 172.21.15.78:0/3649908123 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0c48b0 0x7f3d6c069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d71205640 1 --2- 172.21.15.78:0/3649908123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d6c0c4440 0x7f3d6c0aad90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d71205640 1 -- 172.21.15.78:0/3649908123 >> 172.21.15.78:0/3649908123 conn(0x7f3d6c0c25b0 msgr2=0x7f3d6c0c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:48.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d71205640 1 -- 172.21.15.78:0/3649908123 shutdown_connections 2023-10-14T09:18:48.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d71205640 1 -- 172.21.15.78:0/3649908123 wait complete. 2023-10-14T09:18:48.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d71205640 1 Processor -- start 2023-10-14T09:18:48.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.026+0000 7f3d71205640 1 -- start start 2023-10-14T09:18:48.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d71205640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0c4440 0x7f3d6c1ebf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d71205640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d6c155630 0x7f3d6c0c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d71205640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d6c0befa0 0x7f3d6c1efb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d71205640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c14d810 con 0x7f3d6c0befa0 2023-10-14T09:18:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d71205640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0bd710 con 0x7f3d6c155630 2023-10-14T09:18:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d71205640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c1ef480 con 0x7f3d6c0c4440 2023-10-14T09:18:48.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d6b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d6c0befa0 0x7f3d6c1efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d6b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d6c0befa0 0x7f3d6c1efb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54142/0 (socket says 172.21.15.78:54142) 2023-10-14T09:18:48.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d6b59e640 1 -- 172.21.15.78:0/2093088191 learned_addr learned my addr 172.21.15.78:0/2093088191 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:48.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d6a59c640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d6c155630 0x7f3d6c0c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0c4440 0x7f3d6c1ebf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d6b59e640 1 -- 172.21.15.78:0/2093088191 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0c4440 msgr2=0x7f3d6c1ebf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:48.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0c4440 0x7f3d6c1ebf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d6b59e640 1 -- 172.21.15.78:0/2093088191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d6c155630 msgr2=0x7f3d6c0c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:48.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d6c155630 0x7f3d6c0c1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d6b59e640 1 -- 172.21.15.78:0/2093088191 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60009420 con 0x7f3d6c0befa0 2023-10-14T09:18:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d6c0befa0 0x7f3d6c1efb90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400d600 tx=0x7f3d6400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d537fe640 1 -- 172.21.15.78:0/2093088191 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d640125f0 con 0x7f3d6c0befa0 2023-10-14T09:18:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d537fe640 1 -- 172.21.15.78:0/2093088191 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d64012770 con 0x7f3d6c0befa0 2023-10-14T09:18:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d71205640 1 -- 172.21.15.78:0/2093088191 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c1ef700 con 0x7f3d6c0befa0 2023-10-14T09:18:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d537fe640 1 -- 172.21.15.78:0/2093088191 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64012b20 con 0x7f3d6c0befa0 2023-10-14T09:18:48.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.030+0000 7f3d71205640 1 -- 172.21.15.78:0/2093088191 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c0bcd10 con 0x7f3d6c0befa0 2023-10-14T09:18:48.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d537fe640 1 -- 172.21.15.78:0/2093088191 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3d64012c80 con 0x7f3d6c0befa0 2023-10-14T09:18:48.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d537fe640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3d580664d0 0x7f3d58068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d537fe640 1 -- 172.21.15.78:0/2093088191 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3d640841a0 con 0x7f3d6c0befa0 2023-10-14T09:18:48.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d74577000 1 Processor -- start 2023-10-14T09:18:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3d580664d0 0x7f3d58068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d74577000 1 -- start start 2023-10-14T09:18:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3d580664d0 0x7f3d58068990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0012f0 tx=0x7f3d5c005ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:48.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d74577000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a6708d70 0x55d8a66caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d74577000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cb530 0x55d8a66cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d74577000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66cbe50 0x55d8a66cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d74577000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a64c2cc0 con 0x55d8a66cb530 2023-10-14T09:18:48.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d74577000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a6525920 con 0x55d8a6708d70 2023-10-14T09:18:48.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d74577000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8a6522e50 con 0x55d8a66cbe50 2023-10-14T09:18:48.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6ad9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a6708d70 0x55d8a66caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cb530 0x55d8a66cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6ad9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a6708d70 0x55d8a66caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:40452/0 (socket says 172.21.15.78:40452) 2023-10-14T09:18:48.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6ad9d640 1 -- 172.21.15.78:0/3579576568 learned_addr learned my addr 172.21.15.78:0/3579576568 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:48.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/3579576568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66cbe50 0x55d8a66cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6ad9d640 1 -- 172.21.15.78:0/3579576568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66cbe50 msgr2=0x55d8a66cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/3579576568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66cbe50 0x55d8a66cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6ad9d640 1 -- 172.21.15.78:0/3579576568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cb530 msgr2=0x55d8a66cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/3579576568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cb530 0x55d8a66cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6ad9d640 1 -- 172.21.15.78:0/3579576568 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8a6217890 con 0x55d8a6708d70 2023-10-14T09:18:48.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6a59c640 1 --2- 172.21.15.78:0/3579576568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cb530 0x55d8a66cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:18:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.034+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/3579576568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a6708d70 0x55d8a66caff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c001ca0 tx=0x7f3d5c012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70f42a75985022a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d50ff9640 1 -- 172.21.15.78:0/3579576568 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0159c0 con 0x55d8a6708d70 2023-10-14T09:18:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d50ff9640 1 -- 172.21.15.78:0/3579576568 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c015b20 con 0x55d8a6708d70 2023-10-14T09:18:48.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d50ff9640 1 -- 172.21.15.78:0/3579576568 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c015e90 con 0x55d8a6708d70 2023-10-14T09:18:48.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 -- 172.21.15.78:0/3579576568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a6708d70 msgr2=0x55d8a66caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:48.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 --2- 172.21.15.78:0/3579576568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a6708d70 0x55d8a66caff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c001ca0 tx=0x7f3d5c012000 comp rx=0 tx=0).stop 2023-10-14T09:18:48.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 -- 172.21.15.78:0/3579576568 shutdown_connections 2023-10-14T09:18:48.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 --2- 172.21.15.78:0/3579576568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66cbe50 0x55d8a66cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 --2- 172.21.15.78:0/3579576568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cb530 0x55d8a66cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 --2- 172.21.15.78:0/3579576568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a6708d70 0x55d8a66caff0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 -- 172.21.15.78:0/3579576568 >> 172.21.15.78:0/3579576568 conn(0x55d8a66d3c90 msgr2=0x55d8a670b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 -- 172.21.15.78:0/3579576568 shutdown_connections 2023-10-14T09:18:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 -- 172.21.15.78:0/3579576568 wait complete. 2023-10-14T09:18:48.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 -- start start 2023-10-14T09:18:48.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 Processor -- start 2023-10-14T09:18:48.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cb530 0x55d8a6707980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6707ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a6708d70 0x55d8a66cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a651e740 con 0x55d8a66cbe50 2023-10-14T09:18:48.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a64ddd10 con 0x55d8a66cb530 2023-10-14T09:18:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8a64dd9b0 con 0x55d8a6708d70 2023-10-14T09:18:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d74577000 10 client.0 _ll_register_callbacks cb 0x55d8a66b9390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d6a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6707ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d6ad9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cb530 0x55d8a6707980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d6a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6707ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54162/0 (socket says 172.21.15.78:54162) 2023-10-14T09:18:48.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d6a59c640 1 -- 172.21.15.78:0/1446915908 learned_addr learned my addr 172.21.15.78:0/1446915908 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:48.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a6708d70 0x55d8a66cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d6a59c640 1 -- 172.21.15.78:0/1446915908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a6708d70 msgr2=0x55d8a66cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:48.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d6a59c640 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a6708d70 0x55d8a66cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d6a59c640 1 -- 172.21.15.78:0/1446915908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cb530 msgr2=0x55d8a6707980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:48.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d6a59c640 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cb530 0x55d8a6707980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.038+0000 7f3d6a59c640 1 -- 172.21.15.78:0/1446915908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c1521d0 con 0x55d8a66cbe50 2023-10-14T09:18:48.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d6a59c640 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6707ec0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3d600097c0 tx=0x7f3d6001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded7a409c349fdf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:48.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:48.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d49ffb640 1 -- 172.21.15.78:0/1446915908 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600add40 con 0x55d8a66cbe50 2023-10-14T09:18:48.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d49ffb640 1 -- 172.21.15.78:0/1446915908 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3d600c2410 con 0x55d8a66cbe50 2023-10-14T09:18:48.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 -- 172.21.15.78:0/1446915908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8a64d2370 con 0x55d8a66cbe50 2023-10-14T09:18:48.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d49ffb640 1 -- 172.21.15.78:0/1446915908 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d600adea0 con 0x55d8a66cbe50 2023-10-14T09:18:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 10 client.5427 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 -- 172.21.15.78:0/1446915908 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f3d5c00f040 con 0x55d8a66cbe50 2023-10-14T09:18:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d49ffb640 1 -- 172.21.15.78:0/1446915908 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8a64d2370 con 0x55d8a66cbe50 2023-10-14T09:18:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d49ffb640 1 -- 172.21.15.78:0/1446915908 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f3d600c25d0 con 0x55d8a66cbe50 2023-10-14T09:18:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 10 client.5427 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 10 client.5427 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 20 client.5427 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d8a66cf7d0 0x55d8a66cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 4 client.5427 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:18:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 -- 172.21.15.78:0/1446915908 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8a64b82d0 con 0x55d8a66cf7d0 2023-10-14T09:18:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d8a66cf7d0 0x55d8a66cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d49ffb640 10 client.5427 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d8a66cf7d0 0x55d8a66cfbb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26276d37b449a2fa server_cookie=372fc0356329abdf in_seq=0 out_seq=0 2023-10-14T09:18:48.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d49ffb640 1 -- 172.21.15.78:0/1446915908 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d8a64b82d0 con 0x55d8a66cf7d0 2023-10-14T09:18:48.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d49ffb640 10 client.5427 handle_command_reply: tid=0 2023-10-14T09:18:48.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 client.5427 shutdown 2023-10-14T09:18:48.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 -- 172.21.15.78:0/1446915908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 msgr2=0x55d8a6707ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:48.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6707ec0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3d600097c0 tx=0x7f3d6001ac30 comp rx=0 tx=0).stop 2023-10-14T09:18:48.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 -- 172.21.15.78:0/1446915908 shutdown_connections 2023-10-14T09:18:48.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d8a66cf7d0 0x55d8a66cfbb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a6708d70 0x55d8a66cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6707ec0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d49ffb640 0 client.5427 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 --2- 172.21.15.78:0/1446915908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cb530 0x55d8a6707980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 -- 172.21.15.78:0/1446915908 >> 172.21.15.78:0/1446915908 conn(0x55d8a66d3c90 msgr2=0x55d8a66ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 -- 172.21.15.78:0/1446915908 shutdown_connections 2023-10-14T09:18:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 1 -- 172.21.15.78:0/1446915908 wait complete. 2023-10-14T09:18:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.042+0000 7f3d74577000 20 client.5427 trim_cache size 0 max 16384 2023-10-14T09:18:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d74577000 1 Processor -- start 2023-10-14T09:18:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d74577000 1 -- start start 2023-10-14T09:18:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d74577000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66d3c90 0x55d8a6769000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d74577000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cb530 0x55d8a6769540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d74577000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6769a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d74577000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a61d8940 con 0x55d8a66cbe50 2023-10-14T09:18:48.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d74577000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a671b980 con 0x55d8a66cb530 2023-10-14T09:18:48.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d74577000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8a670b5c0 con 0x55d8a66d3c90 2023-10-14T09:18:48.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d6b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6769a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d6b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6769a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54172/0 (socket says 172.21.15.78:54172) 2023-10-14T09:18:48.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d6b59e640 1 -- 172.21.15.78:0/2834307177 learned_addr learned my addr 172.21.15.78:0/2834307177 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:48.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/2834307177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66d3c90 0x55d8a6769000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d6a59c640 1 --2- 172.21.15.78:0/2834307177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cb530 0x55d8a6769540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d6b59e640 1 -- 172.21.15.78:0/2834307177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66d3c90 msgr2=0x55d8a6769000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:48.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/2834307177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66d3c90 0x55d8a6769000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d6b59e640 1 -- 172.21.15.78:0/2834307177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cb530 msgr2=0x55d8a6769540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:48.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/2834307177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cb530 0x55d8a6769540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d6b59e640 1 -- 172.21.15.78:0/2834307177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8a64e0460 con 0x55d8a66cbe50 2023-10-14T09:18:48.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/2834307177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6769a80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3d6405d120 tx=0x7f3d64054cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e459540037d2045d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:48.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d517fa640 1 -- 172.21.15.78:0/2834307177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d640594a0 con 0x55d8a66cbe50 2023-10-14T09:18:48.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d517fa640 1 -- 172.21.15.78:0/2834307177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6405d650 con 0x55d8a66cbe50 2023-10-14T09:18:48.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.058+0000 7f3d517fa640 1 -- 172.21.15.78:0/2834307177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d640536f0 con 0x55d8a66cbe50 2023-10-14T09:18:48.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- 172.21.15.78:0/2834307177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 msgr2=0x55d8a6769a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 --2- 172.21.15.78:0/2834307177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6769a80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3d6405d120 tx=0x7f3d64054cb0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- 172.21.15.78:0/2834307177 shutdown_connections 2023-10-14T09:18:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 --2- 172.21.15.78:0/2834307177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66cbe50 0x55d8a6769a80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 --2- 172.21.15.78:0/2834307177 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cb530 0x55d8a6769540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 --2- 172.21.15.78:0/2834307177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66d3c90 0x55d8a6769000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- 172.21.15.78:0/2834307177 >> 172.21.15.78:0/2834307177 conn(0x55d8a67084c0 msgr2=0x55d8a66d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:48.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- 172.21.15.78:0/2834307177 shutdown_connections 2023-10-14T09:18:48.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- 172.21.15.78:0/2834307177 wait complete. 2023-10-14T09:18:48.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- start start 2023-10-14T09:18:48.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 Processor -- start 2023-10-14T09:18:48.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66cb530 0x55d8a676a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cbe50 0x55d8a676a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66d3c90 0x55d8a67220f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a651bf50 con 0x55d8a66d3c90 2023-10-14T09:18:48.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a62181b0 con 0x55d8a66cbe50 2023-10-14T09:18:48.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8a6574cf0 con 0x55d8a66cb530 2023-10-14T09:18:48.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 10 client.0 _ll_register_callbacks cb 0x7f3d5c007170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:48.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66d3c90 0x55d8a67220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66d3c90 0x55d8a67220f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54176/0 (socket says 172.21.15.78:54176) 2023-10-14T09:18:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6b59e640 1 -- 172.21.15.78:0/3408260387 learned_addr learned my addr 172.21.15.78:0/3408260387 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66cb530 0x55d8a676a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6a59c640 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cbe50 0x55d8a676a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6b59e640 1 -- 172.21.15.78:0/3408260387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66cb530 msgr2=0x55d8a676a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66cb530 0x55d8a676a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6b59e640 1 -- 172.21.15.78:0/3408260387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cbe50 msgr2=0x55d8a676a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:48.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cbe50 0x55d8a676a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6b59e640 1 -- 172.21.15.78:0/3408260387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c0bcd10 con 0x55d8a66d3c90 2023-10-14T09:18:48.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6b59e640 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66d3c90 0x55d8a67220f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3d640552e0 tx=0x7f3d64082610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b771826a1cab72a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:48.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d49ffb640 1 -- 172.21.15.78:0/3408260387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d640594a0 con 0x55d8a66d3c90 2023-10-14T09:18:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d49ffb640 1 -- 172.21.15.78:0/3408260387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3d64059140 con 0x55d8a66d3c90 2023-10-14T09:18:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- 172.21.15.78:0/3408260387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8a64b66f0 con 0x55d8a66d3c90 2023-10-14T09:18:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d49ffb640 1 -- 172.21.15.78:0/3408260387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d6407c3d0 con 0x55d8a66d3c90 2023-10-14T09:18:48.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 10 client.5433 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- 172.21.15.78:0/3408260387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d8a64c6760 con 0x55d8a66d3c90 2023-10-14T09:18:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d49ffb640 1 -- 172.21.15.78:0/3408260387 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8a64b66f0 con 0x55d8a66d3c90 2023-10-14T09:18:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d49ffb640 1 -- 172.21.15.78:0/3408260387 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f3d64051a60 con 0x55d8a66d3c90 2023-10-14T09:18:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 10 client.5433 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:48.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 10 client.5433 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:48.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 20 client.5433 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:48.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d8a6708d70 0x55d8a6722a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:48.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 4 client.5433 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T09:18:48.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d74577000 1 -- 172.21.15.78:0/3408260387 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d8a6517720 con 0x55d8a6708d70 2023-10-14T09:18:48.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.062+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d8a6708d70 0x55d8a6722a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:48.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d6ad9d640 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d8a6708d70 0x55d8a6722a80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6669d74dc3c6964 server_cookie=9d470d2152445d0e in_seq=0 out_seq=0 2023-10-14T09:18:48.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d49ffb640 10 client.5433 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:48.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d49ffb640 1 -- 172.21.15.78:0/3408260387 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x55d8a6517720 con 0x55d8a6708d70 2023-10-14T09:18:48.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d49ffb640 10 client.5433 handle_command_reply: tid=0 2023-10-14T09:18:48.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 1 client.5433 shutdown 2023-10-14T09:18:48.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 1 -- 172.21.15.78:0/3408260387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66d3c90 msgr2=0x55d8a67220f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:48.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66d3c90 0x55d8a67220f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3d640552e0 tx=0x7f3d64082610 comp rx=0 tx=0).stop 2023-10-14T09:18:48.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 1 -- 172.21.15.78:0/3408260387 shutdown_connections 2023-10-14T09:18:48.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55d8a6708d70 0x55d8a6722a80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d8a66d3c90 0x55d8a67220f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55d8a66cbe50 0x55d8a676a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 1 --2- 172.21.15.78:0/3408260387 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55d8a66cb530 0x55d8a676a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d49ffb640 0 client.5433 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:48.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 1 -- 172.21.15.78:0/3408260387 >> 172.21.15.78:0/3408260387 conn(0x55d8a67084c0 msgr2=0x55d8a66d1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:48.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 1 -- 172.21.15.78:0/3408260387 shutdown_connections 2023-10-14T09:18:48.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 1 -- 172.21.15.78:0/3408260387 wait complete. 2023-10-14T09:18:48.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d74577000 20 client.5433 trim_cache size 0 max 16384 2023-10-14T09:18:48.095 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:18:48.096 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "1f80be0e-0937-433c-91b2-bf32e5285783", 2023-10-14T09:18:48.096 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-10-14T09:18:48.096 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5109, 2023-10-14T09:18:48.096 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-10-14T09:18:48.096 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-10-14T09:18:48.097 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "testcephfs1", 2023-10-14T09:18:48.097 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 31.439405443999998, 2023-10-14T09:18:48.097 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 17, 2023-10-14T09:18:48.097 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 32, 2023-10-14T09:18:48.097 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 32, 2023-10-14T09:18:48.097 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 39.302857230000001 2023-10-14T09:18:48.098 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:18:48.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 -- 172.21.15.78:0/2093088191 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3d580664d0 msgr2=0x7f3d58068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:48.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3d580664d0 0x7f3d58068990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0012f0 tx=0x7f3d5c005ec0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 -- 172.21.15.78:0/2093088191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d6c0befa0 msgr2=0x7f3d6c1efb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:48.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d6c0befa0 0x7f3d6c1efb90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400d600 tx=0x7f3d6400dac0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 -- 172.21.15.78:0/2093088191 shutdown_connections 2023-10-14T09:18:48.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d6c0befa0 0x7f3d6c1efb90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d6c155630 0x7f3d6c0c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f3d580664d0 0x7f3d58068990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 --2- 172.21.15.78:0/2093088191 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3d6c0c4440 0x7f3d6c1ebf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:48.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 -- 172.21.15.78:0/2093088191 >> 172.21.15.78:0/2093088191 conn(0x7f3d6c0c25b0 msgr2=0x7f3d6c0bc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:48.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 -- 172.21.15.78:0/2093088191 shutdown_connections 2023-10-14T09:18:48.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:48.066+0000 7f3d71205640 1 -- 172.21.15.78:0/2093088191 wait complete. 2023-10-14T09:18:48.102 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T09:18:16.002036+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5109": { "addr": "172.21.15.78:6837/4241140805", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6836", "nonce": 4241140805, "type": "v2" }, { "addr": "172.21.15.78:6837", "nonce": 4241140805, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5109, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T09:18:19.017889+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5109 } } } ], "standbys": [ { "addr": "172.21.15.157:6833/2822193022", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6832", "nonce": 2822193022, "type": "v2" }, { "addr": "172.21.15.157:6833", "nonce": 2822193022, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5002, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.157:6835/488302185", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6834", "nonce": 488302185, "type": "v2" }, { "addr": "172.21.15.157:6835", "nonce": 488302185, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5005, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.78:6835/3378161275", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6834", "nonce": 3378161275, "type": "v2" }, { "addr": "172.21.15.78:6835", "nonce": 3378161275, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5106, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T09:18:48.103 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': 2, 'name': 'b', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T09:18:48.104 INFO:tasks.cephfs.test_failover:current = [{'gid': 5106, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.78:6835/3378161275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3378161275}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3378161275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 5002, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6833/2822193022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6832', 'nonce': 2822193022}, {'type': 'v1', 'addr': '172.21.15.157:6833', 'nonce': 2822193022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 5005, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6835/488302185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 488302185}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 488302185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T09:18:48.104 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T09:18:48.104 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T09:18:53.105 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.246+0000 7f6cde30f640 1 Processor -- start 2023-10-14T09:18:53.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.246+0000 7f6cde30f640 1 -- start start 2023-10-14T09:18:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.246+0000 7f6cde30f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6cd814ddb0 0x7f6cd80c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.246+0000 7f6cde30f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cd8153e80 0x7f6cd806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:53.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.246+0000 7f6cde30f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd806c470 con 0x7f6cd80c6910 2023-10-14T09:18:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.246+0000 7f6cde30f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd80c64f0 con 0x7f6cd814ddb0 2023-10-14T09:18:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.246+0000 7f6cde30f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80c5300 con 0x7f6cd8153e80 2023-10-14T09:18:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.246+0000 7f6cdc8ac640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6cd80c6910 0x7f6cd80c3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57230/0 (socket says 172.21.15.78:57230) 2023-10-14T09:18:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.246+0000 7f6cdc8ac640 1 -- 172.21.15.78:0/1702769535 learned_addr learned my addr 172.21.15.78:0/1702769535 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd77fe640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cd8153e80 0x7f6cd806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:53.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd7fff640 1 --2- 172.21.15.78:0/1702769535 >> v2:172.21.15.157:3300/0 conn(0x7f6cd814ddb0 0x7f6cd80c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:53.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885441491 0 0) 0x7f6cd806c470 con 0x7f6cd80c6910 2023-10-14T09:18:53.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cc0003530 con 0x7f6cd80c6910 2023-10-14T09:18:53.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 167187003 0 0) 0x7f6cc0003530 con 0x7f6cd80c6910 2023-10-14T09:18:53.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cd8153e80 msgr2=0x7f6cd806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:53.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cd8153e80 0x7f6cd806bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:53.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 >> v2:172.21.15.157:3300/0 conn(0x7f6cd814ddb0 msgr2=0x7f6cd80c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:53.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 --2- 172.21.15.78:0/1702769535 >> v2:172.21.15.157:3300/0 conn(0x7f6cd814ddb0 0x7f6cd80c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:53.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd806c750 con 0x7f6cd80c6910 2023-10-14T09:18:53.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f6cd0001a00 con 0x7f6cd80c6910 2023-10-14T09:18:53.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 >> v1:172.21.15.78:6789/0 conn(0x7f6cd80c6910 legacy=0x7f6cd80c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:53.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc0003980 0x7f6cc0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:53.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc00047d0 0x7f6cc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:53.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cd8153e80 0x7f6cc0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:53.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80c64f0 con 0x7f6cc00047d0 2023-10-14T09:18:53.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc000b990 con 0x7f6cc0003980 2023-10-14T09:18:53.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc000bb50 con 0x7f6cd8153e80 2023-10-14T09:18:53.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd77fe640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc00047d0 0x7f6cc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:53.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd7fff640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc0003980 0x7f6cc0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:53.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cdc8ac640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cd8153e80 0x7f6cc0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:53.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd77fe640 1 -- 172.21.15.78:0/1702769535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cd8153e80 msgr2=0x7f6cc0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:53.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd77fe640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cd8153e80 0x7f6cc0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:53.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd77fe640 1 -- 172.21.15.78:0/1702769535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc0003980 msgr2=0x7f6cc0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:53.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd77fe640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cc0003980 0x7f6cc0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:53.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.250+0000 7f6cd77fe640 1 -- 172.21.15.78:0/1702769535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc0003530 con 0x7f6cc00047d0 2023-10-14T09:18:53.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cd77fe640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc00047d0 0x7f6cc0004c50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009ab0 tx=0x7f6ccc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde9c19c43a880db server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:53.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0a55d0 con 0x7f6cc00047d0 2023-10-14T09:18:53.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc0a5730 con 0x7f6cc00047d0 2023-10-14T09:18:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cd6ffd640 1 -- 172.21.15.78:0/1702769535 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0a5ae0 con 0x7f6cc00047d0 2023-10-14T09:18:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 -- 172.21.15.78:0/1702769535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc00047d0 msgr2=0x7f6cc0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 --2- 172.21.15.78:0/1702769535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cc00047d0 0x7f6cc0004c50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009ab0 tx=0x7f6ccc01ca00 comp rx=0 tx=0).stop 2023-10-14T09:18:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cdc8ac640 1 -- 172.21.15.78:0/1702769535 reap_dead start 2023-10-14T09:18:53.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 -- 172.21.15.78:0/1702769535 shutdown_connections 2023-10-14T09:18:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 -- 172.21.15.78:0/1702769535 >> 172.21.15.78:0/1702769535 conn(0x7f6cd80ab1f0 msgr2=0x7f6cd80ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 -- 172.21.15.78:0/1702769535 shutdown_connections 2023-10-14T09:18:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 -- 172.21.15.78:0/1702769535 wait complete. 2023-10-14T09:18:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 Processor -- start 2023-10-14T09:18:53.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 -- start start 2023-10-14T09:18:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc00047d0 0x7f6cd80bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd8155770 0x7f6cd80c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd80c2750 0x7f6cd81ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80c0160 con 0x7f6cd8155770 2023-10-14T09:18:53.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd81561c0 con 0x7f6cd80c2750 2023-10-14T09:18:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.254+0000 7f6cde30f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd8155c00 con 0x7f6cc00047d0 2023-10-14T09:18:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd8155770 0x7f6cd80c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd8155770 0x7f6cd80c2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54192/0 (socket says 172.21.15.78:54192) 2023-10-14T09:18:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd77fe640 1 -- 172.21.15.78:0/3449613076 learned_addr learned my addr 172.21.15.78:0/3449613076 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:53.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd7fff640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc00047d0 0x7f6cd80bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cdc8ac640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd80c2750 0x7f6cd81ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd77fe640 1 -- 172.21.15.78:0/3449613076 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc00047d0 msgr2=0x7f6cd80bfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd77fe640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc00047d0 0x7f6cd80bfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd77fe640 1 -- 172.21.15.78:0/3449613076 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd80c2750 msgr2=0x7f6cd81ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:53.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd77fe640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd80c2750 0x7f6cd81ebfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd77fe640 1 -- 172.21.15.78:0/3449613076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd8155ee0 con 0x7f6cd8155770 2023-10-14T09:18:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cdc8ac640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd80c2750 0x7f6cd81ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd77fe640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd8155770 0x7f6cd80c2e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009ab0 tx=0x7f6cc0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd4ff9640 1 -- 172.21.15.78:0/3449613076 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0a55d0 con 0x7f6cd8155770 2023-10-14T09:18:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd4ff9640 1 -- 172.21.15.78:0/3449613076 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc004020 con 0x7f6cd8155770 2023-10-14T09:18:53.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd4ff9640 1 -- 172.21.15.78:0/3449613076 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc004390 con 0x7f6cd8155770 2023-10-14T09:18:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cde30f640 1 -- 172.21.15.78:0/3449613076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd80c1f50 con 0x7f6cd8155770 2023-10-14T09:18:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cde30f640 1 -- 172.21.15.78:0/3449613076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd81581f0 con 0x7f6cd8155770 2023-10-14T09:18:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cde30f640 1 -- 172.21.15.78:0/3449613076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd80c1db0 con 0x7f6cd8155770 2023-10-14T09:18:53.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.258+0000 7f6cd4ff9640 1 -- 172.21.15.78:0/3449613076 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6ccc0b4040 con 0x7f6cd8155770 2023-10-14T09:18:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.262+0000 7f6cd4ff9640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cc40664a0 0x7f6cc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.262+0000 7f6cd4ff9640 1 -- 172.21.15.78:0/3449613076 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6ccc11df00 con 0x7f6cd8155770 2023-10-14T09:18:53.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.262+0000 7f6cd7fff640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cc40664a0 0x7f6cc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.262+0000 7f6cd7fff640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cc40664a0 0x7f6cc4068960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009c60 tx=0x7f6cc8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:53.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.266+0000 7f6cd4ff9640 1 -- 172.21.15.78:0/3449613076 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6cd80c1db0 con 0x7f6cd8155770 2023-10-14T09:18:53.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cde30f640 1 -- 172.21.15.78:0/3449613076 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cd80c1db0 con 0x7f6cd8155770 2023-10-14T09:18:53.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cd4ff9640 1 -- 172.21.15.78:0/3449613076 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f6cd80c1db0 con 0x7f6cd8155770 2023-10-14T09:18:53.452 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:53.453 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:18:53.453 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:18:53.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cde30f640 1 -- 172.21.15.78:0/3449613076 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cc40664a0 msgr2=0x7f6cc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:53.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cde30f640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cc40664a0 0x7f6cc4068960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009c60 tx=0x7f6cc8009190 comp rx=0 tx=0).stop 2023-10-14T09:18:53.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cde30f640 1 -- 172.21.15.78:0/3449613076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd8155770 msgr2=0x7f6cd80c2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:53.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cde30f640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd8155770 0x7f6cd80c2e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009ab0 tx=0x7f6cc0005800 comp rx=0 tx=0).stop 2023-10-14T09:18:53.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cde30f640 1 -- 172.21.15.78:0/3449613076 shutdown_connections 2023-10-14T09:18:53.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cde30f640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6cd80c2750 0x7f6cd81ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:53.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cde30f640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cd8155770 0x7f6cd80c2e20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:53.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cde30f640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f6cc40664a0 0x7f6cc4068960 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:53.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cde30f640 1 --2- 172.21.15.78:0/3449613076 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6cc00047d0 0x7f6cd80bfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:53.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.446+0000 7f6cde30f640 1 -- 172.21.15.78:0/3449613076 >> 172.21.15.78:0/3449613076 conn(0x7f6cd80ab1f0 msgr2=0x7f6cd814c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:53.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.450+0000 7f6cde30f640 1 -- 172.21.15.78:0/3449613076 shutdown_connections 2023-10-14T09:18:53.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:53.450+0000 7f6cde30f640 1 -- 172.21.15.78:0/3449613076 wait complete. 2023-10-14T09:18:53.876 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T09:18:16.002036+0000', 'modified': '2023-10-14T09:18:19.017889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5109}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5109': {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T09:18:53.877 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T09:18:53.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T09:18:54.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc59d2d6640 1 Processor -- start 2023-10-14T09:18:54.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc59d2d6640 1 -- start start 2023-10-14T09:18:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc59d2d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc59814d920 0x7fc59806d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc59d2d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5980c3a30 0x7fc598153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc59d2d6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc59806dad0 0x7fc598153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc59d2d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5980a4cb0 con 0x7fc5980c3a30 2023-10-14T09:18:54.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc59d2d6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5980c45d0 con 0x7fc59806dad0 2023-10-14T09:18:54.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc59d2d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980a4ec0 con 0x7fc59814d920 2023-10-14T09:18:54.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc58ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5980c3a30 0x7fc598153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc58ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5980c3a30 0x7fc598153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54196/0 (socket says 172.21.15.78:54196) 2023-10-14T09:18:54.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc58ffff640 1 -- 172.21.15.78:0/959864285 learned_addr learned my addr 172.21.15.78:0/959864285 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc596ffd640 1 --2- 172.21.15.78:0/959864285 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc59814d920 0x7fc59806d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc5977fe640 1 --2- 172.21.15.78:0/959864285 >> v2:172.21.15.157:3300/0 conn(0x7fc59806dad0 0x7fc598153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc58ffff640 1 -- 172.21.15.78:0/959864285 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc59814d920 msgr2=0x7fc59806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc58ffff640 1 --2- 172.21.15.78:0/959864285 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc59814d920 0x7fc59806d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc58ffff640 1 -- 172.21.15.78:0/959864285 >> v2:172.21.15.157:3300/0 conn(0x7fc59806dad0 msgr2=0x7fc598153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:54.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc58ffff640 1 --2- 172.21.15.78:0/959864285 >> v2:172.21.15.157:3300/0 conn(0x7fc59806dad0 0x7fc598153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.014+0000 7fc58ffff640 1 -- 172.21.15.78:0/959864285 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5981504c0 con 0x7fc5980c3a30 2023-10-14T09:18:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc58ffff640 1 --2- 172.21.15.78:0/959864285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5980c3a30 0x7fc598153760 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc59806c1b0 tx=0x7fc58001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c525530e164d86c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc5967fc640 1 -- 172.21.15.78:0/959864285 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800ac410 con 0x7fc5980c3a30 2023-10-14T09:18:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc5967fc640 1 -- 172.21.15.78:0/959864285 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800ac570 con 0x7fc5980c3a30 2023-10-14T09:18:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc5967fc640 1 -- 172.21.15.78:0/959864285 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800ac900 con 0x7fc5980c3a30 2023-10-14T09:18:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc59d2d6640 1 -- 172.21.15.78:0/959864285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5980c3a30 msgr2=0x7fc598153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc59d2d6640 1 --2- 172.21.15.78:0/959864285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5980c3a30 0x7fc598153760 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc59806c1b0 tx=0x7fc58001c470 comp rx=0 tx=0).stop 2023-10-14T09:18:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc59d2d6640 1 -- 172.21.15.78:0/959864285 shutdown_connections 2023-10-14T09:18:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc59d2d6640 1 --2- 172.21.15.78:0/959864285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5980c3a30 0x7fc598153760 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc59d2d6640 1 --2- 172.21.15.78:0/959864285 >> v2:172.21.15.157:3300/0 conn(0x7fc59806dad0 0x7fc598153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc59d2d6640 1 --2- 172.21.15.78:0/959864285 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc59814d920 0x7fc59806d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc59d2d6640 1 -- 172.21.15.78:0/959864285 >> 172.21.15.78:0/959864285 conn(0x7fc5980c25b0 msgr2=0x7fc5980c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:54.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc59d2d6640 1 -- 172.21.15.78:0/959864285 shutdown_connections 2023-10-14T09:18:54.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.018+0000 7fc59d2d6640 1 -- 172.21.15.78:0/959864285 wait complete. 2023-10-14T09:18:54.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc59d2d6640 1 Processor -- start 2023-10-14T09:18:54.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc59d2d6640 1 -- start start 2023-10-14T09:18:54.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc59d2d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc59806dad0 0x7fc5981efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc59d2d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5980c3a30 0x7fc598071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc59d2d6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc59814d920 0x7fc59814a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc59d2d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc598149e10 con 0x7fc5980c3a30 2023-10-14T09:18:54.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc59d2d6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc598148970 con 0x7fc59814d920 2023-10-14T09:18:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc59d2d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5981480d0 con 0x7fc59806dad0 2023-10-14T09:18:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5980c3a30 0x7fc598071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5980c3a30 0x7fc598071d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54202/0 (socket says 172.21.15.78:54202) 2023-10-14T09:18:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58ffff640 1 -- 172.21.15.78:0/3382984423 learned_addr learned my addr 172.21.15.78:0/3382984423 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc596ffd640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc59806dad0 0x7fc5981efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc5977fe640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc59814d920 0x7fc59814a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58ffff640 1 -- 172.21.15.78:0/3382984423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc59806dad0 msgr2=0x7fc5981efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:54.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58ffff640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc59806dad0 0x7fc5981efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58ffff640 1 -- 172.21.15.78:0/3382984423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc59814d920 msgr2=0x7fc59814a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58ffff640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc59814d920 0x7fc59814a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58ffff640 1 -- 172.21.15.78:0/3382984423 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5800094d0 con 0x7fc5980c3a30 2023-10-14T09:18:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc5977fe640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc59814d920 0x7fc59814a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58ffff640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5980c3a30 0x7fc598071d20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc5800af040 tx=0x7fc580019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58f7fe640 1 -- 172.21.15.78:0/3382984423 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800ac410 con 0x7fc5980c3a30 2023-10-14T09:18:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58f7fe640 1 -- 172.21.15.78:0/3382984423 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800b65f0 con 0x7fc5980c3a30 2023-10-14T09:18:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc59d2d6640 1 -- 172.21.15.78:0/3382984423 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc598151120 con 0x7fc5980c3a30 2023-10-14T09:18:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc58f7fe640 1 -- 172.21.15.78:0/3382984423 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800b69a0 con 0x7fc5980c3a30 2023-10-14T09:18:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.022+0000 7fc59d2d6640 1 -- 172.21.15.78:0/3382984423 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc598148690 con 0x7fc5980c3a30 2023-10-14T09:18:54.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58f7fe640 1 -- 172.21.15.78:0/3382984423 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc5800b6b00 con 0x7fc5980c3a30 2023-10-14T09:18:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58f7fe640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5780664a0 0x7fc578068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58f7fe640 1 -- 172.21.15.78:0/3382984423 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fc58011e760 con 0x7fc5980c3a30 2023-10-14T09:18:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc596ffd640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5780664a0 0x7fc578068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc5a0650000 1 Processor -- start 2023-10-14T09:18:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc596ffd640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5780664a0 0x7fc578068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc588007940 tx=0x7fc588008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc5a0650000 1 -- start start 2023-10-14T09:18:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d387ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388530 0x55ca9d388910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388e50 0x55ca9d389230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc5a0650000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9d17fcc0 con 0x55ca9d388530 2023-10-14T09:18:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc5a0650000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9d1e2920 con 0x55ca9d3c5d70 2023-10-14T09:18:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc5a0650000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca9d1dfe50 con 0x55ca9d388e50 2023-10-14T09:18:54.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388530 0x55ca9d388910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388530 0x55ca9d388910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54212/0 (socket says 172.21.15.78:54212) 2023-10-14T09:18:54.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58ffff640 1 -- 172.21.15.78:0/1939815039 learned_addr learned my addr 172.21.15.78:0/1939815039 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:54.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc596ffd640 1 --2- 172.21.15.78:0/1939815039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d387ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc5977fe640 1 --2- 172.21.15.78:0/1939815039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388e50 0x55ca9d389230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58ffff640 1 -- 172.21.15.78:0/1939815039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388e50 msgr2=0x55ca9d389230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58ffff640 1 --2- 172.21.15.78:0/1939815039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388e50 0x55ca9d389230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58ffff640 1 -- 172.21.15.78:0/1939815039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 msgr2=0x55ca9d387ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58ffff640 1 --2- 172.21.15.78:0/1939815039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d387ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58ffff640 1 -- 172.21.15.78:0/1939815039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca9ced4890 con 0x55ca9d388530 2023-10-14T09:18:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.026+0000 7fc58ffff640 1 --2- 172.21.15.78:0/1939815039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388530 0x55ca9d388910 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc5800f7640 tx=0x7fc5800eff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f9dc6bf607c312 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc58cff9640 1 -- 172.21.15.78:0/1939815039 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5801071c0 con 0x55ca9d388530 2023-10-14T09:18:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc58cff9640 1 -- 172.21.15.78:0/1939815039 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800f39c0 con 0x55ca9d388530 2023-10-14T09:18:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc58cff9640 1 -- 172.21.15.78:0/1939815039 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800f7b70 con 0x55ca9d388530 2023-10-14T09:18:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 -- 172.21.15.78:0/1939815039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388530 msgr2=0x55ca9d388910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 --2- 172.21.15.78:0/1939815039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388530 0x55ca9d388910 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc5800f7640 tx=0x7fc5800eff70 comp rx=0 tx=0).stop 2023-10-14T09:18:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 -- 172.21.15.78:0/1939815039 shutdown_connections 2023-10-14T09:18:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 --2- 172.21.15.78:0/1939815039 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388e50 0x55ca9d389230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 --2- 172.21.15.78:0/1939815039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388530 0x55ca9d388910 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 --2- 172.21.15.78:0/1939815039 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d387ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 -- 172.21.15.78:0/1939815039 >> 172.21.15.78:0/1939815039 conn(0x55ca9d390c90 msgr2=0x55ca9d3c85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 -- 172.21.15.78:0/1939815039 shutdown_connections 2023-10-14T09:18:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 -- 172.21.15.78:0/1939815039 wait complete. 2023-10-14T09:18:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 -- start start 2023-10-14T09:18:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 Processor -- start 2023-10-14T09:18:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d388530 0x55ca9d38c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388e50 0x55ca9d38c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d3c5d70 0x55ca9d38cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9d1db740 con 0x55ca9d3c5d70 2023-10-14T09:18:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9d19ad10 con 0x55ca9d388530 2023-10-14T09:18:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca9d19a9b0 con 0x55ca9d388e50 2023-10-14T09:18:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 10 client.0 _ll_register_callbacks cb 0x55ca9d376390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5977fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d3c5d70 0x55ca9d38cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5977fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d3c5d70 0x55ca9d38cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54226/0 (socket says 172.21.15.78:54226) 2023-10-14T09:18:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5977fe640 1 -- 172.21.15.78:0/2905706062 learned_addr learned my addr 172.21.15.78:0/2905706062 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc596ffd640 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d388530 0x55ca9d38c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc58ffff640 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388e50 0x55ca9d38c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5977fe640 1 -- 172.21.15.78:0/2905706062 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388e50 msgr2=0x55ca9d38c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5977fe640 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388e50 0x55ca9d38c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5977fe640 1 -- 172.21.15.78:0/2905706062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d388530 msgr2=0x55ca9d38c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5977fe640 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d388530 0x55ca9d38c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5977fe640 1 -- 172.21.15.78:0/2905706062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc598148690 con 0x55ca9d3c5d70 2023-10-14T09:18:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5977fe640 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d3c5d70 0x55ca9d38cb20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc590007bb0 tx=0x7fc5900115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be5d74c2d9cbfe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc575ffb640 1 -- 172.21.15.78:0/2905706062 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590011c50 con 0x55ca9d3c5d70 2023-10-14T09:18:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc575ffb640 1 -- 172.21.15.78:0/2905706062 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fc590011db0 con 0x55ca9d3c5d70 2023-10-14T09:18:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.030+0000 7fc5a0650000 1 -- 172.21.15.78:0/2905706062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca9d18f370 con 0x55ca9d3c5d70 2023-10-14T09:18:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc575ffb640 1 -- 172.21.15.78:0/2905706062 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc590016450 con 0x55ca9d3c5d70 2023-10-14T09:18:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 10 client.5451 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 -- 172.21.15.78:0/2905706062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ca9d19d460 con 0x55ca9d3c5d70 2023-10-14T09:18:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc575ffb640 1 -- 172.21.15.78:0/2905706062 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca9d18f370 con 0x55ca9d3c5d70 2023-10-14T09:18:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc575ffb640 1 -- 172.21.15.78:0/2905706062 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fc590014070 con 0x55ca9d3c5d70 2023-10-14T09:18:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 10 client.5451 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 10 client.5451 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 20 client.5451 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55ca9d3da070 0x55ca9d3dc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 4 client.5451 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:18:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 -- 172.21.15.78:0/2905706062 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca9d1752d0 con 0x55ca9d3da070 2023-10-14T09:18:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc596ffd640 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55ca9d3da070 0x55ca9d3dc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc596ffd640 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55ca9d3da070 0x55ca9d3dc460 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6193fe6aeffb409 server_cookie=a58fa3005bf2e24 in_seq=0 out_seq=0 2023-10-14T09:18:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc575ffb640 10 client.5451 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:54.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc575ffb640 1 -- 172.21.15.78:0/2905706062 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ca9d1752d0 con 0x55ca9d3da070 2023-10-14T09:18:54.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc575ffb640 10 client.5451 handle_command_reply: tid=0 2023-10-14T09:18:54.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 client.5451 shutdown 2023-10-14T09:18:54.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 -- 172.21.15.78:0/2905706062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d3c5d70 msgr2=0x55ca9d38cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:54.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d3c5d70 0x55ca9d38cb20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc590007bb0 tx=0x7fc5900115a0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 -- 172.21.15.78:0/2905706062 shutdown_connections 2023-10-14T09:18:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55ca9d3da070 0x55ca9d3dc460 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d3c5d70 0x55ca9d38cb20 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388e50 0x55ca9d38c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 --2- 172.21.15.78:0/2905706062 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d388530 0x55ca9d38c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 -- 172.21.15.78:0/2905706062 >> 172.21.15.78:0/2905706062 conn(0x55ca9d390c90 msgr2=0x55ca9d3876e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc575ffb640 0 client.5451 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 -- 172.21.15.78:0/2905706062 shutdown_connections 2023-10-14T09:18:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 1 -- 172.21.15.78:0/2905706062 wait complete. 2023-10-14T09:18:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.034+0000 7fc5a0650000 20 client.5451 trim_cache size 0 max 16384 2023-10-14T09:18:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 Processor -- start 2023-10-14T09:18:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 -- start start 2023-10-14T09:18:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388530 0x55ca9d3de480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d38f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d3c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9ce95940 con 0x55ca9d388e50 2023-10-14T09:18:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9d1d8f50 con 0x55ca9d3c5d70 2023-10-14T09:18:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca9d1d9e10 con 0x55ca9d388530 2023-10-14T09:18:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d38f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d38f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54234/0 (socket says 172.21.15.78:54234) 2023-10-14T09:18:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58ffff640 1 -- 172.21.15.78:0/4015606853 learned_addr learned my addr 172.21.15.78:0/4015606853 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58ffff640 1 -- 172.21.15.78:0/4015606853 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388530 msgr2=0x55ca9d3de480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58ffff640 1 --2- 172.21.15.78:0/4015606853 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388530 0x55ca9d3de480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58ffff640 1 -- 172.21.15.78:0/4015606853 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 msgr2=0x55ca9d3c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58ffff640 1 --2- 172.21.15.78:0/4015606853 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d3c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58ffff640 1 -- 172.21.15.78:0/4015606853 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca9d183760 con 0x55ca9d388e50 2023-10-14T09:18:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58ffff640 1 --2- 172.21.15.78:0/4015606853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d38f400 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc5800f0120 tx=0x7fc5800f2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cadcf0c3b599f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58d7fa640 1 -- 172.21.15.78:0/4015606853 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58010c070 con 0x55ca9d388e50 2023-10-14T09:18:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58d7fa640 1 -- 172.21.15.78:0/4015606853 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800f39c0 con 0x55ca9d388e50 2023-10-14T09:18:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc58d7fa640 1 -- 172.21.15.78:0/4015606853 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800f7b70 con 0x55ca9d388e50 2023-10-14T09:18:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 -- 172.21.15.78:0/4015606853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 msgr2=0x55ca9d38f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 --2- 172.21.15.78:0/4015606853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d38f400 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc5800f0120 tx=0x7fc5800f2000 comp rx=0 tx=0).stop 2023-10-14T09:18:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 -- 172.21.15.78:0/4015606853 shutdown_connections 2023-10-14T09:18:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 --2- 172.21.15.78:0/4015606853 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d3c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 --2- 172.21.15.78:0/4015606853 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d38f400 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 --2- 172.21.15.78:0/4015606853 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388530 0x55ca9d3de480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 -- 172.21.15.78:0/4015606853 >> 172.21.15.78:0/4015606853 conn(0x55ca9d390c90 msgr2=0x55ca9d387b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:54.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 -- 172.21.15.78:0/4015606853 shutdown_connections 2023-10-14T09:18:54.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.050+0000 7fc5a0650000 1 -- 172.21.15.78:0/4015606853 wait complete. 2023-10-14T09:18:54.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 -- start start 2023-10-14T09:18:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 Processor -- start 2023-10-14T09:18:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388530 0x55ca9d427670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d427bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d3dcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9d1d8b40 con 0x55ca9d388e50 2023-10-14T09:18:54.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9d38cc90 con 0x55ca9d3c5d70 2023-10-14T09:18:54.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca9d1834a0 con 0x55ca9d388530 2023-10-14T09:18:54.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 10 client.0 _ll_register_callbacks cb 0x7fc5800ebbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:18:54.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc58ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d427bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc58ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d427bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54242/0 (socket says 172.21.15.78:54242) 2023-10-14T09:18:54.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc58ffff640 1 -- 172.21.15.78:0/1364873174 learned_addr learned my addr 172.21.15.78:0/1364873174 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:54.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5977fe640 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d3dcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc596ffd640 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388530 0x55ca9d427670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc58ffff640 1 -- 172.21.15.78:0/1364873174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388530 msgr2=0x55ca9d427670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:54.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc58ffff640 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388530 0x55ca9d427670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc58ffff640 1 -- 172.21.15.78:0/1364873174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 msgr2=0x55ca9d3dcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:18:54.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc58ffff640 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d3dcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc58ffff640 1 -- 172.21.15.78:0/1364873174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca9ced4890 con 0x55ca9d388e50 2023-10-14T09:18:54.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc596ffd640 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388530 0x55ca9d427670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:54.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5977fe640 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d3dcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:18:54.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc58ffff640 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d427bb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc58001cd10 tx=0x7fc580000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40c70b26947b791 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:54.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:18:54.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc575ffb640 1 -- 172.21.15.78:0/1364873174 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58010c070 con 0x55ca9d388e50 2023-10-14T09:18:54.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc575ffb640 1 -- 172.21.15.78:0/1364873174 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fc5800edc10 con 0x55ca9d388e50 2023-10-14T09:18:54.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 -- 172.21.15.78:0/1364873174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca9d3c88d0 con 0x55ca9d388e50 2023-10-14T09:18:54.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc575ffb640 1 -- 172.21.15.78:0/1364873174 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5800f76e0 con 0x55ca9d388e50 2023-10-14T09:18:54.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 10 client.5457 fetch_fsmap learned FSMap version 17 2023-10-14T09:18:54.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 -- 172.21.15.78:0/1364873174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ca9ced4cc0 con 0x55ca9d388e50 2023-10-14T09:18:54.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc575ffb640 1 -- 172.21.15.78:0/1364873174 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca9d3c88d0 con 0x55ca9d388e50 2023-10-14T09:18:54.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc575ffb640 1 -- 172.21.15.78:0/1364873174 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fc5800b3030 con 0x55ca9d388e50 2023-10-14T09:18:54.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 10 client.5457 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:18:54.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 10 client.5457 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:18:54.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 20 client.5457 populate_metadata read hostname 'smithi078' 2023-10-14T09:18:54.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55ca9d3dd610 0x55ca9d3dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:54.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 4 client.5457 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T09:18:54.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 -- 172.21.15.78:0/1364873174 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ca9d1736f0 con 0x55ca9d3dd610 2023-10-14T09:18:54.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc596ffd640 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55ca9d3dd610 0x55ca9d3dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:54.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc575ffb640 10 client.5457 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:54.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc596ffd640 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55ca9d3dd610 0x55ca9d3dd9f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75130f0e98388606 server_cookie=5e01bdec90b29489 in_seq=0 out_seq=0 2023-10-14T09:18:54.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc575ffb640 1 -- 172.21.15.78:0/1364873174 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x55ca9d1736f0 con 0x55ca9d3dd610 2023-10-14T09:18:54.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc575ffb640 10 client.5457 handle_command_reply: tid=0 2023-10-14T09:18:54.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.054+0000 7fc5a0650000 1 client.5457 shutdown 2023-10-14T09:18:54.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc5a0650000 1 -- 172.21.15.78:0/1364873174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 msgr2=0x55ca9d427bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:54.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc5a0650000 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d427bb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc58001cd10 tx=0x7fc580000bd0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc5a0650000 1 -- 172.21.15.78:0/1364873174 shutdown_connections 2023-10-14T09:18:54.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc5a0650000 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x55ca9d3dd610 0x55ca9d3dd9f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc5a0650000 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55ca9d3c5d70 0x55ca9d3dcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc5a0650000 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ca9d388e50 0x55ca9d427bb0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc575ffb640 0 client.5457 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:18:54.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc5a0650000 1 --2- 172.21.15.78:0/1364873174 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55ca9d388530 0x55ca9d427670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc5a0650000 1 -- 172.21.15.78:0/1364873174 >> 172.21.15.78:0/1364873174 conn(0x55ca9d390c90 msgr2=0x55ca9d38f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:54.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc5a0650000 1 -- 172.21.15.78:0/1364873174 shutdown_connections 2023-10-14T09:18:54.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc5a0650000 1 -- 172.21.15.78:0/1364873174 wait complete. 2023-10-14T09:18:54.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc5a0650000 20 client.5457 trim_cache size 0 max 16384 2023-10-14T09:18:54.085 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:18:54.086 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "1f80be0e-0937-433c-91b2-bf32e5285783", 2023-10-14T09:18:54.086 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-10-14T09:18:54.086 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5109, 2023-10-14T09:18:54.086 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-10-14T09:18:54.086 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-10-14T09:18:54.087 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "testcephfs1", 2023-10-14T09:18:54.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 37.430629324000002, 2023-10-14T09:18:54.087 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 17, 2023-10-14T09:18:54.087 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 32, 2023-10-14T09:18:54.087 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 32, 2023-10-14T09:18:54.088 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 45.294080913999998 2023-10-14T09:18:54.088 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:18:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 -- 172.21.15.78:0/3382984423 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5780664a0 msgr2=0x7fc578068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:54.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5780664a0 0x7fc578068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc588007940 tx=0x7fc588008040 comp rx=0 tx=0).stop 2023-10-14T09:18:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 -- 172.21.15.78:0/3382984423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5980c3a30 msgr2=0x7fc598071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5980c3a30 0x7fc598071d20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc5800af040 tx=0x7fc580019210 comp rx=0 tx=0).stop 2023-10-14T09:18:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 -- 172.21.15.78:0/3382984423 shutdown_connections 2023-10-14T09:18:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc59814d920 0x7fc59814a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5980c3a30 0x7fc598071d20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fc5780664a0 0x7fc578068960 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 --2- 172.21.15.78:0/3382984423 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc59806dad0 0x7fc5981efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 -- 172.21.15.78:0/3382984423 >> 172.21.15.78:0/3382984423 conn(0x7fc5980c25b0 msgr2=0x7fc59814f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 -- 172.21.15.78:0/3382984423 shutdown_connections 2023-10-14T09:18:54.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:54.058+0000 7fc59d2d6640 1 -- 172.21.15.78:0/3382984423 wait complete. 2023-10-14T09:18:54.092 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T09:18:16.002036+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5109": { "addr": "172.21.15.78:6837/4241140805", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6836", "nonce": 4241140805, "type": "v2" }, { "addr": "172.21.15.78:6837", "nonce": 4241140805, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5109, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T09:18:19.017889+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5109 } } } ], "standbys": [ { "addr": "172.21.15.157:6833/2822193022", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6832", "nonce": 2822193022, "type": "v2" }, { "addr": "172.21.15.157:6833", "nonce": 2822193022, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5002, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.157:6835/488302185", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6834", "nonce": 488302185, "type": "v2" }, { "addr": "172.21.15.157:6835", "nonce": 488302185, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5005, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.78:6835/3378161275", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6834", "nonce": 3378161275, "type": "v2" }, { "addr": "172.21.15.78:6835", "nonce": 3378161275, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5106, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T09:18:54.093 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': 2, 'name': 'b', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T09:18:54.093 INFO:tasks.cephfs.test_failover:current = [{'gid': 5106, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.78:6835/3378161275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3378161275}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3378161275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 5002, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6833/2822193022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6832', 'nonce': 2822193022}, {'type': 'v1', 'addr': '172.21.15.157:6833', 'nonce': 2822193022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 5005, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6835/488302185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 488302185}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 488302185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T09:18:54.094 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T09:18:54.094 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-10-14T09:18:55.424 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:18:55.428 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:18:59.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:18:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb31a4bb640 1 Processor -- start 2023-10-14T09:18:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb31a4bb640 1 -- start start 2023-10-14T09:18:59.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb31a4bb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3140be570 0x7fb3141549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb31a4bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3140bede0 con 0x7fb314157370 2023-10-14T09:18:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb31a4bb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3141578e0 con 0x7fb3140be950 2023-10-14T09:18:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb31a4bb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31406ffd0 con 0x7fb3140be570 2023-10-14T09:18:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb3137fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb314157370 0x7fb314071120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43000/0 (socket says 172.21.15.78:43000) 2023-10-14T09:18:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb3137fe640 1 -- 172.21.15.78:0/2537829762 learned_addr learned my addr 172.21.15.78:0/2537829762 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:18:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb313fff640 1 --2- 172.21.15.78:0/2537829762 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3140be570 0x7fb3141549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb312ffd640 1 -- 172.21.15.78:0/2537829762 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236957196 0 0) 0x7fb308001120 con 0x7fb314157370 2023-10-14T09:18:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb312ffd640 1 -- 172.21.15.78:0/2537829762 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2fc003530 con 0x7fb314157370 2023-10-14T09:18:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb312ffd640 1 -- 172.21.15.78:0/2537829762 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427774428 0 0) 0x7fb3141578e0 con 0x7fb3140be950 2023-10-14T09:18:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb312ffd640 1 -- 172.21.15.78:0/2537829762 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb308001120 con 0x7fb3140be950 2023-10-14T09:18:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb312ffd640 1 -- 172.21.15.78:0/2537829762 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3423732569 0 0) 0x7fb2fc003530 con 0x7fb314157370 2023-10-14T09:18:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb313fff640 1 -- 172.21.15.78:0/2537829762 >> v1:172.21.15.157:6789/0 conn(0x7fb3140be950 legacy=0x7fb314071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb313fff640 1 -- 172.21.15.78:0/2537829762 >> v1:172.21.15.78:6789/0 conn(0x7fb314157370 legacy=0x7fb314071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.238+0000 7fb313fff640 1 -- 172.21.15.78:0/2537829762 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314157bc0 con 0x7fb3140be570 2023-10-14T09:18:59.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.242+0000 7fb313fff640 1 --2- 172.21.15.78:0/2537829762 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3140be570 0x7fb3141549c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3040097f0 tx=0x7fb30401c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5ce56cc2413493d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:59.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.242+0000 7fb312ffd640 1 -- 172.21.15.78:0/2537829762 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308001810 con 0x7fb3140be570 2023-10-14T09:18:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.242+0000 7fb312ffd640 1 -- 172.21.15.78:0/2537829762 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3040a7050 con 0x7fb3140be570 2023-10-14T09:18:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.242+0000 7fb312ffd640 1 -- 172.21.15.78:0/2537829762 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040ab620 con 0x7fb3140be570 2023-10-14T09:18:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.242+0000 7fb31a4bb640 1 -- 172.21.15.78:0/2537829762 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3140be570 msgr2=0x7fb3141549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.242+0000 7fb31a4bb640 1 --2- 172.21.15.78:0/2537829762 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3140be570 0x7fb3141549c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3040097f0 tx=0x7fb30401c320 comp rx=0 tx=0).stop 2023-10-14T09:18:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.242+0000 7fb31a4bb640 1 -- 172.21.15.78:0/2537829762 shutdown_connections 2023-10-14T09:18:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.242+0000 7fb31a4bb640 1 --2- 172.21.15.78:0/2537829762 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3140be570 0x7fb3141549c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.242+0000 7fb31a4bb640 1 -- 172.21.15.78:0/2537829762 >> 172.21.15.78:0/2537829762 conn(0x7fb3140c1cc0 msgr2=0x7fb3140c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.242+0000 7fb31a4bb640 1 -- 172.21.15.78:0/2537829762 shutdown_connections 2023-10-14T09:18:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.242+0000 7fb31a4bb640 1 -- 172.21.15.78:0/2537829762 wait complete. 2023-10-14T09:18:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb31a4bb640 1 Processor -- start 2023-10-14T09:18:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb31a4bb640 1 -- start start 2023-10-14T09:18:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb31a4bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3140be570 0x7fb31413aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb31a4bb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3140be950 0x7fb314135e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb31a4bb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb314157370 0x7fb3141efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb31a4bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31413b420 con 0x7fb3140be570 2023-10-14T09:18:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb31a4bb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3141345a0 con 0x7fb3140be950 2023-10-14T09:18:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb31a4bb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb314133fe0 con 0x7fb314157370 2023-10-14T09:18:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb313fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3140be570 0x7fb31413aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb313fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3140be570 0x7fb31413aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47052/0 (socket says 172.21.15.78:47052) 2023-10-14T09:18:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb313fff640 1 -- 172.21.15.78:0/3608837571 learned_addr learned my addr 172.21.15.78:0/3608837571 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:18:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb313fff640 1 -- 172.21.15.78:0/3608837571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb314157370 msgr2=0x7fb3141efd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb313fff640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb314157370 0x7fb3141efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb313fff640 1 -- 172.21.15.78:0/3608837571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3140be950 msgr2=0x7fb314135e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb313fff640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3140be950 0x7fb314135e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb313fff640 1 -- 172.21.15.78:0/3608837571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304009420 con 0x7fb3140be570 2023-10-14T09:18:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb313fff640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3140be570 0x7fb31413aee0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb3040ae040 tx=0x7fb30401ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb310ff9640 1 -- 172.21.15.78:0/3608837571 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040abcd0 con 0x7fb3140be570 2023-10-14T09:18:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb310ff9640 1 -- 172.21.15.78:0/3608837571 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3040abe50 con 0x7fb3140be570 2023-10-14T09:18:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb310ff9640 1 -- 172.21.15.78:0/3608837571 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304004260 con 0x7fb3140be570 2023-10-14T09:18:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb31a4bb640 1 -- 172.21.15.78:0/3608837571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3141342c0 con 0x7fb3140be570 2023-10-14T09:18:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.246+0000 7fb31a4bb640 1 -- 172.21.15.78:0/3608837571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3141ef7f0 con 0x7fb3140be570 2023-10-14T09:18:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.250+0000 7fb31a4bb640 1 -- 172.21.15.78:0/3608837571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb314074180 con 0x7fb3140be570 2023-10-14T09:18:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.250+0000 7fb310ff9640 1 -- 172.21.15.78:0/3608837571 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb3040043c0 con 0x7fb3140be570 2023-10-14T09:18:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.250+0000 7fb310ff9640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb3000664a0 0x7fb300068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:18:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.250+0000 7fb310ff9640 1 -- 172.21.15.78:0/3608837571 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb30411e530 con 0x7fb3140be570 2023-10-14T09:18:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.250+0000 7fb3137fe640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb3000664a0 0x7fb300068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:18:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.250+0000 7fb3137fe640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb3000664a0 0x7fb300068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb308001380 tx=0x7fb3080013d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:18:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.254+0000 7fb310ff9640 1 -- 172.21.15.78:0/3608837571 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb3040ebaa0 con 0x7fb3140be570 2023-10-14T09:18:59.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.438+0000 7fb31a4bb640 1 -- 172.21.15.78:0/3608837571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb31415f4f0 con 0x7fb3140be570 2023-10-14T09:18:59.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.438+0000 7fb310ff9640 1 -- 172.21.15.78:0/3608837571 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fb3040bfe90 con 0x7fb3140be570 2023-10-14T09:18:59.446 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:18:59.446 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:18:59.447 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:18:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 -- 172.21.15.78:0/3608837571 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb3000664a0 msgr2=0x7fb300068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb3000664a0 0x7fb300068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb308001380 tx=0x7fb3080013d0 comp rx=0 tx=0).stop 2023-10-14T09:18:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 -- 172.21.15.78:0/3608837571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3140be570 msgr2=0x7fb31413aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:18:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3140be570 0x7fb31413aee0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb3040ae040 tx=0x7fb30401ab60 comp rx=0 tx=0).stop 2023-10-14T09:18:59.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 -- 172.21.15.78:0/3608837571 shutdown_connections 2023-10-14T09:18:59.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb3000664a0 0x7fb300068960 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:59.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb314157370 0x7fb3141efd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:59.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3140be950 0x7fb314135e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:59.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 --2- 172.21.15.78:0/3608837571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3140be570 0x7fb31413aee0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:18:59.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 -- 172.21.15.78:0/3608837571 >> 172.21.15.78:0/3608837571 conn(0x7fb3140c1cc0 msgr2=0x7fb314151bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:18:59.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 -- 172.21.15.78:0/3608837571 shutdown_connections 2023-10-14T09:18:59.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:18:59.442+0000 7fb31a4bb640 1 -- 172.21.15.78:0/3608837571 wait complete. 2023-10-14T09:18:59.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T09:18:16.002036+0000', 'modified': '2023-10-14T09:18:19.017889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5109}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5109': {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T09:18:59.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T09:18:59.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T09:19:00.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.002+0000 7fb24f079640 1 Processor -- start 2023-10-14T09:19:00.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.002+0000 7fb24f079640 1 -- start start 2023-10-14T09:19:00.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.002+0000 7fb24f079640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb2480c1e20 0x7fb248150c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.002+0000 7fb24f079640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb248154940 con 0x7fb2480c6ff0 2023-10-14T09:19:00.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.002+0000 7fb24f079640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb248154c20 con 0x7fb2480c7a70 2023-10-14T09:19:00.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.002+0000 7fb24f079640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24806ce80 con 0x7fb2480c1e20 2023-10-14T09:19:00.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.002+0000 7fb24d616640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb2480c6ff0 0x7fb2481511c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43002/0 (socket says 172.21.15.78:43002) 2023-10-14T09:19:00.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.002+0000 7fb24d616640 1 -- 172.21.15.78:0/4126504821 learned_addr learned my addr 172.21.15.78:0/4126504821 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:00.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb247fff640 1 --2- 172.21.15.78:0/4126504821 >> v2:172.21.15.157:3300/0 conn(0x7fb2480c1e20 0x7fb248150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893911777 0 0) 0x7fb248154940 con 0x7fb2480c6ff0 2023-10-14T09:19:00.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb238003530 con 0x7fb2480c6ff0 2023-10-14T09:19:00.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3865592356 0 0) 0x7fb238003530 con 0x7fb2480c6ff0 2023-10-14T09:19:00.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 >> v2:172.21.15.157:3300/0 conn(0x7fb2480c1e20 msgr2=0x7fb248150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 --2- 172.21.15.78:0/4126504821 >> v2:172.21.15.157:3300/0 conn(0x7fb2480c1e20 0x7fb248150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 >> v1:172.21.15.157:6789/0 conn(0x7fb2480c7a70 legacy=0x7fb2480c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24806f740 con 0x7fb2480c6ff0 2023-10-14T09:19:00.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7fb240001a00 con 0x7fb2480c6ff0 2023-10-14T09:19:00.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 >> v1:172.21.15.78:6789/0 conn(0x7fb2480c6ff0 legacy=0x7fb2481511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb238003980 0x7fb238003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2380047d0 0x7fb238004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb238005190 0x7fb23800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24806ce80 con 0x7fb238005190 2023-10-14T09:19:00.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23800c130 con 0x7fb2380047d0 2023-10-14T09:19:00.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23800c2f0 con 0x7fb238003980 2023-10-14T09:19:00.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb24d616640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb238005190 0x7fb23800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb247fff640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2380047d0 0x7fb238004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb24ce15640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb238003980 0x7fb238003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb24d616640 1 -- 172.21.15.78:0/4126504821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb238003980 msgr2=0x7fb238003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb24d616640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb238003980 0x7fb238003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb24d616640 1 -- 172.21.15.78:0/4126504821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2380047d0 msgr2=0x7fb238004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb24d616640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2380047d0 0x7fb238004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb24d616640 1 -- 172.21.15.78:0/4126504821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238003530 con 0x7fb238005190 2023-10-14T09:19:00.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.006+0000 7fb24ce15640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb238003980 0x7fb238003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:00.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24d616640 1 -- 172.21.15.78:0/4126504821 reap_dead start 2023-10-14T09:19:00.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24d616640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb238005190 0x7fb23800b990 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb24000a830 tx=0x7fb24001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0b25cea59455d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400aa6d0 con 0x7fb238005190 2023-10-14T09:19:00.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2400aa870 con 0x7fb238005190 2023-10-14T09:19:00.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb2477fe640 1 -- 172.21.15.78:0/4126504821 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400aac20 con 0x7fb238005190 2023-10-14T09:19:00.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 -- 172.21.15.78:0/4126504821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb238005190 msgr2=0x7fb23800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb238005190 0x7fb23800b990 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb24000a830 tx=0x7fb24001faa0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 -- 172.21.15.78:0/4126504821 shutdown_connections 2023-10-14T09:19:00.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 --2- 172.21.15.78:0/4126504821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb238005190 0x7fb23800b990 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 -- 172.21.15.78:0/4126504821 >> 172.21.15.78:0/4126504821 conn(0x7fb24806a060 msgr2=0x7fb24806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:00.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 -- 172.21.15.78:0/4126504821 shutdown_connections 2023-10-14T09:19:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 -- 172.21.15.78:0/4126504821 wait complete. 2023-10-14T09:19:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 Processor -- start 2023-10-14T09:19:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 -- start start 2023-10-14T09:19:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb238005190 0x7fb2481e8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2481ea4d0 0x7fb248157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2480c1700 0x7fb2481562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb248155e30 con 0x7fb2481ea4d0 2023-10-14T09:19:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb248155220 con 0x7fb2480c1700 2023-10-14T09:19:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.010+0000 7fb24f079640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb248155500 con 0x7fb238005190 2023-10-14T09:19:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb247fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2481ea4d0 0x7fb248157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb247fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2481ea4d0 0x7fb248157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47062/0 (socket says 172.21.15.78:47062) 2023-10-14T09:19:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb247fff640 1 -- 172.21.15.78:0/3744779950 learned_addr learned my addr 172.21.15.78:0/3744779950 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb24ce15640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb238005190 0x7fb2481e8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb24d616640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2480c1700 0x7fb2481562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb247fff640 1 -- 172.21.15.78:0/3744779950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb238005190 msgr2=0x7fb2481e8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb247fff640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb238005190 0x7fb2481e8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb247fff640 1 -- 172.21.15.78:0/3744779950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2480c1700 msgr2=0x7fb2481562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb247fff640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2480c1700 0x7fb2481562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb247fff640 1 -- 172.21.15.78:0/3744779950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2481557e0 con 0x7fb2481ea4d0 2023-10-14T09:19:00.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb24d616640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2480c1700 0x7fb2481562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:19:00.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb247fff640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2481ea4d0 0x7fb248157940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb234011960 tx=0x7fb234011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb2457fa640 1 -- 172.21.15.78:0/3744779950 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23400faf0 con 0x7fb2481ea4d0 2023-10-14T09:19:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb2457fa640 1 -- 172.21.15.78:0/3744779950 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23400fc50 con 0x7fb2481ea4d0 2023-10-14T09:19:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb24f079640 1 -- 172.21.15.78:0/3744779950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb248155ac0 con 0x7fb2481ea4d0 2023-10-14T09:19:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb2457fa640 1 -- 172.21.15.78:0/3744779950 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234014440 con 0x7fb2481ea4d0 2023-10-14T09:19:00.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb24f079640 1 -- 172.21.15.78:0/3744779950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24814daf0 con 0x7fb2481ea4d0 2023-10-14T09:19:00.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb2457fa640 1 -- 172.21.15.78:0/3744779950 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb2340145a0 con 0x7fb2481ea4d0 2023-10-14T09:19:00.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.014+0000 7fb2457fa640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb22c0664a0 0x7fb22c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb2457fa640 1 -- 172.21.15.78:0/3744779950 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb234084700 con 0x7fb2481ea4d0 2023-10-14T09:19:00.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24ce15640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb22c0664a0 0x7fb22c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 Processor -- start 2023-10-14T09:19:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 -- start start 2023-10-14T09:19:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24ce15640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb22c0664a0 0x7fb22c068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb23c000c10 tx=0x7fb23c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c11fd70 0x558f8c0e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c0e2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c0e3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8bed9cc0 con 0x558f8c0e2e50 2023-10-14T09:19:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8bf3c920 con 0x558f8c0e2530 2023-10-14T09:19:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f8bf39e50 con 0x558f8c11fd70 2023-10-14T09:19:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24d616640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c0e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24ce15640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c11fd70 0x558f8c0e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24d616640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c0e3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47064/0 (socket says 172.21.15.78:47064) 2023-10-14T09:19:00.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24d616640 1 -- 172.21.15.78:0/771533989 learned_addr learned my addr 172.21.15.78:0/771533989 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:00.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb247fff640 1 --2- 172.21.15.78:0/771533989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c0e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24ce15640 1 -- 172.21.15.78:0/771533989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 msgr2=0x558f8c0e2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24ce15640 1 --2- 172.21.15.78:0/771533989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c0e2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24ce15640 1 -- 172.21.15.78:0/771533989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 msgr2=0x558f8c0e3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24ce15640 1 --2- 172.21.15.78:0/771533989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c0e3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24ce15640 1 -- 172.21.15.78:0/771533989 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f8bc2e890 con 0x558f8c11fd70 2023-10-14T09:19:00.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24d616640 1 --2- 172.21.15.78:0/771533989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c0e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:19:00.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb24ce15640 1 --2- 172.21.15.78:0/771533989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c11fd70 0x558f8c0e1ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb23c001410 tx=0x7fb23c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9477a2bc22dda22d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb2327fc640 1 -- 172.21.15.78:0/771533989 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c014600 con 0x558f8c11fd70 2023-10-14T09:19:00.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb2327fc640 1 -- 172.21.15.78:0/771533989 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c014760 con 0x558f8c11fd70 2023-10-14T09:19:00.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb2327fc640 1 -- 172.21.15.78:0/771533989 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c014ad0 con 0x558f8c11fd70 2023-10-14T09:19:00.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 -- 172.21.15.78:0/771533989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c11fd70 msgr2=0x558f8c0e1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 --2- 172.21.15.78:0/771533989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c11fd70 0x558f8c0e1ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb23c001410 tx=0x7fb23c013000 comp rx=0 tx=0).stop 2023-10-14T09:19:00.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 -- 172.21.15.78:0/771533989 shutdown_connections 2023-10-14T09:19:00.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 --2- 172.21.15.78:0/771533989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c0e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 --2- 172.21.15.78:0/771533989 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c0e2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 --2- 172.21.15.78:0/771533989 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c11fd70 0x558f8c0e1ff0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 -- 172.21.15.78:0/771533989 >> 172.21.15.78:0/771533989 conn(0x558f8c0eac90 msgr2=0x558f8c1225c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:00.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 -- 172.21.15.78:0/771533989 shutdown_connections 2023-10-14T09:19:00.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.018+0000 7fb252407000 1 -- 172.21.15.78:0/771533989 wait complete. 2023-10-14T09:19:00.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 -- start start 2023-10-14T09:19:00.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 Processor -- start 2023-10-14T09:19:00.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c0e2530 0x558f8c11e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2e50 0x558f8c11eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c0e5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8bf35740 con 0x558f8c11fd70 2023-10-14T09:19:00.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8bef4d10 con 0x558f8c0e2e50 2023-10-14T09:19:00.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f8bef49b0 con 0x558f8c0e2530 2023-10-14T09:19:00.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 10 client.0 _ll_register_callbacks cb 0x558f8c0d0390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:19:00.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb24d616640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c0e5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb24d616640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c0e5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47072/0 (socket says 172.21.15.78:47072) 2023-10-14T09:19:00.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb24d616640 1 -- 172.21.15.78:0/1785747716 learned_addr learned my addr 172.21.15.78:0/1785747716 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:00.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb24ce15640 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c0e2530 0x558f8c11e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb247fff640 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2e50 0x558f8c11eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb24d616640 1 -- 172.21.15.78:0/1785747716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c0e2530 msgr2=0x558f8c11e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb24d616640 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c0e2530 0x558f8c11e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb24d616640 1 -- 172.21.15.78:0/1785747716 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2e50 msgr2=0x558f8c11eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb24d616640 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2e50 0x558f8c11eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb24d616640 1 -- 172.21.15.78:0/1785747716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb238003530 con 0x558f8c11fd70 2023-10-14T09:19:00.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb24d616640 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c0e5a60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb24009c1e0 tx=0x7fb24001c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1dc7f4e1ee469c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb2277fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:19:00.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb2277fe640 1 -- 172.21.15.78:0/1785747716 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400019c0 con 0x558f8c11fd70 2023-10-14T09:19:00.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 -- 172.21.15.78:0/1785747716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f8bee9370 con 0x558f8c11fd70 2023-10-14T09:19:00.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb2277fe640 1 -- 172.21.15.78:0/1785747716 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb240001b20 con 0x558f8c11fd70 2023-10-14T09:19:00.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb2277fe640 1 -- 172.21.15.78:0/1785747716 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2400aa9e0 con 0x558f8c11fd70 2023-10-14T09:19:00.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 10 client.5475 fetch_fsmap learned FSMap version 17 2023-10-14T09:19:00.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 -- 172.21.15.78:0/1785747716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7fb23c00f040 con 0x558f8c11fd70 2023-10-14T09:19:00.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb2277fe640 1 -- 172.21.15.78:0/1785747716 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558f8bee9370 con 0x558f8c11fd70 2023-10-14T09:19:00.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb2277fe640 1 -- 172.21.15.78:0/1785747716 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fb2400bc040 con 0x558f8c11fd70 2023-10-14T09:19:00.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 10 client.5475 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:19:00.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 10 client.5475 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:19:00.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 20 client.5475 populate_metadata read hostname 'smithi078' 2023-10-14T09:19:00.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x558f8c0e67d0 0x558f8c0e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 4 client.5475 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:19:00.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb252407000 1 -- 172.21.15.78:0/1785747716 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f8becf2d0 con 0x558f8c0e67d0 2023-10-14T09:19:00.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.022+0000 7fb24ce15640 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x558f8c0e67d0 0x558f8c0e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb24ce15640 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x558f8c0e67d0 0x558f8c0e6bb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5283c077c59465ed server_cookie=c7f7c77398b31f7e in_seq=0 out_seq=0 2023-10-14T09:19:00.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb2277fe640 10 client.5475 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:19:00.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb2277fe640 1 -- 172.21.15.78:0/1785747716 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558f8becf2d0 con 0x558f8c0e67d0 2023-10-14T09:19:00.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb2277fe640 10 client.5475 handle_command_reply: tid=0 2023-10-14T09:19:00.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 1 client.5475 shutdown 2023-10-14T09:19:00.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 1 -- 172.21.15.78:0/1785747716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 msgr2=0x558f8c0e5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c0e5a60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb24009c1e0 tx=0x7fb24001c840 comp rx=0 tx=0).stop 2023-10-14T09:19:00.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 1 -- 172.21.15.78:0/1785747716 shutdown_connections 2023-10-14T09:19:00.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x558f8c0e67d0 0x558f8c0e6bb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c0e5a60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2e50 0x558f8c11eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb2277fe640 0 client.5475 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:19:00.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 1 --2- 172.21.15.78:0/1785747716 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c0e2530 0x558f8c11e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 1 -- 172.21.15.78:0/1785747716 >> 172.21.15.78:0/1785747716 conn(0x558f8c0eac90 msgr2=0x558f8c0e16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:00.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 1 -- 172.21.15.78:0/1785747716 shutdown_connections 2023-10-14T09:19:00.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 1 -- 172.21.15.78:0/1785747716 wait complete. 2023-10-14T09:19:00.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.026+0000 7fb252407000 20 client.5475 trim_cache size 0 max 16384 2023-10-14T09:19:00.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 Processor -- start 2023-10-14T09:19:00.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 -- start start 2023-10-14T09:19:00.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c136dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c137310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c11fd70 0x558f8c137850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8bbef940 con 0x558f8c0e2e50 2023-10-14T09:19:00.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8bf0ba10 con 0x558f8c0e2530 2023-10-14T09:19:00.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f8bef1aa0 con 0x558f8c11fd70 2023-10-14T09:19:00.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb247fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c137310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb247fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c137310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47084/0 (socket says 172.21.15.78:47084) 2023-10-14T09:19:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb247fff640 1 -- 172.21.15.78:0/2186111384 learned_addr learned my addr 172.21.15.78:0/2186111384 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb247fff640 1 -- 172.21.15.78:0/2186111384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c11fd70 msgr2=0x558f8c137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb247fff640 1 --2- 172.21.15.78:0/2186111384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c11fd70 0x558f8c137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb247fff640 1 -- 172.21.15.78:0/2186111384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 msgr2=0x558f8c136dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb247fff640 1 --2- 172.21.15.78:0/2186111384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c136dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb247fff640 1 -- 172.21.15.78:0/2186111384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f8bef7460 con 0x558f8c0e2e50 2023-10-14T09:19:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb247fff640 1 --2- 172.21.15.78:0/2186111384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c137310 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb234055750 tx=0x7fb234051bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d687d56188f113 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb232ffd640 1 -- 172.21.15.78:0/2186111384 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234080070 con 0x558f8c0e2e50 2023-10-14T09:19:00.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb232ffd640 1 -- 172.21.15.78:0/2186111384 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23405db10 con 0x558f8c0e2e50 2023-10-14T09:19:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb232ffd640 1 -- 172.21.15.78:0/2186111384 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234053bb0 con 0x558f8c0e2e50 2023-10-14T09:19:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 -- 172.21.15.78:0/2186111384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 msgr2=0x558f8c137310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 --2- 172.21.15.78:0/2186111384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c137310 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb234055750 tx=0x7fb234051bd0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 -- 172.21.15.78:0/2186111384 shutdown_connections 2023-10-14T09:19:00.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 --2- 172.21.15.78:0/2186111384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c11fd70 0x558f8c137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 --2- 172.21.15.78:0/2186111384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c0e2e50 0x558f8c137310 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 --2- 172.21.15.78:0/2186111384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c136dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 -- 172.21.15.78:0/2186111384 >> 172.21.15.78:0/2186111384 conn(0x558f8c0eac90 msgr2=0x558f8c0e0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 -- 172.21.15.78:0/2186111384 shutdown_connections 2023-10-14T09:19:00.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 -- 172.21.15.78:0/2186111384 wait complete. 2023-10-14T09:19:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.042+0000 7fb252407000 1 -- start start 2023-10-14T09:19:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 Processor -- start 2023-10-14T09:19:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c0e2e50 0x558f8c150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c151130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8c11f6a0 con 0x558f8c11fd70 2023-10-14T09:19:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8bff3570 con 0x558f8c0e2530 2023-10-14T09:19:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f8bf8bcf0 con 0x558f8c0e2e50 2023-10-14T09:19:00.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 10 client.0 _ll_register_callbacks cb 0x7fb23c005170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:19:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24d616640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24d616640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47088/0 (socket says 172.21.15.78:47088) 2023-10-14T09:19:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24d616640 1 -- 172.21.15.78:0/1865163044 learned_addr learned my addr 172.21.15.78:0/1865163044 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24ce15640 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb247fff640 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c0e2e50 0x558f8c150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24d616640 1 -- 172.21.15.78:0/1865163044 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c0e2e50 msgr2=0x558f8c150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24d616640 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c0e2e50 0x558f8c150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24d616640 1 -- 172.21.15.78:0/1865163044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 msgr2=0x558f8c1506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24d616640 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c1506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24d616640 1 -- 172.21.15.78:0/1865163044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24814daf0 con 0x558f8c11fd70 2023-10-14T09:19:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb247fff640 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c0e2e50 0x558f8c150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24ce15640 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24d616640 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c151130 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb24001e320 tx=0x7fb238005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777bfc02fbce24ac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb2277fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-10-14T09:19:00.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb2277fe640 1 -- 172.21.15.78:0/1865163044 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24000a5f0 con 0x558f8c11fd70 2023-10-14T09:19:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 -- 172.21.15.78:0/1865163044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f8becd6f0 con 0x558f8c11fd70 2023-10-14T09:19:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb2277fe640 1 -- 172.21.15.78:0/1865163044 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb2400aad30 con 0x558f8c11fd70 2023-10-14T09:19:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb2277fe640 1 -- 172.21.15.78:0/1865163044 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2400aa9e0 con 0x558f8c11fd70 2023-10-14T09:19:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 10 client.5481 fetch_fsmap learned FSMap version 17 2023-10-14T09:19:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 -- 172.21.15.78:0/1865163044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558f8bedd760 con 0x558f8c11fd70 2023-10-14T09:19:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb2277fe640 1 -- 172.21.15.78:0/1865163044 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558f8becd6f0 con 0x558f8c11fd70 2023-10-14T09:19:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb2277fe640 1 -- 172.21.15.78:0/1865163044 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fb2400bc030 con 0x558f8c11fd70 2023-10-14T09:19:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 10 client.5481 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T09:19:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 10 client.5481 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T09:19:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 20 client.5481 populate_metadata read hostname 'smithi078' 2023-10-14T09:19:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x558f8c192aa0 0x558f8c194e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 4 client.5481 mds_command: new command op to 5109 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T09:19:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 -- 172.21.15.78:0/1865163044 --> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558f8bf2e720 con 0x558f8c192aa0 2023-10-14T09:19:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24ce15640 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x558f8c192aa0 0x558f8c194e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb24ce15640 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x558f8c192aa0 0x558f8c194e90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c8f578d7b3e0c88 server_cookie=1949530654aeaef8 in_seq=0 out_seq=0 2023-10-14T09:19:00.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb2277fe640 10 client.5481 ms_handle_connect on v2:172.21.15.78:6836/4241140805 2023-10-14T09:19:00.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb2277fe640 1 -- 172.21.15.78:0/1865163044 <== mds.0 v2:172.21.15.78:6836/4241140805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+336 (crc 0 0 0) 0x558f8bf2e720 con 0x558f8c192aa0 2023-10-14T09:19:00.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb2277fe640 10 client.5481 handle_command_reply: tid=0 2023-10-14T09:19:00.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 client.5481 shutdown 2023-10-14T09:19:00.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 -- 172.21.15.78:0/1865163044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 msgr2=0x558f8c151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.046+0000 7fb252407000 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c151130 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb24001e320 tx=0x7fb238005800 comp rx=0 tx=0).stop 2023-10-14T09:19:00.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb252407000 1 -- 172.21.15.78:0/1865163044 shutdown_connections 2023-10-14T09:19:00.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb252407000 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.78:6836/4241140805,v1:172.21.15.78:6837/4241140805] conn(0x558f8c192aa0 0x558f8c194e90 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb252407000 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558f8c11fd70 0x558f8c151130 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb2277fe640 0 client.5481 ms_handle_reset on v2:172.21.15.78:6836/4241140805 2023-10-14T09:19:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb252407000 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x558f8c0e2e50 0x558f8c150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb252407000 1 --2- 172.21.15.78:0/1865163044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x558f8c0e2530 0x558f8c1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb252407000 1 -- 172.21.15.78:0/1865163044 >> 172.21.15.78:0/1865163044 conn(0x558f8c0eac90 msgr2=0x558f8c0e0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb252407000 1 -- 172.21.15.78:0/1865163044 shutdown_connections 2023-10-14T09:19:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb252407000 1 -- 172.21.15.78:0/1865163044 wait complete. 2023-10-14T09:19:00.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb252407000 20 client.5481 trim_cache size 0 max 16384 2023-10-14T09:19:00.076 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:19:00.076 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "1f80be0e-0937-433c-91b2-bf32e5285783", 2023-10-14T09:19:00.077 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-10-14T09:19:00.077 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5109, 2023-10-14T09:19:00.077 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-10-14T09:19:00.078 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-10-14T09:19:00.078 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "testcephfs1", 2023-10-14T09:19:00.078 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 43.422495177999998, 2023-10-14T09:19:00.078 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 17, 2023-10-14T09:19:00.079 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 32, 2023-10-14T09:19:00.079 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 32, 2023-10-14T09:19:00.079 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 51.285947106000002 2023-10-14T09:19:00.079 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:19:00.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 -- 172.21.15.78:0/3744779950 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb22c0664a0 msgr2=0x7fb22c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb22c0664a0 0x7fb22c068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb23c000c10 tx=0x7fb23c009040 comp rx=0 tx=0).stop 2023-10-14T09:19:00.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 -- 172.21.15.78:0/3744779950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2481ea4d0 msgr2=0x7fb248157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2481ea4d0 0x7fb248157940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb234011960 tx=0x7fb234011e20 comp rx=0 tx=0).stop 2023-10-14T09:19:00.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 -- 172.21.15.78:0/3744779950 shutdown_connections 2023-10-14T09:19:00.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2480c1700 0x7fb2481562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2481ea4d0 0x7fb248157940 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb22c0664a0 0x7fb22c068960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 --2- 172.21.15.78:0/3744779950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb238005190 0x7fb2481e8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 -- 172.21.15.78:0/3744779950 >> 172.21.15.78:0/3744779950 conn(0x7fb24806a060 msgr2=0x7fb2480c5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:00.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 -- 172.21.15.78:0/3744779950 shutdown_connections 2023-10-14T09:19:00.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.050+0000 7fb24f079640 1 -- 172.21.15.78:0/3744779950 wait complete. 2023-10-14T09:19:00.083 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-10-14T09:18:16.002036+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "testcephfs1", "in": [ 0 ], "info": { "gid_5109": { "addr": "172.21.15.78:6837/4241140805", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6836", "nonce": 4241140805, "type": "v2" }, { "addr": "172.21.15.78:6837", "nonce": 4241140805, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5109, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2023-10-14T09:18:19.017889+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5109 } } } ], "standbys": [ { "addr": "172.21.15.157:6833/2822193022", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6832", "nonce": 2822193022, "type": "v2" }, { "addr": "172.21.15.157:6833", "nonce": 2822193022, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5002, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.157:6835/488302185", "addrs": { "addrvec": [ { "addr": "172.21.15.157:6834", "nonce": 488302185, "type": "v2" }, { "addr": "172.21.15.157:6835", "nonce": 488302185, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5005, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.78:6835/3378161275", "addrs": { "addrvec": [ { "addr": "172.21.15.78:6834", "nonce": 3378161275, "type": "v2" }, { "addr": "172.21.15.78:6835", "nonce": 3378161275, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5106, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-10-14T09:19:00.085 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': 2, 'name': 'b', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-10-14T09:19:00.085 INFO:tasks.cephfs.test_failover:current = [{'gid': 5106, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.78:6835/3378161275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3378161275}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3378161275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}, {'gid': 5002, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6833/2822193022', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6832', 'nonce': 2822193022}, {'type': 'v1', 'addr': '172.21.15.157:6833', 'nonce': 2822193022}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5109, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/4241140805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 4241140805}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4241140805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 5005, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.157:6835/488302185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6834', 'nonce': 488302185}, {'type': 'v1', 'addr': '172.21.15.157:6835', 'nonce': 488302185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}] 2023-10-14T09:19:00.086 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-10-14T09:19:00.086 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T09:19:00.087 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T09:19:00.133 DEBUG:teuthology.orchestra.run.smithi157:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T09:19:00.220 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T09:19:00.221 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:19:00.221 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:19:00.231 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-14T09:19:00.231 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:19:00.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:19:00.232 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T09:19:00.286 INFO:teuthology.orchestra.run.smithi078.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-14T09:19:00.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:19:00.287 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:19:00.288 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:19:00.298 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9344 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-14T09:19:00.298 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:19:00.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:19:00.299 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T09:19:00.350 INFO:teuthology.orchestra.run.smithi157.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-14T09:19:00.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:19:00.352 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:19:00.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.482+0000 7fb9a17f8640 1 Processor -- start 2023-10-14T09:19:00.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb9a17f8640 1 -- start start 2023-10-14T09:19:00.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb9a17f8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb99c14ddb0 0x7fb99c0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb9a17f8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb99c0c6910 0x7fb99c0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb9a17f8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c06c470 con 0x7fb99c153e80 2023-10-14T09:19:00.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb9a17f8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c0c64f0 con 0x7fb99c0c6910 2023-10-14T09:19:00.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb9a17f8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c0c5300 con 0x7fb99c14ddb0 2023-10-14T09:19:00.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb99b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb99c0c6910 0x7fb99c0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb9927fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb99c153e80 0x7fb99c06bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43012/0 (socket says 172.21.15.78:43012) 2023-10-14T09:19:00.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb9927fc640 1 -- 172.21.15.78:0/1673699742 learned_addr learned my addr 172.21.15.78:0/1673699742 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:00.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb99affd640 1 --2- 172.21.15.78:0/1673699742 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb99c14ddb0 0x7fb99c0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb99b7fe640 1 -- 172.21.15.78:0/1673699742 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb99c14ddb0 msgr2=0x7fb99c0c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb99b7fe640 1 --2- 172.21.15.78:0/1673699742 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb99c14ddb0 0x7fb99c0c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb99b7fe640 1 -- 172.21.15.78:0/1673699742 >> v1:172.21.15.78:6789/0 conn(0x7fb99c153e80 legacy=0x7fb99c06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb99b7fe640 1 -- 172.21.15.78:0/1673699742 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c06c750 con 0x7fb99c0c6910 2023-10-14T09:19:00.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.486+0000 7fb99affd640 1 --2- 172.21.15.78:0/1673699742 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb99c14ddb0 0x7fb99c0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb99b7fe640 1 --2- 172.21.15.78:0/1673699742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0c6910 0x7fb99c0c3fe0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb994009d90 tx=0x7fb99401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ebc11091f403f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb99a7fc640 1 -- 172.21.15.78:0/1673699742 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9940a57e0 con 0x7fb99c0c6910 2023-10-14T09:19:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb99a7fc640 1 -- 172.21.15.78:0/1673699742 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9940a5940 con 0x7fb99c0c6910 2023-10-14T09:19:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb99a7fc640 1 -- 172.21.15.78:0/1673699742 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9940a5cd0 con 0x7fb99c0c6910 2023-10-14T09:19:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb9a17f8640 1 -- 172.21.15.78:0/1673699742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0c6910 msgr2=0x7fb99c0c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb9a17f8640 1 --2- 172.21.15.78:0/1673699742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0c6910 0x7fb99c0c3fe0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb994009d90 tx=0x7fb99401c830 comp rx=0 tx=0).stop 2023-10-14T09:19:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb9a17f8640 1 -- 172.21.15.78:0/1673699742 shutdown_connections 2023-10-14T09:19:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb9a17f8640 1 --2- 172.21.15.78:0/1673699742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0c6910 0x7fb99c0c3fe0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb9a17f8640 1 --2- 172.21.15.78:0/1673699742 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb99c14ddb0 0x7fb99c0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb9a17f8640 1 -- 172.21.15.78:0/1673699742 >> 172.21.15.78:0/1673699742 conn(0x7fb99c0ab1f0 msgr2=0x7fb99c0ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:00.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb9a17f8640 1 -- 172.21.15.78:0/1673699742 shutdown_connections 2023-10-14T09:19:00.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb9a17f8640 1 -- 172.21.15.78:0/1673699742 wait complete. 2023-10-14T09:19:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb9a17f8640 1 Processor -- start 2023-10-14T09:19:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.490+0000 7fb9a17f8640 1 -- start start 2023-10-14T09:19:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb9a17f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0c6910 0x7fb99c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb9a17f8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb99c14ddb0 0x7fb99c14bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb9a17f8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb99c153e80 0x7fb99c14c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb9a17f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c14c640 con 0x7fb99c0c6910 2023-10-14T09:19:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb9a17f8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1ed330 con 0x7fb99c14ddb0 2023-10-14T09:19:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb9a17f8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c0c0f70 con 0x7fb99c153e80 2023-10-14T09:19:00.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb99affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0c6910 0x7fb99c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb99affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0c6910 0x7fb99c152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47102/0 (socket says 172.21.15.78:47102) 2023-10-14T09:19:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb99affd640 1 -- 172.21.15.78:0/3173066338 learned_addr learned my addr 172.21.15.78:0/3173066338 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb99b7fe640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb99c153e80 0x7fb99c14c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb9927fc640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb99c14ddb0 0x7fb99c14bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb99affd640 1 -- 172.21.15.78:0/3173066338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb99c153e80 msgr2=0x7fb99c14c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb99affd640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb99c153e80 0x7fb99c14c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb99affd640 1 -- 172.21.15.78:0/3173066338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb99c14ddb0 msgr2=0x7fb99c14bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb99affd640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb99c14ddb0 0x7fb99c14bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb99affd640 1 -- 172.21.15.78:0/3173066338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb994009a70 con 0x7fb99c0c6910 2023-10-14T09:19:00.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb99affd640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0c6910 0x7fb99c152610 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00d800 tx=0x7fb98c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb993fff640 1 -- 172.21.15.78:0/3173066338 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0096c0 con 0x7fb99c0c6910 2023-10-14T09:19:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb993fff640 1 -- 172.21.15.78:0/3173066338 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c009820 con 0x7fb99c0c6910 2023-10-14T09:19:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb9a17f8640 1 -- 172.21.15.78:0/3173066338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99c1ec720 con 0x7fb99c0c6910 2023-10-14T09:19:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb993fff640 1 -- 172.21.15.78:0/3173066338 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c009bd0 con 0x7fb99c0c6910 2023-10-14T09:19:00.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb9a17f8640 1 -- 172.21.15.78:0/3173066338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c1ecce0 con 0x7fb99c0c6910 2023-10-14T09:19:00.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb9a17f8640 1 -- 172.21.15.78:0/3173066338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99c074180 con 0x7fb99c0c6910 2023-10-14T09:19:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.494+0000 7fb993fff640 1 -- 172.21.15.78:0/3173066338 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb98c009d30 con 0x7fb99c0c6910 2023-10-14T09:19:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.498+0000 7fb993fff640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb97c0664d0 0x7fb97c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.498+0000 7fb993fff640 1 -- 172.21.15.78:0/3173066338 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb98c0844e0 con 0x7fb99c0c6910 2023-10-14T09:19:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.498+0000 7fb9927fc640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb97c0664d0 0x7fb97c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.498+0000 7fb9927fc640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb97c0664d0 0x7fb97c068990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb99c154c40 tx=0x7fb984009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.502+0000 7fb993fff640 1 -- 172.21.15.78:0/3173066338 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb98c0519b0 con 0x7fb99c0c6910 2023-10-14T09:19:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.682+0000 7fb9a17f8640 1 -- 172.21.15.78:0/3173066338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb99c0abff0 con 0x7fb99c0c6910 2023-10-14T09:19:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.682+0000 7fb993fff640 1 -- 172.21.15.78:0/3173066338 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fb98c054fd0 con 0x7fb99c0c6910 2023-10-14T09:19:00.689 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:00.689 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:19:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:19:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 -- 172.21.15.78:0/3173066338 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb97c0664d0 msgr2=0x7fb97c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb97c0664d0 0x7fb97c068990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb99c154c40 tx=0x7fb984009040 comp rx=0 tx=0).stop 2023-10-14T09:19:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 -- 172.21.15.78:0/3173066338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0c6910 msgr2=0x7fb99c152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0c6910 0x7fb99c152610 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00d800 tx=0x7fb98c00dcc0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 -- 172.21.15.78:0/3173066338 shutdown_connections 2023-10-14T09:19:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb97c0664d0 0x7fb97c068990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb99c153e80 0x7fb99c14c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb99c14ddb0 0x7fb99c14bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 --2- 172.21.15.78:0/3173066338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb99c0c6910 0x7fb99c152610 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 -- 172.21.15.78:0/3173066338 >> 172.21.15.78:0/3173066338 conn(0x7fb99c0ab1f0 msgr2=0x7fb99c0a9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 -- 172.21.15.78:0/3173066338 shutdown_connections 2023-10-14T09:19:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.686+0000 7fb9a17f8640 1 -- 172.21.15.78:0/3173066338 wait complete. 2023-10-14T09:19:00.710 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:19:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1f5aea640 1 Processor -- start 2023-10-14T09:19:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1f5aea640 1 -- start start 2023-10-14T09:19:00.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1f5aea640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa1f0151430 0x7fa1f01547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1f5aea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa1f00c4180 0x7fa1f00c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1f5aea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f0151810 con 0x7fa1f00c1eb0 2023-10-14T09:19:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1f5aea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f00c27d0 con 0x7fa1f00c4180 2023-10-14T09:19:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1f5aea640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f006f760 con 0x7fa1f0151430 2023-10-14T09:19:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1eeffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa1f00c1eb0 0x7fa1f00c77f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43022/0 (socket says 172.21.15.78:43022) 2023-10-14T09:19:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1eeffd640 1 -- 172.21.15.78:0/646939117 learned_addr learned my addr 172.21.15.78:0/646939117 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1effff640 1 --2- 172.21.15.78:0/646939117 >> v2:172.21.15.78:3300/0 conn(0x7fa1f00c4180 0x7fa1f00c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1ef7fe640 1 --2- 172.21.15.78:0/646939117 >> v2:172.21.15.157:3300/0 conn(0x7fa1f0151430 0x7fa1f01547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1ee7fc640 1 -- 172.21.15.78:0/646939117 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933338817 0 0) 0x7fa1f0151810 con 0x7fa1f00c1eb0 2023-10-14T09:19:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1ee7fc640 1 -- 172.21.15.78:0/646939117 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1d8003530 con 0x7fa1f00c1eb0 2023-10-14T09:19:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1effff640 1 -- 172.21.15.78:0/646939117 >> v2:172.21.15.157:3300/0 conn(0x7fa1f0151430 msgr2=0x7fa1f01547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1effff640 1 --2- 172.21.15.78:0/646939117 >> v2:172.21.15.157:3300/0 conn(0x7fa1f0151430 0x7fa1f01547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1effff640 1 -- 172.21.15.78:0/646939117 >> v1:172.21.15.78:6789/0 conn(0x7fa1f00c1eb0 legacy=0x7fa1f00c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1effff640 1 -- 172.21.15.78:0/646939117 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f0154d20 con 0x7fa1f00c4180 2023-10-14T09:19:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.842+0000 7fa1ef7fe640 1 --2- 172.21.15.78:0/646939117 >> v2:172.21.15.157:3300/0 conn(0x7fa1f0151430 0x7fa1f01547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1effff640 1 --2- 172.21.15.78:0/646939117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f00c4180 0x7fa1f00c4590 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00c7400 tx=0x7fa1e801c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6393a715d72ffb19 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1ee7fc640 1 -- 172.21.15.78:0/646939117 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80a5880 con 0x7fa1f00c4180 2023-10-14T09:19:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1ee7fc640 1 -- 172.21.15.78:0/646939117 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e80a59e0 con 0x7fa1f00c4180 2023-10-14T09:19:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1ee7fc640 1 -- 172.21.15.78:0/646939117 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80a5d70 con 0x7fa1f00c4180 2023-10-14T09:19:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1f5aea640 1 -- 172.21.15.78:0/646939117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f00c4180 msgr2=0x7fa1f00c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1f5aea640 1 --2- 172.21.15.78:0/646939117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f00c4180 0x7fa1f00c4590 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00c7400 tx=0x7fa1e801c7c0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1f5aea640 1 -- 172.21.15.78:0/646939117 shutdown_connections 2023-10-14T09:19:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1f5aea640 1 --2- 172.21.15.78:0/646939117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f00c4180 0x7fa1f00c4590 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1f5aea640 1 --2- 172.21.15.78:0/646939117 >> v2:172.21.15.157:3300/0 conn(0x7fa1f0151430 0x7fa1f01547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1f5aea640 1 -- 172.21.15.78:0/646939117 >> 172.21.15.78:0/646939117 conn(0x7fa1f006a060 msgr2=0x7fa1f006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1f5aea640 1 -- 172.21.15.78:0/646939117 shutdown_connections 2023-10-14T09:19:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.846+0000 7fa1f5aea640 1 -- 172.21.15.78:0/646939117 wait complete. 2023-10-14T09:19:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1f5aea640 1 Processor -- start 2023-10-14T09:19:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1f5aea640 1 -- start start 2023-10-14T09:19:00.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1f5aea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f00c1eb0 0x7fa1f00acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1f5aea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f00c4180 0x7fa1f00bd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1f5aea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f0151430 0x7fa1f00be570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1f5aea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0157ce0 con 0x7fa1f0151430 2023-10-14T09:19:00.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1f5aea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00bf9c0 con 0x7fa1f00c4180 2023-10-14T09:19:00.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1f5aea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00bfeb0 con 0x7fa1f00c1eb0 2023-10-14T09:19:00.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f0151430 0x7fa1f00be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f0151430 0x7fa1f00be570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47122/0 (socket says 172.21.15.78:47122) 2023-10-14T09:19:00.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1effff640 1 -- 172.21.15.78:0/1018169100 learned_addr learned my addr 172.21.15.78:0/1018169100 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:00.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1eeffd640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f00c4180 0x7fa1f00bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1ef7fe640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f00c1eb0 0x7fa1f00acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1effff640 1 -- 172.21.15.78:0/1018169100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f00c1eb0 msgr2=0x7fa1f00acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1effff640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f00c1eb0 0x7fa1f00acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1effff640 1 -- 172.21.15.78:0/1018169100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f00c4180 msgr2=0x7fa1f00bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:00.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1effff640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f00c4180 0x7fa1f00bd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:00.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1effff640 1 -- 172.21.15.78:0/1018169100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8009a70 con 0x7fa1f0151430 2023-10-14T09:19:00.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1ef7fe640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f00c1eb0 0x7fa1f00acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:00.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1effff640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f0151430 0x7fa1f00be570 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80b0040 tx=0x7fa1e8019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1d7fff640 1 -- 172.21.15.78:0/1018169100 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80b9650 con 0x7fa1f0151430 2023-10-14T09:19:00.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1d7fff640 1 -- 172.21.15.78:0/1018169100 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e80b97b0 con 0x7fa1f0151430 2023-10-14T09:19:00.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1f5aea640 1 -- 172.21.15.78:0/1018169100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f00bfbd0 con 0x7fa1f0151430 2023-10-14T09:19:00.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1d7fff640 1 -- 172.21.15.78:0/1018169100 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80b9b40 con 0x7fa1f0151430 2023-10-14T09:19:00.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1f5aea640 1 -- 172.21.15.78:0/1018169100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f01ecc70 con 0x7fa1f0151430 2023-10-14T09:19:00.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.850+0000 7fa1f5aea640 1 -- 172.21.15.78:0/1018169100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f0074180 con 0x7fa1f0151430 2023-10-14T09:19:00.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.854+0000 7fa1d7fff640 1 -- 172.21.15.78:0/1018169100 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa1e80b9ca0 con 0x7fa1f0151430 2023-10-14T09:19:00.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.854+0000 7fa1d7fff640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1dc0664a0 0x7fa1dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:00.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.854+0000 7fa1d7fff640 1 -- 172.21.15.78:0/1018169100 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fa1e811f1a0 con 0x7fa1f0151430 2023-10-14T09:19:00.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.854+0000 7fa1ef7fe640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1dc0664a0 0x7fa1dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:00.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.854+0000 7fa1ef7fe640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1dc0664a0 0x7fa1dc068960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009970 tx=0x7fa1e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:00.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:00.858+0000 7fa1d7fff640 1 -- 172.21.15.78:0/1018169100 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa1e80ec570 con 0x7fa1f0151430 2023-10-14T09:19:01.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.006+0000 7fa1f5aea640 1 -- 172.21.15.78:0/1018169100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1f00bad80 con 0x7fa1f0151430 2023-10-14T09:19:01.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.006+0000 7fa1d7fff640 1 -- 172.21.15.78:0/1018169100 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16589 (secure 0 0 0) 0x7fa1e80efb90 con 0x7fa1f0151430 2023-10-14T09:19:01.014 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:01.015 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":32,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:18:17.070566+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T09:18:13.661984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T09:18:15.003533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:19:01.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 -- 172.21.15.78:0/1018169100 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1dc0664a0 msgr2=0x7fa1dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1dc0664a0 0x7fa1dc068960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009970 tx=0x7fa1e0008040 comp rx=0 tx=0).stop 2023-10-14T09:19:01.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 -- 172.21.15.78:0/1018169100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f0151430 msgr2=0x7fa1f00be570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f0151430 0x7fa1f00be570 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80b0040 tx=0x7fa1e8019560 comp rx=0 tx=0).stop 2023-10-14T09:19:01.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 -- 172.21.15.78:0/1018169100 shutdown_connections 2023-10-14T09:19:01.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f0151430 0x7fa1f00be570 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f00c4180 0x7fa1f00bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fa1dc0664a0 0x7fa1dc068960 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 --2- 172.21.15.78:0/1018169100 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f00c1eb0 0x7fa1f00acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 -- 172.21.15.78:0/1018169100 >> 172.21.15.78:0/1018169100 conn(0x7fa1f006a060 msgr2=0x7fa1f01535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:01.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 -- 172.21.15.78:0/1018169100 shutdown_connections 2023-10-14T09:19:01.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.010+0000 7fa1f5aea640 1 -- 172.21.15.78:0/1018169100 wait complete. 2023-10-14T09:19:01.036 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T09:17:13.284800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T09:18:13.661984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T09:18:15.003533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:19:01.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:19:01.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.170+0000 7fb032609640 1 Processor -- start 2023-10-14T09:19:01.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb032609640 1 -- start start 2023-10-14T09:19:01.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb032609640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb02c150f40 0x7fb02c1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb032609640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c151fd0 con 0x7fb02c150ac0 2023-10-14T09:19:01.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb032609640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c1513b0 con 0x7fb02c139dc0 2023-10-14T09:19:01.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb032609640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c0702c0 con 0x7fb02c150f40 2023-10-14T09:19:01.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb02b7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb02c150ac0 0x7fb02c1532c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43028/0 (socket says 172.21.15.78:43028) 2023-10-14T09:19:01.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb02b7fe640 1 -- 172.21.15.78:0/449512583 learned_addr learned my addr 172.21.15.78:0/449512583 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:01.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb030ba6640 1 --2- 172.21.15.78:0/449512583 >> v2:172.21.15.78:3300/0 conn(0x7fb02c150f40 0x7fb02c1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb02affd640 1 -- 172.21.15.78:0/449512583 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001330090 0 0) 0x7fb02c151fd0 con 0x7fb02c150ac0 2023-10-14T09:19:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb02affd640 1 -- 172.21.15.78:0/449512583 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb014003530 con 0x7fb02c150ac0 2023-10-14T09:19:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb030ba6640 1 -- 172.21.15.78:0/449512583 >> v1:172.21.15.157:6789/0 conn(0x7fb02c139dc0 legacy=0x7fb02c0718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb030ba6640 1 -- 172.21.15.78:0/449512583 >> v1:172.21.15.78:6789/0 conn(0x7fb02c150ac0 legacy=0x7fb02c1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.174+0000 7fb030ba6640 1 -- 172.21.15.78:0/449512583 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c152220 con 0x7fb02c150f40 2023-10-14T09:19:01.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb030ba6640 1 --2- 172.21.15.78:0/449512583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb02c150f40 0x7fb02c1539d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb024009d90 tx=0x7fb02401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f1d0b9c1b742f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:01.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb02affd640 1 -- 172.21.15.78:0/449512583 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0240a5780 con 0x7fb02c150f40 2023-10-14T09:19:01.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb02affd640 1 -- 172.21.15.78:0/449512583 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0240a58e0 con 0x7fb02c150f40 2023-10-14T09:19:01.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb02affd640 1 -- 172.21.15.78:0/449512583 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0240a5c70 con 0x7fb02c150f40 2023-10-14T09:19:01.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb032609640 1 -- 172.21.15.78:0/449512583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb02c150f40 msgr2=0x7fb02c1539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb032609640 1 --2- 172.21.15.78:0/449512583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb02c150f40 0x7fb02c1539d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb024009d90 tx=0x7fb02401c8c0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb032609640 1 -- 172.21.15.78:0/449512583 shutdown_connections 2023-10-14T09:19:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb032609640 1 --2- 172.21.15.78:0/449512583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb02c150f40 0x7fb02c1539d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb032609640 1 -- 172.21.15.78:0/449512583 >> 172.21.15.78:0/449512583 conn(0x7fb02c0c1d00 msgr2=0x7fb02c0c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:01.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb032609640 1 -- 172.21.15.78:0/449512583 shutdown_connections 2023-10-14T09:19:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb032609640 1 -- 172.21.15.78:0/449512583 wait complete. 2023-10-14T09:19:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb032609640 1 Processor -- start 2023-10-14T09:19:01.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.178+0000 7fb032609640 1 -- start start 2023-10-14T09:19:01.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb032609640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb02c139dc0 0x7fb02c0c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb032609640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb02c150ac0 0x7fb02c136a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb032609640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb02c150f40 0x7fb02c1ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb032609640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c152ea0 con 0x7fb02c139dc0 2023-10-14T09:19:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb032609640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c06caf0 con 0x7fb02c150f40 2023-10-14T09:19:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb032609640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0c3af0 con 0x7fb02c150ac0 2023-10-14T09:19:01.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb02c139dc0 0x7fb02c0c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb02c139dc0 0x7fb02c0c35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47146/0 (socket says 172.21.15.78:47146) 2023-10-14T09:19:01.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb02bfff640 1 -- 172.21.15.78:0/2808884390 learned_addr learned my addr 172.21.15.78:0/2808884390 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb030ba6640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb02c150f40 0x7fb02c1ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb02b7fe640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb02c150ac0 0x7fb02c136a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb02bfff640 1 -- 172.21.15.78:0/2808884390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb02c150ac0 msgr2=0x7fb02c136a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb02bfff640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb02c150ac0 0x7fb02c136a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb02bfff640 1 -- 172.21.15.78:0/2808884390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb02c150f40 msgr2=0x7fb02c1ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb02bfff640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb02c150f40 0x7fb02c1ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb02bfff640 1 -- 172.21.15.78:0/2808884390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb024009a70 con 0x7fb02c139dc0 2023-10-14T09:19:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb02bfff640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb02c139dc0 0x7fb02c0c35b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c530 tx=0x7fb01c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb028ff9640 1 -- 172.21.15.78:0/2808884390 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c005220 con 0x7fb02c139dc0 2023-10-14T09:19:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb028ff9640 1 -- 172.21.15.78:0/2808884390 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c005380 con 0x7fb02c139dc0 2023-10-14T09:19:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb028ff9640 1 -- 172.21.15.78:0/2808884390 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c007270 con 0x7fb02c139dc0 2023-10-14T09:19:01.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb032609640 1 -- 172.21.15.78:0/2808884390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c0c2ff0 con 0x7fb02c139dc0 2023-10-14T09:19:01.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb032609640 1 -- 172.21.15.78:0/2808884390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c06d420 con 0x7fb02c139dc0 2023-10-14T09:19:01.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb032609640 1 -- 172.21.15.78:0/2808884390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c074110 con 0x7fb02c139dc0 2023-10-14T09:19:01.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.182+0000 7fb028ff9640 1 -- 172.21.15.78:0/2808884390 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb01c0073d0 con 0x7fb02c139dc0 2023-10-14T09:19:01.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.186+0000 7fb028ff9640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb0180664a0 0x7fb018068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.186+0000 7fb028ff9640 1 -- 172.21.15.78:0/2808884390 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb01c083640 con 0x7fb02c139dc0 2023-10-14T09:19:01.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.186+0000 7fb02b7fe640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb0180664a0 0x7fb018068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.186+0000 7fb02b7fe640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb0180664a0 0x7fb018068960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb0200011f0 tx=0x7fb020009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:01.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.190+0000 7fb028ff9640 1 -- 172.21.15.78:0/2808884390 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb01c050b30 con 0x7fb02c139dc0 2023-10-14T09:19:01.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.338+0000 7fb032609640 1 -- 172.21.15.78:0/2808884390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb02c0c11b0 con 0x7fb02c139dc0 2023-10-14T09:19:01.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.338+0000 7fb028ff9640 1 -- 172.21.15.78:0/2808884390 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb01c054150 con 0x7fb02c139dc0 2023-10-14T09:19:01.347 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-10-14T09:19:01.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 -- 172.21.15.78:0/2808884390 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb0180664a0 msgr2=0x7fb018068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb0180664a0 0x7fb018068960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb0200011f0 tx=0x7fb020009040 comp rx=0 tx=0).stop 2023-10-14T09:19:01.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 -- 172.21.15.78:0/2808884390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb02c139dc0 msgr2=0x7fb02c0c35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb02c139dc0 0x7fb02c0c35b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c530 tx=0x7fb01c00c9f0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 -- 172.21.15.78:0/2808884390 shutdown_connections 2023-10-14T09:19:01.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb02c150f40 0x7fb02c1ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb0180664a0 0x7fb018068960 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb02c150ac0 0x7fb02c136a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 --2- 172.21.15.78:0/2808884390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb02c139dc0 0x7fb02c0c35b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 -- 172.21.15.78:0/2808884390 >> 172.21.15.78:0/2808884390 conn(0x7fb02c0c1d00 msgr2=0x7fb02c0c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:01.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 -- 172.21.15.78:0/2808884390 shutdown_connections 2023-10-14T09:19:01.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.342+0000 7fb032609640 1 -- 172.21.15.78:0/2808884390 wait complete. 2023-10-14T09:19:01.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T09:19:01.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.502+0000 7f25cd068640 1 Processor -- start 2023-10-14T09:19:01.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.502+0000 7f25cd068640 1 -- start start 2023-10-14T09:19:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.502+0000 7f25cd068640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c806dcf0 0x7f25c80bfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.502+0000 7f25cd068640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c80a7660 con 0x7f25c8151400 2023-10-14T09:19:01.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.502+0000 7f25cd068640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c8154820 con 0x7f25c806eac0 2023-10-14T09:19:01.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.502+0000 7f25cd068640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c81517e0 con 0x7f25c806dcf0 2023-10-14T09:19:01.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c6d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f25c8151400 0x7f25c8069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43036/0 (socket says 172.21.15.78:43036) 2023-10-14T09:19:01.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c6d9d640 1 -- 172.21.15.78:0/2053556788 learned_addr learned my addr 172.21.15.78:0/2053556788 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:01.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c659c640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c806dcf0 0x7f25c80bfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201260564 0 0) 0x7f25c80a7660 con 0x7f25c8151400 2023-10-14T09:19:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25b0003530 con 0x7f25c8151400 2023-10-14T09:19:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2767668459 0 0) 0x7f25b0003530 con 0x7f25c8151400 2023-10-14T09:19:01.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c806dcf0 msgr2=0x7f25c80bfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c806dcf0 0x7f25c80bfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 >> v1:172.21.15.157:6789/0 conn(0x7f25c806eac0 legacy=0x7f25c815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c8154ac0 con 0x7f25c8151400 2023-10-14T09:19:01.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f25b8001680 con 0x7f25c8151400 2023-10-14T09:19:01.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 >> v1:172.21.15.78:6789/0 conn(0x7f25c8151400 legacy=0x7f25c8069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25b00039b0 0x7f25b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b00047d0 0x7f25b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c806dcf0 0x7f25b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c81517e0 con 0x7f25b00039b0 2023-10-14T09:19:01.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b000ba40 con 0x7f25b00047d0 2023-10-14T09:19:01.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b000bc00 con 0x7f25c806dcf0 2023-10-14T09:19:01.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c6d9d640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25b00039b0 0x7f25b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c659c640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b00047d0 0x7f25b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c759e640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c806dcf0 0x7f25b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c6d9d640 1 -- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c806dcf0 msgr2=0x7f25b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c6d9d640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c806dcf0 0x7f25b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c6d9d640 1 -- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b00047d0 msgr2=0x7f25b0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c6d9d640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b00047d0 0x7f25b0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c6d9d640 1 -- 172.21.15.78:0/2053556788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b0003530 con 0x7f25b00039b0 2023-10-14T09:19:01.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.506+0000 7f25c759e640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c806dcf0 0x7f25b0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:01.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25c6d9d640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25b00039b0 0x7f25b0003dd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c210 tx=0x7f25b801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac2a2ac35825d00 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:01.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8005ae0 con 0x7f25b00039b0 2023-10-14T09:19:01.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b8005c40 con 0x7f25b00039b0 2023-10-14T09:19:01.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25c5d9b640 1 -- 172.21.15.78:0/2053556788 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80a57f0 con 0x7f25b00039b0 2023-10-14T09:19:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25cd068640 1 -- 172.21.15.78:0/2053556788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25b00039b0 msgr2=0x7f25b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25cd068640 1 --2- 172.21.15.78:0/2053556788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25b00039b0 0x7f25b0003dd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c210 tx=0x7f25b801cc00 comp rx=0 tx=0).stop 2023-10-14T09:19:01.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25c759e640 1 -- 172.21.15.78:0/2053556788 reap_dead start 2023-10-14T09:19:01.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25cd068640 1 -- 172.21.15.78:0/2053556788 shutdown_connections 2023-10-14T09:19:01.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25cd068640 1 -- 172.21.15.78:0/2053556788 >> 172.21.15.78:0/2053556788 conn(0x7f25c80c63a0 msgr2=0x7f25c80c67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:01.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25cd068640 1 -- 172.21.15.78:0/2053556788 shutdown_connections 2023-10-14T09:19:01.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25cd068640 1 -- 172.21.15.78:0/2053556788 wait complete. 2023-10-14T09:19:01.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25cd068640 1 Processor -- start 2023-10-14T09:19:01.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.510+0000 7f25cd068640 1 -- start start 2023-10-14T09:19:01.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25cd068640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b00039b0 0x7f25c8158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25cd068640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c81550f0 0x7f25c8146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25cd068640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25c8147280 0x7f25c81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25cd068640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c81592e0 con 0x7f25c8147280 2023-10-14T09:19:01.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25cd068640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c81579a0 con 0x7f25b00039b0 2023-10-14T09:19:01.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25cd068640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c814f330 con 0x7f25c81550f0 2023-10-14T09:19:01.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25c759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25c8147280 0x7f25c81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25c759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25c8147280 0x7f25c81555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47160/0 (socket says 172.21.15.78:47160) 2023-10-14T09:19:01.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25c759e640 1 -- 172.21.15.78:0/377359218 learned_addr learned my addr 172.21.15.78:0/377359218 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:01.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25c659c640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c81550f0 0x7f25c8146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25c6d9d640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b00039b0 0x7f25c8158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25c759e640 1 -- 172.21.15.78:0/377359218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c81550f0 msgr2=0x7f25c8146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25c759e640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c81550f0 0x7f25c8146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25c759e640 1 -- 172.21.15.78:0/377359218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b00039b0 msgr2=0x7f25c8158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25c759e640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b00039b0 0x7f25c8158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25c759e640 1 -- 172.21.15.78:0/377359218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c814f610 con 0x7f25c8147280 2023-10-14T09:19:01.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25c759e640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25c8147280 0x7f25c81555b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f25c0000f90 tx=0x7f25c000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:01.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25af7fe640 1 -- 172.21.15.78:0/377359218 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0017070 con 0x7f25c8147280 2023-10-14T09:19:01.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25af7fe640 1 -- 172.21.15.78:0/377359218 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000eed0 con 0x7f25c8147280 2023-10-14T09:19:01.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25af7fe640 1 -- 172.21.15.78:0/377359218 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0006b60 con 0x7f25c8147280 2023-10-14T09:19:01.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25cd068640 1 -- 172.21.15.78:0/377359218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c814f8f0 con 0x7f25c8147280 2023-10-14T09:19:01.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25cd068640 1 -- 172.21.15.78:0/377359218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c8147700 con 0x7f25c8147280 2023-10-14T09:19:01.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25cd068640 1 -- 172.21.15.78:0/377359218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c814fe10 con 0x7f25c8147280 2023-10-14T09:19:01.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.514+0000 7f25af7fe640 1 -- 172.21.15.78:0/377359218 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f25c0003980 con 0x7f25c8147280 2023-10-14T09:19:01.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.518+0000 7f25af7fe640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25b40664d0 0x7f25b4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.518+0000 7f25af7fe640 1 -- 172.21.15.78:0/377359218 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f25c0083510 con 0x7f25c8147280 2023-10-14T09:19:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.518+0000 7f25c6d9d640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25b40664d0 0x7f25b4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.518+0000 7f25c6d9d640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25b40664d0 0x7f25b4068990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f25b80ab000 tx=0x7f25b80a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:01.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.522+0000 7f25af7fe640 1 -- 172.21.15.78:0/377359218 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25c814fe10 con 0x7f25c8147280 2023-10-14T09:19:01.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 -- 172.21.15.78:0/377359218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25c8074110 con 0x7f25c8147280 2023-10-14T09:19:01.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25af7fe640 1 -- 172.21.15.78:0/377359218 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v32) v1 ==== 109+0+11 (secure 0 0 0) 0x7f25c0054400 con 0x7f25c8147280 2023-10-14T09:19:01.675 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-10-14T09:19:01.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 -- 172.21.15.78:0/377359218 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25b40664d0 msgr2=0x7f25b4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25b40664d0 0x7f25b4068990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f25b80ab000 tx=0x7f25b80a7070 comp rx=0 tx=0).stop 2023-10-14T09:19:01.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 -- 172.21.15.78:0/377359218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25c8147280 msgr2=0x7f25c81555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25c8147280 0x7f25c81555b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f25c0000f90 tx=0x7f25c000eb90 comp rx=0 tx=0).stop 2023-10-14T09:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 -- 172.21.15.78:0/377359218 shutdown_connections 2023-10-14T09:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25c8147280 0x7f25c81555b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f25b40664d0 0x7f25b4068990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25c81550f0 0x7f25c8146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 --2- 172.21.15.78:0/377359218 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b00039b0 0x7f25c8158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 -- 172.21.15.78:0/377359218 >> 172.21.15.78:0/377359218 conn(0x7f25c80c63a0 msgr2=0x7f25c8069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 -- 172.21.15.78:0/377359218 shutdown_connections 2023-10-14T09:19:01.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.670+0000 7f25cd068640 1 -- 172.21.15.78:0/377359218 wait complete. 2023-10-14T09:19:01.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T09:19:01.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.830+0000 7f2cf4ead640 1 Processor -- start 2023-10-14T09:19:01.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.830+0000 7f2cf4ead640 1 -- start start 2023-10-14T09:19:01.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cf4ead640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2cf00c6320 0x7f2cf00c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cf4ead640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2cf006c900 0x7f2cf0154290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cf4ead640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf00c4360 con 0x7f2cf00bcc50 2023-10-14T09:19:01.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cf4ead640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf0157c20 con 0x7f2cf00c6320 2023-10-14T09:19:01.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cf4ead640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00c4010 con 0x7f2cf006c900 2023-10-14T09:19:01.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cef7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2cf00c6320 0x7f2cf00c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cef7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2cf00c6320 0x7f2cf00c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47174/0 (socket says 172.21.15.78:47174) 2023-10-14T09:19:01.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cef7fe640 1 -- 172.21.15.78:0/1062936590 learned_addr learned my addr 172.21.15.78:0/1062936590 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:01.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cef7fe640 1 -- 172.21.15.78:0/1062936590 >> v2:172.21.15.157:3300/0 conn(0x7f2cf006c900 msgr2=0x7f2cf0154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:01.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2ceffff640 1 --2- 172.21.15.78:0/1062936590 >> v2:172.21.15.157:3300/0 conn(0x7f2cf006c900 0x7f2cf0154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cef7fe640 1 --2- 172.21.15.78:0/1062936590 >> v2:172.21.15.157:3300/0 conn(0x7f2cf006c900 0x7f2cf0154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cef7fe640 1 -- 172.21.15.78:0/1062936590 >> v1:172.21.15.157:6789/0 conn(0x7f2cf00bcc50 legacy=0x7f2cf0153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:01.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2cef7fe640 1 -- 172.21.15.78:0/1062936590 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0157ec0 con 0x7f2cf00c6320 2023-10-14T09:19:01.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.834+0000 7f2ceffff640 1 --2- 172.21.15.78:0/1062936590 >> v2:172.21.15.157:3300/0 conn(0x7f2cf006c900 0x7f2cf0154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:19:01.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cef7fe640 1 --2- 172.21.15.78:0/1062936590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf00c6320 0x7f2cf00c6700 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2cf006baa0 tx=0x7f2ce001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb799ac1eb79d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:01.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cee7fc640 1 -- 172.21.15.78:0/1062936590 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00ab600 con 0x7f2cf00c6320 2023-10-14T09:19:01.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cee7fc640 1 -- 172.21.15.78:0/1062936590 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce00a7050 con 0x7f2cf00c6320 2023-10-14T09:19:01.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cee7fc640 1 -- 172.21.15.78:0/1062936590 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00ab980 con 0x7f2cf00c6320 2023-10-14T09:19:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 -- 172.21.15.78:0/1062936590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf00c6320 msgr2=0x7f2cf00c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 --2- 172.21.15.78:0/1062936590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf00c6320 0x7f2cf00c6700 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2cf006baa0 tx=0x7f2ce001c430 comp rx=0 tx=0).stop 2023-10-14T09:19:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 -- 172.21.15.78:0/1062936590 shutdown_connections 2023-10-14T09:19:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 --2- 172.21.15.78:0/1062936590 >> v2:172.21.15.157:3300/0 conn(0x7f2cf006c900 0x7f2cf0154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 --2- 172.21.15.78:0/1062936590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf00c6320 0x7f2cf00c6700 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 -- 172.21.15.78:0/1062936590 >> 172.21.15.78:0/1062936590 conn(0x7f2cf0071790 msgr2=0x7f2cf0071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:01.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 -- 172.21.15.78:0/1062936590 shutdown_connections 2023-10-14T09:19:01.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 -- 172.21.15.78:0/1062936590 wait complete. 2023-10-14T09:19:01.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 Processor -- start 2023-10-14T09:19:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 -- start start 2023-10-14T09:19:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf006c900 0x7f2cf0156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf00c6320 0x7f2cf014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cf0155e50 0x7f2cf014ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf01eda20 con 0x7f2cf006c900 2023-10-14T09:19:01.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf01ed6d0 con 0x7f2cf00c6320 2023-10-14T09:19:01.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.838+0000 7f2cf4ead640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0156300 con 0x7f2cf0155e50 2023-10-14T09:19:01.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf006c900 0x7f2cf0156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf006c900 0x7f2cf0156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47176/0 (socket says 172.21.15.78:47176) 2023-10-14T09:19:01.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cef7fe640 1 -- 172.21.15.78:0/2203764909 learned_addr learned my addr 172.21.15.78:0/2203764909 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cef7fe640 1 -- 172.21.15.78:0/2203764909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cf0155e50 msgr2=0x7f2cf014ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cef7fe640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cf0155e50 0x7f2cf014ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cef7fe640 1 -- 172.21.15.78:0/2203764909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf00c6320 msgr2=0x7f2cf014b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2ceeffd640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf00c6320 0x7f2cf014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cef7fe640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf00c6320 0x7f2cf014b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:01.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cef7fe640 1 -- 172.21.15.78:0/2203764909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00094d0 con 0x7f2cf006c900 2023-10-14T09:19:01.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2ceeffd640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf00c6320 0x7f2cf014b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:19:01.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cef7fe640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf006c900 0x7f2cf0156f60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2ce001aae0 tx=0x7f2ce00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:01.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cd7fff640 1 -- 172.21.15.78:0/2203764909 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00b6640 con 0x7f2cf006c900 2023-10-14T09:19:01.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cd7fff640 1 -- 172.21.15.78:0/2203764909 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce00b67a0 con 0x7f2cf006c900 2023-10-14T09:19:01.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cd7fff640 1 -- 172.21.15.78:0/2203764909 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00b6b30 con 0x7f2cf006c900 2023-10-14T09:19:01.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cf4ead640 1 -- 172.21.15.78:0/2203764909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf01565e0 con 0x7f2cf006c900 2023-10-14T09:19:01.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cf4ead640 1 -- 172.21.15.78:0/2203764909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf01574a0 con 0x7f2cf006c900 2023-10-14T09:19:01.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cf4ead640 1 -- 172.21.15.78:0/2203764909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf0074110 con 0x7f2cf006c900 2023-10-14T09:19:01.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cd7fff640 1 -- 172.21.15.78:0/2203764909 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2ce00b2040 con 0x7f2cf006c900 2023-10-14T09:19:01.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cd7fff640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2cdc0664a0 0x7f2cdc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:01.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.842+0000 7f2cd7fff640 1 -- 172.21.15.78:0/2203764909 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2ce011dc30 con 0x7f2cf006c900 2023-10-14T09:19:01.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.846+0000 7f2ceeffd640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2cdc0664a0 0x7f2cdc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:01.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.846+0000 7f2ceeffd640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2cdc0664a0 0x7f2cdc068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0151090 tx=0x7f2ce4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:01.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.846+0000 7f2cd7fff640 1 -- 172.21.15.78:0/2203764909 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2ce00eb080 con 0x7f2cf006c900 2023-10-14T09:19:02.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 -- 172.21.15.78:0/2203764909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f2cf015e2e0 con 0x7f2cf006c900 2023-10-14T09:19:02.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cd7fff640 1 -- 172.21.15.78:0/2203764909 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v32) v1 ==== 105+0+11 (secure 0 0 0) 0x7f2ce00ee6a0 con 0x7f2cf006c900 2023-10-14T09:19:02.004 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-10-14T09:19:02.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 -- 172.21.15.78:0/2203764909 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2cdc0664a0 msgr2=0x7f2cdc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2cdc0664a0 0x7f2cdc068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0151090 tx=0x7f2ce4009040 comp rx=0 tx=0).stop 2023-10-14T09:19:02.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 -- 172.21.15.78:0/2203764909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf006c900 msgr2=0x7f2cf0156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf006c900 0x7f2cf0156f60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2ce001aae0 tx=0x7f2ce00191d0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 -- 172.21.15.78:0/2203764909 shutdown_connections 2023-10-14T09:19:02.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2cdc0664a0 0x7f2cdc068960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cf0155e50 0x7f2cf014ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cf00c6320 0x7f2cf014b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 --2- 172.21.15.78:0/2203764909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf006c900 0x7f2cf0156f60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 -- 172.21.15.78:0/2203764909 >> 172.21.15.78:0/2203764909 conn(0x7f2cf0071790 msgr2=0x7f2cf01536b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:02.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 -- 172.21.15.78:0/2203764909 shutdown_connections 2023-10-14T09:19:02.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:01.998+0000 7f2cf4ead640 1 -- 172.21.15.78:0/2203764909 wait complete. 2023-10-14T09:19:02.025 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:19:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f195c405640 1 Processor -- start 2023-10-14T09:19:02.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f195c405640 1 -- start start 2023-10-14T09:19:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f195c405640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1954153e80 0x7f19540c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f195c405640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19540c6910 0x7f19540c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f195c405640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195406c470 con 0x7f195414ddb0 2023-10-14T09:19:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f195c405640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540c64f0 con 0x7f1954153e80 2023-10-14T09:19:02.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f195c405640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540c5300 con 0x7f19540c6910 2023-10-14T09:19:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f19599a0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1954153e80 0x7f19540c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f19599a0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1954153e80 0x7f19540c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47188/0 (socket says 172.21.15.78:47188) 2023-10-14T09:19:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f19599a0640 1 -- 172.21.15.78:0/837450156 learned_addr learned my addr 172.21.15.78:0/837450156 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:02.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f195a9a2640 1 --2- 172.21.15.78:0/837450156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19540c6910 0x7f19540c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f19599a0640 1 -- 172.21.15.78:0/837450156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19540c6910 msgr2=0x7f19540c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:02.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f19599a0640 1 --2- 172.21.15.78:0/837450156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19540c6910 0x7f19540c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f19599a0640 1 -- 172.21.15.78:0/837450156 >> v1:172.21.15.157:6789/0 conn(0x7f195414ddb0 legacy=0x7f195406bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.158+0000 7f19599a0640 1 -- 172.21.15.78:0/837450156 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195406c750 con 0x7f1954153e80 2023-10-14T09:19:02.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f19599a0640 1 --2- 172.21.15.78:0/837450156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1954153e80 0x7f19540c7780 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1944009870 tx=0x7f194401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e398fa4d126ae01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:02.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195919f640 1 -- 172.21.15.78:0/837450156 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19440ac640 con 0x7f1954153e80 2023-10-14T09:19:02.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195919f640 1 -- 172.21.15.78:0/837450156 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19440ac7a0 con 0x7f1954153e80 2023-10-14T09:19:02.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195919f640 1 -- 172.21.15.78:0/837450156 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19440acb30 con 0x7f1954153e80 2023-10-14T09:19:02.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195c405640 1 -- 172.21.15.78:0/837450156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1954153e80 msgr2=0x7f19540c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195c405640 1 --2- 172.21.15.78:0/837450156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1954153e80 0x7f19540c7780 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1944009870 tx=0x7f194401c420 comp rx=0 tx=0).stop 2023-10-14T09:19:02.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195c405640 1 -- 172.21.15.78:0/837450156 shutdown_connections 2023-10-14T09:19:02.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195c405640 1 --2- 172.21.15.78:0/837450156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19540c6910 0x7f19540c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195c405640 1 --2- 172.21.15.78:0/837450156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1954153e80 0x7f19540c7780 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195c405640 1 -- 172.21.15.78:0/837450156 >> 172.21.15.78:0/837450156 conn(0x7f19540ab1f0 msgr2=0x7f19540ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:02.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195c405640 1 -- 172.21.15.78:0/837450156 shutdown_connections 2023-10-14T09:19:02.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195c405640 1 -- 172.21.15.78:0/837450156 wait complete. 2023-10-14T09:19:02.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.162+0000 7f195c405640 1 Processor -- start 2023-10-14T09:19:02.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195c405640 1 -- start start 2023-10-14T09:19:02.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195c405640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19540c6910 0x7f19541523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195c405640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f195414ddb0 0x7f1954152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195c405640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1954153e80 0x7f19541efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195c405640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19541ece40 con 0x7f1954153e80 2023-10-14T09:19:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195c405640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19541ed050 con 0x7f195414ddb0 2023-10-14T09:19:02.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195c405640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540c3110 con 0x7f19540c6910 2023-10-14T09:19:02.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195a9a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1954153e80 0x7f19541efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195a9a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1954153e80 0x7f19541efa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47204/0 (socket says 172.21.15.78:47204) 2023-10-14T09:19:02.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195a9a2640 1 -- 172.21.15.78:0/3462991350 learned_addr learned my addr 172.21.15.78:0/3462991350 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195a1a1640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19540c6910 0x7f19541523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f19599a0640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f195414ddb0 0x7f1954152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195a9a2640 1 -- 172.21.15.78:0/3462991350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19540c6910 msgr2=0x7f19541523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195a9a2640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19540c6910 0x7f19541523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195a9a2640 1 -- 172.21.15.78:0/3462991350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f195414ddb0 msgr2=0x7f1954152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195a9a2640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f195414ddb0 0x7f1954152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195a9a2640 1 -- 172.21.15.78:0/3462991350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19440094d0 con 0x7f1954153e80 2023-10-14T09:19:02.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195a9a2640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1954153e80 0x7f19541efa10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f194c007e60 tx=0x7f194c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:02.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f194affd640 1 -- 172.21.15.78:0/3462991350 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c014420 con 0x7f1954153e80 2023-10-14T09:19:02.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f194affd640 1 -- 172.21.15.78:0/3462991350 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c0145a0 con 0x7f1954153e80 2023-10-14T09:19:02.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195c405640 1 -- 172.21.15.78:0/3462991350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19540c33f0 con 0x7f1954153e80 2023-10-14T09:19:02.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f194affd640 1 -- 172.21.15.78:0/3462991350 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c014950 con 0x7f1954153e80 2023-10-14T09:19:02.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195c405640 1 -- 172.21.15.78:0/3462991350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195414bac0 con 0x7f1954153e80 2023-10-14T09:19:02.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.166+0000 7f195c405640 1 -- 172.21.15.78:0/3462991350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1954074180 con 0x7f1954153e80 2023-10-14T09:19:02.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.170+0000 7f194affd640 1 -- 172.21.15.78:0/3462991350 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f194c014ab0 con 0x7f1954153e80 2023-10-14T09:19:02.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.170+0000 7f194affd640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f19380664a0 0x7f1938068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.170+0000 7f194affd640 1 -- 172.21.15.78:0/3462991350 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f194c084680 con 0x7f1954153e80 2023-10-14T09:19:02.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.170+0000 7f195a1a1640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f19380664a0 0x7f1938068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.170+0000 7f195a1a1640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f19380664a0 0x7f1938068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1950007fd0 tx=0x7f1950009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:02.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.174+0000 7f194affd640 1 -- 172.21.15.78:0/3462991350 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f194c051b80 con 0x7f1954153e80 2023-10-14T09:19:02.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.354+0000 7f195c405640 1 -- 172.21.15.78:0/3462991350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19540c7560 con 0x7f1954153e80 2023-10-14T09:19:02.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.354+0000 7f194affd640 1 -- 172.21.15.78:0/3462991350 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f194c0551a0 con 0x7f1954153e80 2023-10-14T09:19:02.363 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:02.364 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:19:02.365 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:19:02.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 -- 172.21.15.78:0/3462991350 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f19380664a0 msgr2=0x7f1938068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f19380664a0 0x7f1938068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1950007fd0 tx=0x7f1950009040 comp rx=0 tx=0).stop 2023-10-14T09:19:02.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 -- 172.21.15.78:0/3462991350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1954153e80 msgr2=0x7f19541efa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1954153e80 0x7f19541efa10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f194c007e60 tx=0x7f194c00e4b0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 -- 172.21.15.78:0/3462991350 shutdown_connections 2023-10-14T09:19:02.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1954153e80 0x7f19541efa10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f195414ddb0 0x7f1954152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f19380664a0 0x7f1938068960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 --2- 172.21.15.78:0/3462991350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f19540c6910 0x7f19541523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 -- 172.21.15.78:0/3462991350 >> 172.21.15.78:0/3462991350 conn(0x7f19540ab1f0 msgr2=0x7f19540a9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:02.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 -- 172.21.15.78:0/3462991350 shutdown_connections 2023-10-14T09:19:02.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.358+0000 7f195c405640 1 -- 172.21.15.78:0/3462991350 wait complete. 2023-10-14T09:19:02.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:19:02.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd4e26b640 1 Processor -- start 2023-10-14T09:19:02.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd4e26b640 1 -- start start 2023-10-14T09:19:02.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd4e26b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efd480a87c0 0x7efd4806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd4e26b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd48152a60 con 0x7efd4813b050 2023-10-14T09:19:02.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd4e26b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd48151e50 con 0x7efd480a8360 2023-10-14T09:19:02.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd4e26b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480a9340 con 0x7efd480a87c0 2023-10-14T09:19:02.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd47fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efd4813b050 0x7efd48155a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43044/0 (socket says 172.21.15.78:43044) 2023-10-14T09:19:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd47fff640 1 -- 172.21.15.78:0/2114832661 learned_addr learned my addr 172.21.15.78:0/2114832661 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd4c808640 1 --2- 172.21.15.78:0/2114832661 >> v2:172.21.15.157:3300/0 conn(0x7efd480a87c0 0x7efd4806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219281388 0 0) 0x7efd48152a60 con 0x7efd4813b050 2023-10-14T09:19:02.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd30003530 con 0x7efd4813b050 2023-10-14T09:19:02.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350622247 0 0) 0x7efd48151e50 con 0x7efd480a8360 2023-10-14T09:19:02.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd48152a60 con 0x7efd480a8360 2023-10-14T09:19:02.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1604860316 0 0) 0x7efd30003530 con 0x7efd4813b050 2023-10-14T09:19:02.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 >> v2:172.21.15.157:3300/0 conn(0x7efd480a87c0 msgr2=0x7efd4806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd46ffd640 1 --2- 172.21.15.78:0/2114832661 >> v2:172.21.15.157:3300/0 conn(0x7efd480a87c0 0x7efd4806d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 >> v1:172.21.15.157:6789/0 conn(0x7efd480a8360 legacy=0x7efd4806cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48152130 con 0x7efd4813b050 2023-10-14T09:19:02.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.514+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7efd38001680 con 0x7efd4813b050 2023-10-14T09:19:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 >> v1:172.21.15.78:6789/0 conn(0x7efd4813b050 legacy=0x7efd48155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd46ffd640 1 --2- 172.21.15.78:0/2114832661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 0x7efd30003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd46ffd640 1 --2- 172.21.15.78:0/2114832661 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd300047d0 0x7efd30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd46ffd640 1 --2- 172.21.15.78:0/2114832661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd30005190 0x7efd3000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480a9340 con 0x7efd30003b10 2023-10-14T09:19:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3000c0c0 con 0x7efd30005190 2023-10-14T09:19:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3000c280 con 0x7efd300047d0 2023-10-14T09:19:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd47fff640 1 --2- 172.21.15.78:0/2114832661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 0x7efd30003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd4c808640 1 --2- 172.21.15.78:0/2114832661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd30005190 0x7efd3000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd477fe640 1 --2- 172.21.15.78:0/2114832661 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd300047d0 0x7efd30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd47fff640 1 -- 172.21.15.78:0/2114832661 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd300047d0 msgr2=0x7efd30004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd47fff640 1 --2- 172.21.15.78:0/2114832661 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd300047d0 0x7efd30004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd47fff640 1 -- 172.21.15.78:0/2114832661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd30005190 msgr2=0x7efd3000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd47fff640 1 --2- 172.21.15.78:0/2114832661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd30005190 0x7efd3000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd47fff640 1 -- 172.21.15.78:0/2114832661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd30003530 con 0x7efd30003b10 2023-10-14T09:19:02.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd4c808640 1 -- 172.21.15.78:0/2114832661 reap_dead start 2023-10-14T09:19:02.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd47fff640 1 --2- 172.21.15.78:0/2114832661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 0x7efd30003f10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efd3800c160 tx=0x7efd3801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9407e283d333698b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:02.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.518+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd380058e0 con 0x7efd30003b10 2023-10-14T09:19:02.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd38005a60 con 0x7efd30003b10 2023-10-14T09:19:02.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd46ffd640 1 -- 172.21.15.78:0/2114832661 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38005e50 con 0x7efd30003b10 2023-10-14T09:19:02.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 -- 172.21.15.78:0/2114832661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 msgr2=0x7efd30003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 --2- 172.21.15.78:0/2114832661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 0x7efd30003f10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efd3800c160 tx=0x7efd3801cbc0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 -- 172.21.15.78:0/2114832661 shutdown_connections 2023-10-14T09:19:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 --2- 172.21.15.78:0/2114832661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 0x7efd30003f10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 -- 172.21.15.78:0/2114832661 >> 172.21.15.78:0/2114832661 conn(0x7efd480c1cc0 msgr2=0x7efd480c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:02.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 -- 172.21.15.78:0/2114832661 shutdown_connections 2023-10-14T09:19:02.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 -- 172.21.15.78:0/2114832661 wait complete. 2023-10-14T09:19:02.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 Processor -- start 2023-10-14T09:19:02.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 -- start start 2023-10-14T09:19:02.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 0x7efd480c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd480719b0 0x7efd481e3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd48152e60 0x7efd481ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480c3bf0 con 0x7efd30003b10 2023-10-14T09:19:02.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480c4cd0 con 0x7efd48152e60 2023-10-14T09:19:02.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4e26b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd480c3000 con 0x7efd480719b0 2023-10-14T09:19:02.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd47fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 0x7efd480c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd47fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 0x7efd480c3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47232/0 (socket says 172.21.15.78:47232) 2023-10-14T09:19:02.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd47fff640 1 -- 172.21.15.78:0/1342198696 learned_addr learned my addr 172.21.15.78:0/1342198696 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:02.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd477fe640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd480719b0 0x7efd481e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.522+0000 7efd4c808640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd48152e60 0x7efd481ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd47fff640 1 -- 172.21.15.78:0/1342198696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd480719b0 msgr2=0x7efd481e3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd47fff640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd480719b0 0x7efd481e3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd47fff640 1 -- 172.21.15.78:0/1342198696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd48152e60 msgr2=0x7efd481ec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd47fff640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd48152e60 0x7efd481ec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd47fff640 1 -- 172.21.15.78:0/1342198696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480c4f00 con 0x7efd30003b10 2023-10-14T09:19:02.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd47fff640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 0x7efd480c3490 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7efd380ab040 tx=0x7efd30005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd44ff9640 1 -- 172.21.15.78:0/1342198696 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd380a58a0 con 0x7efd30003b10 2023-10-14T09:19:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd44ff9640 1 -- 172.21.15.78:0/1342198696 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd380a5a00 con 0x7efd30003b10 2023-10-14T09:19:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd4e26b640 1 -- 172.21.15.78:0/1342198696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd481f0620 con 0x7efd30003b10 2023-10-14T09:19:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd44ff9640 1 -- 172.21.15.78:0/1342198696 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd380a5d70 con 0x7efd30003b10 2023-10-14T09:19:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd4e26b640 1 -- 172.21.15.78:0/1342198696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd481e3b90 con 0x7efd30003b10 2023-10-14T09:19:02.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd4e26b640 1 -- 172.21.15.78:0/1342198696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd481f0b40 con 0x7efd30003b10 2023-10-14T09:19:02.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd44ff9640 1 -- 172.21.15.78:0/1342198696 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efd380047f0 con 0x7efd30003b10 2023-10-14T09:19:02.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd44ff9640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd340664d0 0x7efd34068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd44ff9640 1 -- 172.21.15.78:0/1342198696 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7efd3811d660 con 0x7efd30003b10 2023-10-14T09:19:02.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.526+0000 7efd477fe640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd340664d0 0x7efd34068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.530+0000 7efd477fe640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd340664d0 0x7efd34068990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efd481e0e50 tx=0x7efd3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:02.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.530+0000 7efd44ff9640 1 -- 172.21.15.78:0/1342198696 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efd380eaab0 con 0x7efd30003b10 2023-10-14T09:19:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.682+0000 7efd4e26b640 1 -- 172.21.15.78:0/1342198696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd480c2df0 con 0x7efd30003b10 2023-10-14T09:19:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.682+0000 7efd44ff9640 1 -- 172.21.15.78:0/1342198696 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16589 (secure 0 0 0) 0x7efd380ee0d0 con 0x7efd30003b10 2023-10-14T09:19:02.689 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:02.690 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":32,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:18:17.070566+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T09:18:13.661984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T09:18:15.003533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:19:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 -- 172.21.15.78:0/1342198696 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd340664d0 msgr2=0x7efd34068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd340664d0 0x7efd34068990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efd481e0e50 tx=0x7efd3c009040 comp rx=0 tx=0).stop 2023-10-14T09:19:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 -- 172.21.15.78:0/1342198696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 msgr2=0x7efd480c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 0x7efd480c3490 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7efd380ab040 tx=0x7efd30005800 comp rx=0 tx=0).stop 2023-10-14T09:19:02.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 -- 172.21.15.78:0/1342198696 shutdown_connections 2023-10-14T09:19:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd48152e60 0x7efd481ec6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7efd340664d0 0x7efd34068990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efd480719b0 0x7efd481e3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 --2- 172.21.15.78:0/1342198696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd30003b10 0x7efd480c3490 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 -- 172.21.15.78:0/1342198696 >> 172.21.15.78:0/1342198696 conn(0x7efd480c1cc0 msgr2=0x7efd480aa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:02.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 -- 172.21.15.78:0/1342198696 shutdown_connections 2023-10-14T09:19:02.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.686+0000 7efd4e26b640 1 -- 172.21.15.78:0/1342198696 wait complete. 2023-10-14T09:19:02.711 INFO:tasks.cephfs.filesystem:Destroying file system testcephfs1 and related pools 2023-10-14T09:19:02.712 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:19:02.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.842+0000 7fb81392a640 1 Processor -- start 2023-10-14T09:19:02.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.842+0000 7fb81392a640 1 -- start start 2023-10-14T09:19:02.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.842+0000 7fb81392a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb80c1513c0 0x7fb80c0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb81392a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb80c1541a0 0x7fb80c154600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb81392a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80c153d50 con 0x7fb80c0c1e20 2023-10-14T09:19:02.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb81392a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80c06f7b0 con 0x7fb80c1541a0 2023-10-14T09:19:02.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb81392a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c158100 con 0x7fb80c1513c0 2023-10-14T09:19:02.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb811ec7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb80c1541a0 0x7fb80c154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb811ec7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb80c1541a0 0x7fb80c154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47240/0 (socket says 172.21.15.78:47240) 2023-10-14T09:19:02.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb811ec7640 1 -- 172.21.15.78:0/3356435022 learned_addr learned my addr 172.21.15.78:0/3356435022 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:02.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb8116c6640 1 --2- 172.21.15.78:0/3356435022 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb80c1513c0 0x7fb80c0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb811ec7640 1 -- 172.21.15.78:0/3356435022 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb80c1513c0 msgr2=0x7fb80c0c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:02.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb811ec7640 1 --2- 172.21.15.78:0/3356435022 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb80c1513c0 0x7fb80c0c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb811ec7640 1 -- 172.21.15.78:0/3356435022 >> v1:172.21.15.157:6789/0 conn(0x7fb80c0c1e20 legacy=0x7fb80c0c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb811ec7640 1 -- 172.21.15.78:0/3356435022 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c06f9c0 con 0x7fb80c1541a0 2023-10-14T09:19:02.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb811ec7640 1 --2- 172.21.15.78:0/3356435022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb80c1541a0 0x7fb80c154600 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb804009e50 tx=0x7fb80401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0a6a860d886f88 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb803fff640 1 -- 172.21.15.78:0/3356435022 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8040a57f0 con 0x7fb80c1541a0 2023-10-14T09:19:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb803fff640 1 -- 172.21.15.78:0/3356435022 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8040a5950 con 0x7fb80c1541a0 2023-10-14T09:19:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.846+0000 7fb803fff640 1 -- 172.21.15.78:0/3356435022 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8040a5ce0 con 0x7fb80c1541a0 2023-10-14T09:19:02.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 -- 172.21.15.78:0/3356435022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb80c1541a0 msgr2=0x7fb80c154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 --2- 172.21.15.78:0/3356435022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb80c1541a0 0x7fb80c154600 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb804009e50 tx=0x7fb80401ca10 comp rx=0 tx=0).stop 2023-10-14T09:19:02.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 -- 172.21.15.78:0/3356435022 shutdown_connections 2023-10-14T09:19:02.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 --2- 172.21.15.78:0/3356435022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb80c1541a0 0x7fb80c154600 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 --2- 172.21.15.78:0/3356435022 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb80c1513c0 0x7fb80c0c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 -- 172.21.15.78:0/3356435022 >> 172.21.15.78:0/3356435022 conn(0x7fb80c06a060 msgr2=0x7fb80c06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:02.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 -- 172.21.15.78:0/3356435022 shutdown_connections 2023-10-14T09:19:02.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 -- 172.21.15.78:0/3356435022 wait complete. 2023-10-14T09:19:02.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 Processor -- start 2023-10-14T09:19:02.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 -- start start 2023-10-14T09:19:02.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb80c0c1e20 0x7fb80c1efe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb80c1513c0 0x7fb80c156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb80c1541a0 0x7fb80c1ec070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0befc0 con 0x7fb80c1513c0 2023-10-14T09:19:02.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c1f03c0 con 0x7fb80c1541a0 2023-10-14T09:19:02.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb81392a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0be710 con 0x7fb80c0c1e20 2023-10-14T09:19:02.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb810ec5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb80c1513c0 0x7fb80c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb810ec5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb80c1513c0 0x7fb80c156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47252/0 (socket says 172.21.15.78:47252) 2023-10-14T09:19:02.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb810ec5640 1 -- 172.21.15.78:0/1436559653 learned_addr learned my addr 172.21.15.78:0/1436559653 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:02.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb811ec7640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb80c1541a0 0x7fb80c1ec070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb8116c6640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb80c0c1e20 0x7fb80c1efe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb810ec5640 1 -- 172.21.15.78:0/1436559653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb80c0c1e20 msgr2=0x7fb80c1efe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb810ec5640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb80c0c1e20 0x7fb80c1efe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb810ec5640 1 -- 172.21.15.78:0/1436559653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb80c1541a0 msgr2=0x7fb80c1ec070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:02.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb810ec5640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb80c1541a0 0x7fb80c1ec070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:02.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb810ec5640 1 -- 172.21.15.78:0/1436559653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804009b30 con 0x7fb80c1513c0 2023-10-14T09:19:02.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.850+0000 7fb811ec7640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb80c1541a0 0x7fb80c1ec070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:02.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb810ec5640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb80c1513c0 0x7fb80c156380 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00c390 tx=0x7fb7fc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:02.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb801ffb640 1 -- 172.21.15.78:0/1436559653 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0052d0 con 0x7fb80c1513c0 2023-10-14T09:19:02.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb801ffb640 1 -- 172.21.15.78:0/1436559653 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc005430 con 0x7fb80c1513c0 2023-10-14T09:19:02.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb81392a640 1 -- 172.21.15.78:0/1436559653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80c0be9f0 con 0x7fb80c1513c0 2023-10-14T09:19:02.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb801ffb640 1 -- 172.21.15.78:0/1436559653 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc003820 con 0x7fb80c1513c0 2023-10-14T09:19:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb81392a640 1 -- 172.21.15.78:0/1436559653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c157320 con 0x7fb80c1513c0 2023-10-14T09:19:02.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb81392a640 1 -- 172.21.15.78:0/1436559653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c1ecd70 con 0x7fb80c1513c0 2023-10-14T09:19:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb801ffb640 1 -- 172.21.15.78:0/1436559653 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb7fc003980 con 0x7fb80c1513c0 2023-10-14T09:19:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb801ffb640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb7f00664d0 0x7fb7f0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:02.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb801ffb640 1 -- 172.21.15.78:0/1436559653 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb7fc0832c0 con 0x7fb80c1513c0 2023-10-14T09:19:02.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb8116c6640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb7f00664d0 0x7fb7f0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:02.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.854+0000 7fb8116c6640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb7f00664d0 0x7fb7f0068990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb808009b60 tx=0x7fb808009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:02.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:02.858+0000 7fb801ffb640 1 -- 172.21.15.78:0/1436559653 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb7fc0507c0 con 0x7fb80c1513c0 2023-10-14T09:19:03.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.050+0000 7fb81392a640 1 -- 172.21.15.78:0/1436559653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb80c074180 con 0x7fb80c1513c0 2023-10-14T09:19:03.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.050+0000 7fb801ffb640 1 -- 172.21.15.78:0/1436559653 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fb7fc053de0 con 0x7fb80c1513c0 2023-10-14T09:19:03.057 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:03.058 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:19:03.059 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:19:03.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 -- 172.21.15.78:0/1436559653 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb7f00664d0 msgr2=0x7fb7f0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb7f00664d0 0x7fb7f0068990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb808009b60 tx=0x7fb808009190 comp rx=0 tx=0).stop 2023-10-14T09:19:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 -- 172.21.15.78:0/1436559653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb80c1513c0 msgr2=0x7fb80c156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb80c1513c0 0x7fb80c156380 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00c390 tx=0x7fb7fc00c850 comp rx=0 tx=0).stop 2023-10-14T09:19:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 -- 172.21.15.78:0/1436559653 shutdown_connections 2023-10-14T09:19:03.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb80c1541a0 0x7fb80c1ec070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb80c1513c0 0x7fb80c156380 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fb7f00664d0 0x7fb7f0068990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 --2- 172.21.15.78:0/1436559653 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb80c0c1e20 0x7fb80c1efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 -- 172.21.15.78:0/1436559653 >> 172.21.15.78:0/1436559653 conn(0x7fb80c06a060 msgr2=0x7fb80c154580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:03.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 -- 172.21.15.78:0/1436559653 shutdown_connections 2023-10-14T09:19:03.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.054+0000 7fb81392a640 1 -- 172.21.15.78:0/1436559653 wait complete. 2023-10-14T09:19:03.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:19:03.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b21a17640 1 Processor -- start 2023-10-14T09:19:03.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b21a17640 1 -- start start 2023-10-14T09:19:03.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b21a17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b1c151240 0x7f9b1c157e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b21a17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b1c0c4fa0 0x7f9b1c0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b21a17640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c0c4950 con 0x7f9b1c0c4400 2023-10-14T09:19:03.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b21a17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c157370 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b21a17640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c157650 con 0x7f9b1c151240 2023-10-14T09:19:03.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b1a7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b1c0c4fa0 0x7f9b1c0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b1b7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9b1c0c4400 0x7f9b1c0c5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43050/0 (socket says 172.21.15.78:43050) 2023-10-14T09:19:03.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b1b7fe640 1 -- 172.21.15.78:0/3566393097 learned_addr learned my addr 172.21.15.78:0/3566393097 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:03.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b1affd640 1 --2- 172.21.15.78:0/3566393097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b1c151240 0x7f9b1c157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b1a7fc640 1 -- 172.21.15.78:0/3566393097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b1c151240 msgr2=0x7f9b1c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:03.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b1a7fc640 1 --2- 172.21.15.78:0/3566393097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b1c151240 0x7f9b1c157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b1a7fc640 1 -- 172.21.15.78:0/3566393097 >> v1:172.21.15.78:6789/0 conn(0x7f9b1c0c4400 legacy=0x7f9b1c0c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b1a7fc640 1 -- 172.21.15.78:0/3566393097 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c157930 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b19ffb640 1 -- 172.21.15.78:0/3566393097 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772771367 0 0) 0x7f9b1c0c4950 con 0x7f9b1c0c4400 2023-10-14T09:19:03.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.210+0000 7f9b1affd640 1 --2- 172.21.15.78:0/3566393097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b1c151240 0x7f9b1c157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:19:03.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b1a7fc640 1 --2- 172.21.15.78:0/3566393097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c0c4fa0 0x7f9b1c0c74e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9b100097f0 tx=0x7f9b1001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c5989e92388882 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:03.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b19ffb640 1 -- 172.21.15.78:0/3566393097 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b100a4ea0 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b19ffb640 1 -- 172.21.15.78:0/3566393097 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b100a7050 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b19ffb640 1 -- 172.21.15.78:0/3566393097 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b100ab820 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b21a17640 1 -- 172.21.15.78:0/3566393097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c0c4fa0 msgr2=0x7f9b1c0c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b21a17640 1 --2- 172.21.15.78:0/3566393097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c0c4fa0 0x7f9b1c0c74e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9b100097f0 tx=0x7f9b1001c3f0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b21a17640 1 -- 172.21.15.78:0/3566393097 shutdown_connections 2023-10-14T09:19:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b21a17640 1 --2- 172.21.15.78:0/3566393097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c0c4fa0 0x7f9b1c0c74e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b21a17640 1 --2- 172.21.15.78:0/3566393097 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b1c151240 0x7f9b1c157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b21a17640 1 -- 172.21.15.78:0/3566393097 >> 172.21.15.78:0/3566393097 conn(0x7f9b1c0c6060 msgr2=0x7f9b1c0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b21a17640 1 -- 172.21.15.78:0/3566393097 shutdown_connections 2023-10-14T09:19:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.214+0000 7f9b21a17640 1 -- 172.21.15.78:0/3566393097 wait complete. 2023-10-14T09:19:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b21a17640 1 Processor -- start 2023-10-14T09:19:03.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b21a17640 1 -- start start 2023-10-14T09:19:03.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b21a17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b1c0c4400 0x7f9b1c1477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b21a17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c0c4fa0 0x7f9b1c15da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b21a17640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b1c151240 0x7f9b1c1ef560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b21a17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c1ef110 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b21a17640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0bf9c0 con 0x7f9b1c151240 2023-10-14T09:19:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b21a17640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0bfca0 con 0x7f9b1c0c4400 2023-10-14T09:19:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b1a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c0c4fa0 0x7f9b1c15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b1a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c0c4fa0 0x7f9b1c15da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47272/0 (socket says 172.21.15.78:47272) 2023-10-14T09:19:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b1a7fc640 1 -- 172.21.15.78:0/237095301 learned_addr learned my addr 172.21.15.78:0/237095301 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:03.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b1affd640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b1c0c4400 0x7f9b1c1477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b1b7fe640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b1c151240 0x7f9b1c1ef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b1a7fc640 1 -- 172.21.15.78:0/237095301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b1c0c4400 msgr2=0x7f9b1c1477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b1a7fc640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b1c0c4400 0x7f9b1c1477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b1a7fc640 1 -- 172.21.15.78:0/237095301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b1c151240 msgr2=0x7f9b1c1ef560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b1a7fc640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b1c151240 0x7f9b1c1ef560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b1a7fc640 1 -- 172.21.15.78:0/237095301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10009420 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b1a7fc640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c0c4fa0 0x7f9b1c15da60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9b100ae040 tx=0x7f9b10019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:03.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b03fff640 1 -- 172.21.15.78:0/237095301 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b100b4610 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b03fff640 1 -- 172.21.15.78:0/237095301 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b100abe90 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b21a17640 1 -- 172.21.15.78:0/237095301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c0bff80 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b03fff640 1 -- 172.21.15.78:0/237095301 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b100b49d0 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b21a17640 1 -- 172.21.15.78:0/237095301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c0bf690 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.218+0000 7f9b21a17640 1 -- 172.21.15.78:0/237095301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c1ef280 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.222+0000 7f9b03fff640 1 -- 172.21.15.78:0/237095301 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9b100b2040 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.222+0000 7f9b03fff640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b080664d0 0x7f9b08068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.222+0000 7f9b03fff640 1 -- 172.21.15.78:0/237095301 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f9b1011df60 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.222+0000 7f9b1affd640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b080664d0 0x7f9b08068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.222+0000 7f9b1affd640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b080664d0 0x7f9b08068990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c006fd0 tx=0x7f9b0c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.226+0000 7f9b03fff640 1 -- 172.21.15.78:0/237095301 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b1c1ef280 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b21a17640 1 -- 172.21.15.78:0/237095301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b1c1ef250 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b03fff640 1 -- 172.21.15.78:0/237095301 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f9b100eb3b0 con 0x7f9b1c0c4fa0 2023-10-14T09:19:03.421 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:03.421 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T09:18:16.002036+0000","modified":"2023-10-14T09:18:19.017889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5109":{"gid":5109,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/4241140805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":4241140805},{"type":"v1","addr":"172.21.15.78:6837","nonce":4241140805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T09:19:03.421 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-10-14T09:19:03.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b21a17640 1 -- 172.21.15.78:0/237095301 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b080664d0 msgr2=0x7f9b08068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b21a17640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b080664d0 0x7f9b08068990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c006fd0 tx=0x7f9b0c008040 comp rx=0 tx=0).stop 2023-10-14T09:19:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b21a17640 1 -- 172.21.15.78:0/237095301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c0c4fa0 msgr2=0x7f9b1c15da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b21a17640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c0c4fa0 0x7f9b1c15da60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9b100ae040 tx=0x7f9b10019190 comp rx=0 tx=0).stop 2023-10-14T09:19:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b21a17640 1 -- 172.21.15.78:0/237095301 shutdown_connections 2023-10-14T09:19:03.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b21a17640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9b1c151240 0x7f9b1c1ef560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b21a17640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b1c0c4fa0 0x7f9b1c15da60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b21a17640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9b080664d0 0x7f9b08068990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b21a17640 1 --2- 172.21.15.78:0/237095301 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9b1c0c4400 0x7f9b1c1477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.414+0000 7f9b21a17640 1 -- 172.21.15.78:0/237095301 >> 172.21.15.78:0/237095301 conn(0x7f9b1c0c6060 msgr2=0x7f9b1c0c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:03.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.418+0000 7f9b21a17640 1 -- 172.21.15.78:0/237095301 shutdown_connections 2023-10-14T09:19:03.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.418+0000 7f9b21a17640 1 -- 172.21.15.78:0/237095301 wait complete. 2023-10-14T09:19:03.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:19:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda50454640 1 Processor -- start 2023-10-14T09:19:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda50454640 1 -- start start 2023-10-14T09:19:03.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda50454640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda4814ddb0 0x7fda480c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda50454640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4806c470 con 0x7fda480c6910 2023-10-14T09:19:03.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda50454640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4806c750 con 0x7fda48153e80 2023-10-14T09:19:03.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda50454640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480c64f0 con 0x7fda4814ddb0 2023-10-14T09:19:03.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda4e9f1640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fda480c6910 0x7fda480c3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43060/0 (socket says 172.21.15.78:43060) 2023-10-14T09:19:03.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda4e9f1640 1 -- 172.21.15.78:0/178030039 learned_addr learned my addr 172.21.15.78:0/178030039 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:03.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda4e1f0640 1 --2- 172.21.15.78:0/178030039 >> v2:172.21.15.78:3300/0 conn(0x7fda4814ddb0 0x7fda480c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda4e1f0640 1 -- 172.21.15.78:0/178030039 >> v1:172.21.15.157:6789/0 conn(0x7fda48153e80 legacy=0x7fda4806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda4e1f0640 1 -- 172.21.15.78:0/178030039 >> v1:172.21.15.78:6789/0 conn(0x7fda480c6910 legacy=0x7fda480c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda4e1f0640 1 -- 172.21.15.78:0/178030039 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4806ca30 con 0x7fda4814ddb0 2023-10-14T09:19:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.574+0000 7fda4d1ee640 1 -- 172.21.15.78:0/178030039 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245645568 0 0) 0x7fda4806c470 con 0x7fda480c6910 2023-10-14T09:19:03.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.578+0000 7fda4e1f0640 1 --2- 172.21.15.78:0/178030039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda4814ddb0 0x7fda480c7780 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fda440097c0 tx=0x7fda4401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c421c98ffbeeddd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.578+0000 7fda4d1ee640 1 -- 172.21.15.78:0/178030039 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda440ab600 con 0x7fda4814ddb0 2023-10-14T09:19:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.578+0000 7fda4d1ee640 1 -- 172.21.15.78:0/178030039 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda440a7050 con 0x7fda4814ddb0 2023-10-14T09:19:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.578+0000 7fda4d1ee640 1 -- 172.21.15.78:0/178030039 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda440ab980 con 0x7fda4814ddb0 2023-10-14T09:19:03.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.578+0000 7fda50454640 1 -- 172.21.15.78:0/178030039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda4814ddb0 msgr2=0x7fda480c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.578+0000 7fda50454640 1 --2- 172.21.15.78:0/178030039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda4814ddb0 0x7fda480c7780 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fda440097c0 tx=0x7fda4401c360 comp rx=0 tx=0).stop 2023-10-14T09:19:03.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.578+0000 7fda50454640 1 -- 172.21.15.78:0/178030039 shutdown_connections 2023-10-14T09:19:03.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.578+0000 7fda50454640 1 --2- 172.21.15.78:0/178030039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda4814ddb0 0x7fda480c7780 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.578+0000 7fda50454640 1 -- 172.21.15.78:0/178030039 >> 172.21.15.78:0/178030039 conn(0x7fda480ab1f0 msgr2=0x7fda480ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:03.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.578+0000 7fda50454640 1 -- 172.21.15.78:0/178030039 shutdown_connections 2023-10-14T09:19:03.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.578+0000 7fda50454640 1 -- 172.21.15.78:0/178030039 wait complete. 2023-10-14T09:19:03.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda50454640 1 Processor -- start 2023-10-14T09:19:03.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda50454640 1 -- start start 2023-10-14T09:19:03.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda50454640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda480c6910 0x7fda480c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda50454640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda4814ddb0 0x7fda481576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda50454640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda48153e80 0x7fda480bd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda50454640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda481ed1a0 con 0x7fda48153e80 2023-10-14T09:19:03.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda50454640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda481566d0 con 0x7fda4814ddb0 2023-10-14T09:19:03.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda50454640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda48157230 con 0x7fda480c6910 2023-10-14T09:19:03.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4e9f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda48153e80 0x7fda480bd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4e9f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda48153e80 0x7fda480bd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47284/0 (socket says 172.21.15.78:47284) 2023-10-14T09:19:03.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4e9f1640 1 -- 172.21.15.78:0/335265466 learned_addr learned my addr 172.21.15.78:0/335265466 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:03.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4e1f0640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda480c6910 0x7fda480c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4d9ef640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda4814ddb0 0x7fda481576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4e9f1640 1 -- 172.21.15.78:0/335265466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda480c6910 msgr2=0x7fda480c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4e9f1640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda480c6910 0x7fda480c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4e9f1640 1 -- 172.21.15.78:0/335265466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda4814ddb0 msgr2=0x7fda481576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4e9f1640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda4814ddb0 0x7fda481576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4e9f1640 1 -- 172.21.15.78:0/335265466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44009420 con 0x7fda48153e80 2023-10-14T09:19:03.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4e1f0640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda480c6910 0x7fda480c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:03.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda4e9f1640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda48153e80 0x7fda480bd730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fda4000c7b0 tx=0x7fda4000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda3effd640 1 -- 172.21.15.78:0/335265466 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000a640 con 0x7fda48153e80 2023-10-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda3effd640 1 -- 172.21.15.78:0/335265466 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4000a7c0 con 0x7fda48153e80 2023-10-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda50454640 1 -- 172.21.15.78:0/335265466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda480c1df0 con 0x7fda48153e80 2023-10-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda3effd640 1 -- 172.21.15.78:0/335265466 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4000ab70 con 0x7fda48153e80 2023-10-14T09:19:03.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.582+0000 7fda50454640 1 -- 172.21.15.78:0/335265466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda48156be0 con 0x7fda48153e80 2023-10-14T09:19:03.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.586+0000 7fda50454640 1 -- 172.21.15.78:0/335265466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda481573e0 con 0x7fda48153e80 2023-10-14T09:19:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.586+0000 7fda3effd640 1 -- 172.21.15.78:0/335265466 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fda4000acd0 con 0x7fda48153e80 2023-10-14T09:19:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.586+0000 7fda3effd640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda2c0664d0 0x7fda2c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.586+0000 7fda3effd640 1 -- 172.21.15.78:0/335265466 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fda40083730 con 0x7fda48153e80 2023-10-14T09:19:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.586+0000 7fda4e1f0640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda2c0664d0 0x7fda2c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.586+0000 7fda4e1f0640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda2c0664d0 0x7fda2c068990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda440ad000 tx=0x7fda440a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:03.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.590+0000 7fda3effd640 1 -- 172.21.15.78:0/335265466 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fda481573e0 con 0x7fda48153e80 2023-10-14T09:19:03.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.742+0000 7fda50454640 1 -- 172.21.15.78:0/335265466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda481573e0 con 0x7fda48153e80 2023-10-14T09:19:03.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda3effd640 1 -- 172.21.15.78:0/335265466 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16589 (secure 0 0 0) 0x7fda481573e0 con 0x7fda48153e80 2023-10-14T09:19:03.751 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:03.751 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":32,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:18:17.070566+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T09:18:13.661984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T09:18:15.003533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:19:03.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 -- 172.21.15.78:0/335265466 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda2c0664d0 msgr2=0x7fda2c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda2c0664d0 0x7fda2c068990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda440ad000 tx=0x7fda440a6000 comp rx=0 tx=0).stop 2023-10-14T09:19:03.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 -- 172.21.15.78:0/335265466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda48153e80 msgr2=0x7fda480bd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda48153e80 0x7fda480bd730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fda4000c7b0 tx=0x7fda4000cc70 comp rx=0 tx=0).stop 2023-10-14T09:19:03.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 -- 172.21.15.78:0/335265466 shutdown_connections 2023-10-14T09:19:03.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda48153e80 0x7fda480bd730 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fda4814ddb0 0x7fda481576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fda2c0664d0 0x7fda2c068990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 --2- 172.21.15.78:0/335265466 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fda480c6910 0x7fda480c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 -- 172.21.15.78:0/335265466 >> 172.21.15.78:0/335265466 conn(0x7fda480ab1f0 msgr2=0x7fda480bc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:03.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 -- 172.21.15.78:0/335265466 shutdown_connections 2023-10-14T09:19:03.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.746+0000 7fda50454640 1 -- 172.21.15.78:0/335265466 wait complete. 2023-10-14T09:19:03.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail testcephfs1 2023-10-14T09:19:03.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.902+0000 7ff3dbd72640 1 Processor -- start 2023-10-14T09:19:03.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3dbd72640 1 -- start start 2023-10-14T09:19:03.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3dbd72640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3d406d640 0x7ff3d4071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3dbd72640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3d4158e10 0x7ff3d40bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3dbd72640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d4158980 con 0x7ff3d4070110 2023-10-14T09:19:03.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3dbd72640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d41580b0 con 0x7ff3d4158e10 2023-10-14T09:19:03.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3dbd72640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d406db40 con 0x7ff3d406d640 2023-10-14T09:19:03.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3d9b0e640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff3d4070110 0x7ff3d4155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43074/0 (socket says 172.21.15.78:43074) 2023-10-14T09:19:03.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3d9b0e640 1 -- 172.21.15.78:0/2231652199 learned_addr learned my addr 172.21.15.78:0/2231652199 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:03.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3da30f640 1 --2- 172.21.15.78:0/2231652199 >> v2:172.21.15.78:3300/0 conn(0x7ff3d4158e10 0x7ff3d40bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3d930d640 1 --2- 172.21.15.78:0/2231652199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3d406d640 0x7ff3d4071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3d8b0c640 1 -- 172.21.15.78:0/2231652199 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989572854 0 0) 0x7ff3d4158980 con 0x7ff3d4070110 2023-10-14T09:19:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3d8b0c640 1 -- 172.21.15.78:0/2231652199 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3c0003530 con 0x7ff3d4070110 2023-10-14T09:19:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3da30f640 1 -- 172.21.15.78:0/2231652199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3d406d640 msgr2=0x7ff3d4071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3da30f640 1 --2- 172.21.15.78:0/2231652199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3d406d640 0x7ff3d4071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3da30f640 1 -- 172.21.15.78:0/2231652199 >> v1:172.21.15.78:6789/0 conn(0x7ff3d4070110 legacy=0x7ff3d4155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.906+0000 7ff3da30f640 1 -- 172.21.15.78:0/2231652199 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d4158330 con 0x7ff3d4158e10 2023-10-14T09:19:03.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3da30f640 1 --2- 172.21.15.78:0/2231652199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3d4158e10 0x7ff3d40bfbc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009d90 tx=0x7ff3cc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caebf6e1678e2252 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:03.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3d8b0c640 1 -- 172.21.15.78:0/2231652199 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0a5900 con 0x7ff3d4158e10 2023-10-14T09:19:03.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3d8b0c640 1 -- 172.21.15.78:0/2231652199 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc0a5a60 con 0x7ff3d4158e10 2023-10-14T09:19:03.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3d8b0c640 1 -- 172.21.15.78:0/2231652199 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0a5df0 con 0x7ff3d4158e10 2023-10-14T09:19:03.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3dbd72640 1 -- 172.21.15.78:0/2231652199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3d4158e10 msgr2=0x7ff3d40bfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3dbd72640 1 --2- 172.21.15.78:0/2231652199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3d4158e10 0x7ff3d40bfbc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009d90 tx=0x7ff3cc01c920 comp rx=0 tx=0).stop 2023-10-14T09:19:03.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3dbd72640 1 -- 172.21.15.78:0/2231652199 shutdown_connections 2023-10-14T09:19:03.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3dbd72640 1 --2- 172.21.15.78:0/2231652199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3d4158e10 0x7ff3d40bfbc0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3dbd72640 1 --2- 172.21.15.78:0/2231652199 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3d406d640 0x7ff3d4071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3dbd72640 1 -- 172.21.15.78:0/2231652199 >> 172.21.15.78:0/2231652199 conn(0x7ff3d40c1cc0 msgr2=0x7ff3d40c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:03.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3dbd72640 1 -- 172.21.15.78:0/2231652199 shutdown_connections 2023-10-14T09:19:03.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3dbd72640 1 -- 172.21.15.78:0/2231652199 wait complete. 2023-10-14T09:19:03.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.910+0000 7ff3dbd72640 1 Processor -- start 2023-10-14T09:19:03.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3dbd72640 1 -- start start 2023-10-14T09:19:03.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3dbd72640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3d406d640 0x7ff3d40c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3dbd72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3d4070110 0x7ff3d4148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3dbd72640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3d4158e10 0x7ff3d41f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3dbd72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d4146940 con 0x7ff3d4070110 2023-10-14T09:19:03.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3dbd72640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d4146010 con 0x7ff3d406d640 2023-10-14T09:19:03.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3dbd72640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d41462f0 con 0x7ff3d4158e10 2023-10-14T09:19:03.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3d930d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3d4070110 0x7ff3d4148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3d930d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3d4070110 0x7ff3d4148700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47306/0 (socket says 172.21.15.78:47306) 2023-10-14T09:19:03.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3d930d640 1 -- 172.21.15.78:0/3357402035 learned_addr learned my addr 172.21.15.78:0/3357402035 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:03.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3d9b0e640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3d406d640 0x7ff3d40c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3da30f640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3d4158e10 0x7ff3d41f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3d930d640 1 -- 172.21.15.78:0/3357402035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3d4158e10 msgr2=0x7ff3d41f06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3d930d640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3d4158e10 0x7ff3d41f06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3d930d640 1 -- 172.21.15.78:0/3357402035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3d406d640 msgr2=0x7ff3d40c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3d930d640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3d406d640 0x7ff3d40c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3d930d640 1 -- 172.21.15.78:0/3357402035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc009a70 con 0x7ff3d4070110 2023-10-14T09:19:03.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3d930d640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3d4070110 0x7ff3d4148700 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400d5d0 tx=0x7ff3c400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3ca7fc640 1 -- 172.21.15.78:0/3357402035 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4004240 con 0x7ff3d4070110 2023-10-14T09:19:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3ca7fc640 1 -- 172.21.15.78:0/3357402035 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c40043a0 con 0x7ff3d4070110 2023-10-14T09:19:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3dbd72640 1 -- 172.21.15.78:0/3357402035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d41465d0 con 0x7ff3d4070110 2023-10-14T09:19:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3ca7fc640 1 -- 172.21.15.78:0/3357402035 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4003840 con 0x7ff3d4070110 2023-10-14T09:19:03.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3dbd72640 1 -- 172.21.15.78:0/3357402035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d4139a10 con 0x7ff3d4070110 2023-10-14T09:19:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3dbd72640 1 -- 172.21.15.78:0/3357402035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d4074180 con 0x7ff3d4070110 2023-10-14T09:19:03.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.914+0000 7ff3ca7fc640 1 -- 172.21.15.78:0/3357402035 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff3c40039a0 con 0x7ff3d4070110 2023-10-14T09:19:03.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.918+0000 7ff3ca7fc640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff3b80664d0 0x7ff3b8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:03.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.918+0000 7ff3ca7fc640 1 -- 172.21.15.78:0/3357402035 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7ff3c4084130 con 0x7ff3d4070110 2023-10-14T09:19:03.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.918+0000 7ff3d9b0e640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff3b80664d0 0x7ff3b8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:03.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.918+0000 7ff3d9b0e640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff3b80664d0 0x7ff3b8068990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00011f0 tx=0x7ff3d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:03.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:03.922+0000 7ff3ca7fc640 1 -- 172.21.15.78:0/3357402035 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff3c40514f0 con 0x7ff3d4070110 2023-10-14T09:19:04.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.106+0000 7ff3dbd72640 1 -- 172.21.15.78:0/3357402035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "testcephfs1"} v 0) v1 -- 0x7ff3d4146760 con 0x7ff3d4070110 2023-10-14T09:19:04.111 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-10-14T09:19:04.106+0000 7ff57b4e6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T09:19:04.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.106+0000 7ff3ca7fc640 1 -- 172.21.15.78:0/3357402035 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "testcephfs1"}]=0 testcephfs1 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7ff3c4054b10 con 0x7ff3d4070110 2023-10-14T09:19:04.113 INFO:teuthology.orchestra.run.smithi078.stderr:testcephfs1 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T09:19:04.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 -- 172.21.15.78:0/3357402035 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff3b80664d0 msgr2=0x7ff3b8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:04.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff3b80664d0 0x7ff3b8068990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00011f0 tx=0x7ff3d0009040 comp rx=0 tx=0).stop 2023-10-14T09:19:04.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 -- 172.21.15.78:0/3357402035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3d4070110 msgr2=0x7ff3d4148700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:04.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3d4070110 0x7ff3d4148700 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400d5d0 tx=0x7ff3c400da90 comp rx=0 tx=0).stop 2023-10-14T09:19:04.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 -- 172.21.15.78:0/3357402035 shutdown_connections 2023-10-14T09:19:04.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff3b80664d0 0x7ff3b8068990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:04.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3d4158e10 0x7ff3d41f06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:04.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3d4070110 0x7ff3d4148700 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:04.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 --2- 172.21.15.78:0/3357402035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3d406d640 0x7ff3d40c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:04.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 -- 172.21.15.78:0/3357402035 >> 172.21.15.78:0/3357402035 conn(0x7ff3d40c1cc0 msgr2=0x7ff3d4155f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:04.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 -- 172.21.15.78:0/3357402035 shutdown_connections 2023-10-14T09:19:04.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.110+0000 7ff3dbd72640 1 -- 172.21.15.78:0/3357402035 wait complete. 2023-10-14T09:19:04.121 INFO:tasks.ceph.mds.c.smithi078.stderr: -1339> 2023-10-14T09:18:20.595+0000 7f1c5127d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T09:19:04.136 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm testcephfs1 --yes-i-really-mean-it 2023-10-14T09:19:04.163 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-10-14T09:19:04.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.274+0000 7f3576e68640 1 Processor -- start 2023-10-14T09:19:04.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.274+0000 7f3576e68640 1 -- start start 2023-10-14T09:19:04.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f3576e68640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357014d750 0x7f35700ba160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:04.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f3576e68640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3570154060 0x7f357006bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:04.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f3576e68640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35700bb990 con 0x7f357006c490 2023-10-14T09:19:04.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f3576e68640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35700bbc70 con 0x7f3570154060 2023-10-14T09:19:04.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f3576e68640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35700bbf50 con 0x7f357014d750 2023-10-14T09:19:04.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f356ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3570154060 0x7f357006bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:04.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f356ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3570154060 0x7f357006bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47338/0 (socket says 172.21.15.78:47338) 2023-10-14T09:19:04.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f356ffff640 1 -- 172.21.15.78:0/134371561 learned_addr learned my addr 172.21.15.78:0/134371561 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:04.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f3574c04640 1 --2- 172.21.15.78:0/134371561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357014d750 0x7f35700ba160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:04.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f356ffff640 1 -- 172.21.15.78:0/134371561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357014d750 msgr2=0x7f35700ba160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:04.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f356ffff640 1 --2- 172.21.15.78:0/134371561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357014d750 0x7f35700ba160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:04.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f356ffff640 1 -- 172.21.15.78:0/134371561 >> v1:172.21.15.157:6789/0 conn(0x7f357006c490 legacy=0x7f357006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:04.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f356ffff640 1 -- 172.21.15.78:0/134371561 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570153860 con 0x7f3570154060 2023-10-14T09:19:04.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.278+0000 7f3574c04640 1 --2- 172.21.15.78:0/134371561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357014d750 0x7f35700ba160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:04.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f356ffff640 1 --2- 172.21.15.78:0/134371561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3570154060 0x7f357006bf50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f355c006fd0 tx=0x7f355c01f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210d52735f117c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:04.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f356f7fe640 1 -- 172.21.15.78:0/134371561 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c004230 con 0x7f3570154060 2023-10-14T09:19:04.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f356f7fe640 1 -- 172.21.15.78:0/134371561 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c0ab070 con 0x7f3570154060 2023-10-14T09:19:04.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f356f7fe640 1 -- 172.21.15.78:0/134371561 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0a77b0 con 0x7f3570154060 2023-10-14T09:19:04.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f3576e68640 1 -- 172.21.15.78:0/134371561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3570154060 msgr2=0x7f357006bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:04.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f3576e68640 1 --2- 172.21.15.78:0/134371561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3570154060 0x7f357006bf50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f355c006fd0 tx=0x7f355c01f3a0 comp rx=0 tx=0).stop 2023-10-14T09:19:04.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f3576e68640 1 -- 172.21.15.78:0/134371561 shutdown_connections 2023-10-14T09:19:04.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f3576e68640 1 --2- 172.21.15.78:0/134371561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3570154060 0x7f357006bf50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:04.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f3576e68640 1 --2- 172.21.15.78:0/134371561 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357014d750 0x7f35700ba160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:04.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f3576e68640 1 -- 172.21.15.78:0/134371561 >> 172.21.15.78:0/134371561 conn(0x7f35700c1d00 msgr2=0x7f35700c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:04.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f3576e68640 1 -- 172.21.15.78:0/134371561 shutdown_connections 2023-10-14T09:19:04.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f3576e68640 1 -- 172.21.15.78:0/134371561 wait complete. 2023-10-14T09:19:04.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f3576e68640 1 Processor -- start 2023-10-14T09:19:04.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.282+0000 7f3576e68640 1 -- start start 2023-10-14T09:19:04.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f3576e68640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357006c490 0x7f3570159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:04.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f3576e68640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f357014d750 0x7f35700a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:04.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f3576e68640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3570154060 0x7f35700aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:04.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f3576e68640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35700ab2a0 con 0x7f357014d750 2023-10-14T09:19:04.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f3576e68640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3570151010 con 0x7f3570154060 2023-10-14T09:19:04.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f3576e68640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35701ed150 con 0x7f357006c490 2023-10-14T09:19:04.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f357014d750 0x7f35700a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:04.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f357014d750 0x7f35700a9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47342/0 (socket says 172.21.15.78:47342) 2023-10-14T09:19:04.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356ffff640 1 -- 172.21.15.78:0/2382896450 learned_addr learned my addr 172.21.15.78:0/2382896450 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:04.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f3574c04640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357006c490 0x7f3570159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:04.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f3575405640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3570154060 0x7f35700aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:04.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356ffff640 1 -- 172.21.15.78:0/2382896450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357006c490 msgr2=0x7f3570159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:04.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356ffff640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357006c490 0x7f3570159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:04.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356ffff640 1 -- 172.21.15.78:0/2382896450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3570154060 msgr2=0x7f35700aa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:04.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356ffff640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3570154060 0x7f35700aa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:04.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356ffff640 1 -- 172.21.15.78:0/2382896450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c00b780 con 0x7f357014d750 2023-10-14T09:19:04.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356ffff640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f357014d750 0x7f35700a9ec0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f355c000c10 tx=0x7f355c01b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:04.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356d7fa640 1 -- 172.21.15.78:0/2382896450 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0a8b50 con 0x7f357014d750 2023-10-14T09:19:04.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356d7fa640 1 -- 172.21.15.78:0/2382896450 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c0a8cb0 con 0x7f357014d750 2023-10-14T09:19:04.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356d7fa640 1 -- 172.21.15.78:0/2382896450 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c003620 con 0x7f357014d750 2023-10-14T09:19:04.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f3576e68640 1 -- 172.21.15.78:0/2382896450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35700bc3f0 con 0x7f357014d750 2023-10-14T09:19:04.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f3576e68640 1 -- 172.21.15.78:0/2382896450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35701596d0 con 0x7f357014d750 2023-10-14T09:19:04.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f3576e68640 1 -- 172.21.15.78:0/2382896450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35700bc910 con 0x7f357014d750 2023-10-14T09:19:04.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.286+0000 7f356d7fa640 1 -- 172.21.15.78:0/2382896450 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f355c003780 con 0x7f357014d750 2023-10-14T09:19:04.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.290+0000 7f356d7fa640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f35540664a0 0x7f3554068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:04.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.290+0000 7f356d7fa640 1 -- 172.21.15.78:0/2382896450 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5815+0+0 (secure 0 0 0) 0x7f355c11e180 con 0x7f357014d750 2023-10-14T09:19:04.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.290+0000 7f3574c04640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f35540664a0 0x7f3554068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:04.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.290+0000 7f3574c04640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f35540664a0 0x7f3554068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3564009950 tx=0x7f3564008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:04.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.294+0000 7f356d7fa640 1 -- 172.21.15.78:0/2382896450 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f35700bc910 con 0x7f357014d750 2023-10-14T09:19:04.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:04.474+0000 7f3576e68640 1 -- 172.21.15.78:0/2382896450 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "testcephfs1", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f35700bc910 con 0x7f357014d750 2023-10-14T09:19:05.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.110+0000 7f356d7fa640 1 -- 172.21.15.78:0/2382896450 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "testcephfs1", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7f35700bc910 con 0x7f357014d750 2023-10-14T09:19:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.110+0000 7f3576e68640 1 -- 172.21.15.78:0/2382896450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f35540664a0 msgr2=0x7f3554068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.110+0000 7f3576e68640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f35540664a0 0x7f3554068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3564009950 tx=0x7f3564008040 comp rx=0 tx=0).stop 2023-10-14T09:19:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.110+0000 7f3576e68640 1 -- 172.21.15.78:0/2382896450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f357014d750 msgr2=0x7f35700a9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.110+0000 7f3576e68640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f357014d750 0x7f35700a9ec0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f355c000c10 tx=0x7f355c01b6e0 comp rx=0 tx=0).stop 2023-10-14T09:19:05.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.110+0000 7f3576e68640 1 -- 172.21.15.78:0/2382896450 shutdown_connections 2023-10-14T09:19:05.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.110+0000 7f3576e68640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3570154060 0x7f35700aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:05.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.110+0000 7f3576e68640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f357014d750 0x7f35700a9ec0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:05.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.110+0000 7f3576e68640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f35540664a0 0x7f3554068960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:05.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.110+0000 7f3576e68640 1 --2- 172.21.15.78:0/2382896450 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f357006c490 0x7f3570159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:05.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.110+0000 7f3576e68640 1 -- 172.21.15.78:0/2382896450 >> 172.21.15.78:0/2382896450 conn(0x7f35700c1d00 msgr2=0x7f35700c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:05.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.114+0000 7f3576e68640 1 -- 172.21.15.78:0/2382896450 shutdown_connections 2023-10-14T09:19:05.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.114+0000 7f3576e68640 1 -- 172.21.15.78:0/2382896450 wait complete. 2023-10-14T09:19:05.140 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm testcephfs1_metadata testcephfs1_metadata --yes-i-really-really-mean-it 2023-10-14T09:19:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f3074e74640 1 Processor -- start 2023-10-14T09:19:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f3074e74640 1 -- start start 2023-10-14T09:19:05.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f3074e74640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30700aec80 0x7f30700c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f3074e74640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f30700bcb90 0x7f3070153b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f3074e74640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30700c4270 con 0x7f307006ca50 2023-10-14T09:19:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f3074e74640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30700c7750 con 0x7f30700bcb90 2023-10-14T09:19:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f3074e74640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30700c4ac0 con 0x7f30700aec80 2023-10-14T09:19:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f306effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f30700bcb90 0x7f3070153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f306ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f307006ca50 0x7f30701540d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:43082/0 (socket says 172.21.15.78:43082) 2023-10-14T09:19:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f306ffff640 1 -- 172.21.15.78:0/2823459939 learned_addr learned my addr 172.21.15.78:0/2823459939 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f306f7fe640 1 --2- 172.21.15.78:0/2823459939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30700aec80 0x7f30700c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f306effd640 1 -- 172.21.15.78:0/2823459939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30700aec80 msgr2=0x7f30700c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f306effd640 1 --2- 172.21.15.78:0/2823459939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30700aec80 0x7f30700c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f306effd640 1 -- 172.21.15.78:0/2823459939 >> v1:172.21.15.78:6789/0 conn(0x7f307006ca50 legacy=0x7f30701540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.326+0000 7f306effd640 1 -- 172.21.15.78:0/2823459939 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700c4700 con 0x7f30700bcb90 2023-10-14T09:19:05.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f306effd640 1 --2- 172.21.15.78:0/2823459939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30700bcb90 0x7f3070153b90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f30640097c0 tx=0x7f306401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394c9162be8a7af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:05.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f306e7fc640 1 -- 172.21.15.78:0/2823459939 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30640ab600 con 0x7f30700bcb90 2023-10-14T09:19:05.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f306e7fc640 1 -- 172.21.15.78:0/2823459939 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30640a7050 con 0x7f30700bcb90 2023-10-14T09:19:05.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f306e7fc640 1 -- 172.21.15.78:0/2823459939 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30640ab980 con 0x7f30700bcb90 2023-10-14T09:19:05.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f3074e74640 1 -- 172.21.15.78:0/2823459939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30700bcb90 msgr2=0x7f3070153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:05.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f3074e74640 1 --2- 172.21.15.78:0/2823459939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30700bcb90 0x7f3070153b90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f30640097c0 tx=0x7f306401c3f0 comp rx=0 tx=0).stop 2023-10-14T09:19:05.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f3074e74640 1 -- 172.21.15.78:0/2823459939 shutdown_connections 2023-10-14T09:19:05.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f3074e74640 1 --2- 172.21.15.78:0/2823459939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30700bcb90 0x7f3070153b90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:05.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f3074e74640 1 --2- 172.21.15.78:0/2823459939 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30700aec80 0x7f30700c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:05.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f3074e74640 1 -- 172.21.15.78:0/2823459939 >> 172.21.15.78:0/2823459939 conn(0x7f3070071790 msgr2=0x7f3070071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:05.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f3074e74640 1 -- 172.21.15.78:0/2823459939 shutdown_connections 2023-10-14T09:19:05.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.330+0000 7f3074e74640 1 -- 172.21.15.78:0/2823459939 wait complete. 2023-10-14T09:19:05.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3074e74640 1 Processor -- start 2023-10-14T09:19:05.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3074e74640 1 -- start start 2023-10-14T09:19:05.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3074e74640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f307006ca50 0x7f30700adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:05.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3074e74640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30700aec80 0x7f3070147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:05.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3074e74640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30700bcb90 0x7f3070145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:05.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3074e74640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307014d160 con 0x7f30700bcb90 2023-10-14T09:19:05.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3074e74640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307014c520 con 0x7f30700aec80 2023-10-14T09:19:05.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3074e74640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307014c7c0 con 0x7f307006ca50 2023-10-14T09:19:05.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f306ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30700bcb90 0x7f3070145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:05.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f306ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30700bcb90 0x7f3070145360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47358/0 (socket says 172.21.15.78:47358) 2023-10-14T09:19:05.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f306ffff640 1 -- 172.21.15.78:0/3915246473 learned_addr learned my addr 172.21.15.78:0/3915246473 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:05.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f306f7fe640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f307006ca50 0x7f30700adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:05.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f306effd640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30700aec80 0x7f3070147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:05.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f306ffff640 1 -- 172.21.15.78:0/3915246473 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f307006ca50 msgr2=0x7f30700adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:05.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f306ffff640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f307006ca50 0x7f30700adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:05.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f306ffff640 1 -- 172.21.15.78:0/3915246473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30700aec80 msgr2=0x7f3070147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:05.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f306ffff640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30700aec80 0x7f3070147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:05.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f306ffff640 1 -- 172.21.15.78:0/3915246473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3064009420 con 0x7f30700bcb90 2023-10-14T09:19:05.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f306ffff640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30700bcb90 0x7f3070145360 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f306800caf0 tx=0x7f306800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:05.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3057fff640 1 -- 172.21.15.78:0/3915246473 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800aca0 con 0x7f30700bcb90 2023-10-14T09:19:05.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3057fff640 1 -- 172.21.15.78:0/3915246473 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800ae00 con 0x7f30700bcb90 2023-10-14T09:19:05.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3057fff640 1 -- 172.21.15.78:0/3915246473 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068012600 con 0x7f30700bcb90 2023-10-14T09:19:05.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3074e74640 1 -- 172.21.15.78:0/3915246473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307014caa0 con 0x7f30700bcb90 2023-10-14T09:19:05.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.334+0000 7f3074e74640 1 -- 172.21.15.78:0/3915246473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30700ae140 con 0x7f30700bcb90 2023-10-14T09:19:05.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.338+0000 7f3074e74640 1 -- 172.21.15.78:0/3915246473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307006c640 con 0x7f30700bcb90 2023-10-14T09:19:05.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.338+0000 7f3057fff640 1 -- 172.21.15.78:0/3915246473 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3068007070 con 0x7f30700bcb90 2023-10-14T09:19:05.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.338+0000 7f3057fff640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f305c0664a0 0x7f305c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:05.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.338+0000 7f3057fff640 1 -- 172.21.15.78:0/3915246473 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5815+0+0 (secure 0 0 0) 0x7f3068083cb0 con 0x7f30700bcb90 2023-10-14T09:19:05.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.338+0000 7f306f7fe640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f305c0664a0 0x7f305c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:05.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.338+0000 7f306f7fe640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f305c0664a0 0x7f305c068960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3060009af0 tx=0x7f3060008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:05.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.342+0000 7f3057fff640 1 -- 172.21.15.78:0/3915246473 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f307006c640 con 0x7f30700bcb90 2023-10-14T09:19:05.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:05.494+0000 7f3074e74640 1 -- 172.21.15.78:0/3915246473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "testcephfs1_metadata", "pool2": "testcephfs1_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f307006c640 con 0x7f30700bcb90 2023-10-14T09:19:06.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.330+0000 7f3057fff640 1 -- 172.21.15.78:0/3915246473 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "testcephfs1_metadata", "pool2": "testcephfs1_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'testcephfs1_metadata' removed v34) v1 ==== 196+0+0 (secure 0 0 0) 0x7f307006c640 con 0x7f30700bcb90 2023-10-14T09:19:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'testcephfs1_metadata' removed 2023-10-14T09:19:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 -- 172.21.15.78:0/3915246473 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f305c0664a0 msgr2=0x7f305c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f305c0664a0 0x7f305c068960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3060009af0 tx=0x7f3060008040 comp rx=0 tx=0).stop 2023-10-14T09:19:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 -- 172.21.15.78:0/3915246473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30700bcb90 msgr2=0x7f3070145360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30700bcb90 0x7f3070145360 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f306800caf0 tx=0x7f306800a060 comp rx=0 tx=0).stop 2023-10-14T09:19:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 -- 172.21.15.78:0/3915246473 shutdown_connections 2023-10-14T09:19:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30700bcb90 0x7f3070145360 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30700aec80 0x7f3070147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f305c0664a0 0x7f305c068960 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:06.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 --2- 172.21.15.78:0/3915246473 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f307006ca50 0x7f30700adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 -- 172.21.15.78:0/3915246473 >> 172.21.15.78:0/3915246473 conn(0x7f3070071790 msgr2=0x7f3070071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 -- 172.21.15.78:0/3915246473 shutdown_connections 2023-10-14T09:19:06.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.334+0000 7f3074e74640 1 -- 172.21.15.78:0/3915246473 wait complete. 2023-10-14T09:19:06.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm testcephfs1_data testcephfs1_data --yes-i-really-really-mean-it 2023-10-14T09:19:06.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7913eea640 1 Processor -- start 2023-10-14T09:19:06.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7913eea640 1 -- start start 2023-10-14T09:19:06.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7913eea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f790c070110 0x7f790c071e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:06.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7913eea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f790c158e10 0x7f790c0bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:06.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7913eea640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790c158980 con 0x7f790c06d640 2023-10-14T09:19:06.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7913eea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c1580b0 con 0x7f790c158e10 2023-10-14T09:19:06.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7913eea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c06db40 con 0x7f790c070110 2023-10-14T09:19:06.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7912487640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f790c158e10 0x7f790c0bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:06.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7912487640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f790c158e10 0x7f790c0bfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47364/0 (socket says 172.21.15.78:47364) 2023-10-14T09:19:06.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7912487640 1 -- 172.21.15.78:0/778348656 learned_addr learned my addr 172.21.15.78:0/778348656 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:06.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7911c86640 1 --2- 172.21.15.78:0/778348656 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f790c070110 0x7f790c071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:06.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7912487640 1 -- 172.21.15.78:0/778348656 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f790c070110 msgr2=0x7f790c071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:06.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7912487640 1 --2- 172.21.15.78:0/778348656 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f790c070110 0x7f790c071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:06.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7912487640 1 -- 172.21.15.78:0/778348656 >> v1:172.21.15.157:6789/0 conn(0x7f790c06d640 legacy=0x7f790c155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:06.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.506+0000 7f7912487640 1 -- 172.21.15.78:0/778348656 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c158330 con 0x7f790c158e10 2023-10-14T09:19:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7912487640 1 --2- 172.21.15.78:0/778348656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c158e10 0x7f790c0bfbc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7904009e50 tx=0x7f790401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94888224ca41ec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7910c84640 1 -- 172.21.15.78:0/778348656 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79040a57d0 con 0x7f790c158e10 2023-10-14T09:19:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7910c84640 1 -- 172.21.15.78:0/778348656 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79040a5930 con 0x7f790c158e10 2023-10-14T09:19:06.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7910c84640 1 -- 172.21.15.78:0/778348656 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79040a5cc0 con 0x7f790c158e10 2023-10-14T09:19:06.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7913eea640 1 -- 172.21.15.78:0/778348656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c158e10 msgr2=0x7f790c0bfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7913eea640 1 --2- 172.21.15.78:0/778348656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c158e10 0x7f790c0bfbc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7904009e50 tx=0x7f790401c9e0 comp rx=0 tx=0).stop 2023-10-14T09:19:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7913eea640 1 -- 172.21.15.78:0/778348656 shutdown_connections 2023-10-14T09:19:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7913eea640 1 --2- 172.21.15.78:0/778348656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c158e10 0x7f790c0bfbc0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7913eea640 1 --2- 172.21.15.78:0/778348656 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f790c070110 0x7f790c071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:06.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7913eea640 1 -- 172.21.15.78:0/778348656 >> 172.21.15.78:0/778348656 conn(0x7f790c0c1cc0 msgr2=0x7f790c0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:06.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7913eea640 1 -- 172.21.15.78:0/778348656 shutdown_connections 2023-10-14T09:19:06.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.510+0000 7f7913eea640 1 -- 172.21.15.78:0/778348656 wait complete. 2023-10-14T09:19:06.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7913eea640 1 Processor -- start 2023-10-14T09:19:06.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7913eea640 1 -- start start 2023-10-14T09:19:06.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7913eea640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f790c06d640 0x7f790c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7913eea640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f790c070110 0x7f790c14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7913eea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c158e10 0x7f790c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7913eea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0c4800 con 0x7f790c158e10 2023-10-14T09:19:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7913eea640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c14f220 con 0x7f790c06d640 2023-10-14T09:19:06.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7913eea640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0c4c00 con 0x7f790c070110 2023-10-14T09:19:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7912487640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c158e10 0x7f790c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7912487640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c158e10 0x7f790c14ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47366/0 (socket says 172.21.15.78:47366) 2023-10-14T09:19:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7912487640 1 -- 172.21.15.78:0/3046155245 learned_addr learned my addr 172.21.15.78:0/3046155245 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7911c86640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f790c06d640 0x7f790c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7911485640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f790c070110 0x7f790c14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7912487640 1 -- 172.21.15.78:0/3046155245 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f790c070110 msgr2=0x7f790c14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7912487640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f790c070110 0x7f790c14e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7912487640 1 -- 172.21.15.78:0/3046155245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f790c06d640 msgr2=0x7f790c0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7912487640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f790c06d640 0x7f790c0c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7912487640 1 -- 172.21.15.78:0/3046155245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7904009b30 con 0x7f790c158e10 2023-10-14T09:19:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7911c86640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f790c06d640 0x7f790c0c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7912487640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c158e10 0x7f790c14ab10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f79040af040 tx=0x7f7904019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f79027fc640 1 -- 172.21.15.78:0/3046155245 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79040b8670 con 0x7f790c158e10 2023-10-14T09:19:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f79027fc640 1 -- 172.21.15.78:0/3046155245 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79040b87d0 con 0x7f790c158e10 2023-10-14T09:19:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f79027fc640 1 -- 172.21.15.78:0/3046155245 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79040b8b80 con 0x7f790c158e10 2023-10-14T09:19:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7913eea640 1 -- 172.21.15.78:0/3046155245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c14edf0 con 0x7f790c158e10 2023-10-14T09:19:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7913eea640 1 -- 172.21.15.78:0/3046155245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c1f4460 con 0x7f790c158e10 2023-10-14T09:19:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.514+0000 7f7913eea640 1 -- 172.21.15.78:0/3046155245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c074110 con 0x7f790c158e10 2023-10-14T09:19:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.518+0000 7f79027fc640 1 -- 172.21.15.78:0/3046155245 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f79040b8ce0 con 0x7f790c158e10 2023-10-14T09:19:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.518+0000 7f79027fc640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f78f00664a0 0x7f78f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.518+0000 7f79027fc640 1 -- 172.21.15.78:0/3046155245 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5367+0+0 (secure 0 0 0) 0x7f790411f380 con 0x7f790c158e10 2023-10-14T09:19:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.518+0000 7f7911c86640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f78f00664a0 0x7f78f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.518+0000 7f7911c86640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f78f00664a0 0x7f78f0068960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f790c155010 tx=0x7f7908008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.522+0000 7f79027fc640 1 -- 172.21.15.78:0/3046155245 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f79040eca70 con 0x7f790c158e10 2023-10-14T09:19:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:06.674+0000 7f7913eea640 1 -- 172.21.15.78:0/3046155245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "testcephfs1_data", "pool2": "testcephfs1_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f790c15c270 con 0x7f790c158e10 2023-10-14T09:19:07.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f79027fc640 1 -- 172.21.15.78:0/3046155245 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "testcephfs1_data", "pool2": "testcephfs1_data", "yes_i_really_really_mean_it": true}]=0 pool 'testcephfs1_data' removed v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7f79040f0090 con 0x7f790c158e10 2023-10-14T09:19:07.344 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'testcephfs1_data' removed 2023-10-14T09:19:07.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f7913eea640 1 -- 172.21.15.78:0/3046155245 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f78f00664a0 msgr2=0x7f78f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f7913eea640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f78f00664a0 0x7f78f0068960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f790c155010 tx=0x7f7908008040 comp rx=0 tx=0).stop 2023-10-14T09:19:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f7913eea640 1 -- 172.21.15.78:0/3046155245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c158e10 msgr2=0x7f790c14ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f7913eea640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c158e10 0x7f790c14ab10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f79040af040 tx=0x7f7904019780 comp rx=0 tx=0).stop 2023-10-14T09:19:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f7913eea640 1 -- 172.21.15.78:0/3046155245 shutdown_connections 2023-10-14T09:19:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f7913eea640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f790c158e10 0x7f790c14ab10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f7913eea640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f78f00664a0 0x7f78f0068960 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f7913eea640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f790c070110 0x7f790c14e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f7913eea640 1 --2- 172.21.15.78:0/3046155245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f790c06d640 0x7f790c0c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f7913eea640 1 -- 172.21.15.78:0/3046155245 >> 172.21.15.78:0/3046155245 conn(0x7f790c0c1cc0 msgr2=0x7f790c06c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:07.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.338+0000 7f7913eea640 1 -- 172.21.15.78:0/3046155245 shutdown_connections 2023-10-14T09:19:07.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.342+0000 7f7913eea640 1 -- 172.21.15.78:0/3046155245 wait complete. 2023-10-14T09:19:07.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.b mds_join_fs 2023-10-14T09:19:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d81a1640 1 Processor -- start 2023-10-14T09:19:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d81a1640 1 -- start start 2023-10-14T09:19:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d81a1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01d0150ac0 0x7f01d0150f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d81a1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d0151fd0 con 0x7f01d01532c0 2023-10-14T09:19:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d81a1640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d0153e40 con 0x7f01d0139dc0 2023-10-14T09:19:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d81a1640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d00702c0 con 0x7f01d0150ac0 2023-10-14T09:19:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d673e640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f01d01532c0 0x7f01d0153730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48214/0 (socket says 172.21.15.78:48214) 2023-10-14T09:19:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d673e640 1 -- 172.21.15.78:0/890573893 learned_addr learned my addr 172.21.15.78:0/890573893 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d573c640 1 --2- 172.21.15.78:0/890573893 >> v2:172.21.15.157:3300/0 conn(0x7f01d0150ac0 0x7f01d0150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d4f3b640 1 -- 172.21.15.78:0/890573893 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082411721 0 0) 0x7f01d0151fd0 con 0x7f01d01532c0 2023-10-14T09:19:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d4f3b640 1 -- 172.21.15.78:0/890573893 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01bc003530 con 0x7f01d01532c0 2023-10-14T09:19:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d4f3b640 1 -- 172.21.15.78:0/890573893 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946844317 0 0) 0x7f01d0153e40 con 0x7f01d0139dc0 2023-10-14T09:19:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d4f3b640 1 -- 172.21.15.78:0/890573893 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01d0151fd0 con 0x7f01d0139dc0 2023-10-14T09:19:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d573c640 1 -- 172.21.15.78:0/890573893 >> v1:172.21.15.157:6789/0 conn(0x7f01d0139dc0 legacy=0x7f01d00718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d4f3b640 1 -- 172.21.15.78:0/890573893 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 722277110 0 0) 0x7f01bc003530 con 0x7f01d01532c0 2023-10-14T09:19:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d573c640 1 -- 172.21.15.78:0/890573893 >> v1:172.21.15.78:6789/0 conn(0x7f01d01532c0 legacy=0x7f01d0153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.506+0000 7f01d573c640 1 -- 172.21.15.78:0/890573893 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d0152220 con 0x7f01d0150ac0 2023-10-14T09:19:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.510+0000 7f01d573c640 1 --2- 172.21.15.78:0/890573893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01d0150ac0 0x7f01d0150f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f01c00097c0 tx=0x7f01c001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=909a86415f60b34e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.510+0000 7f01d4f3b640 1 -- 172.21.15.78:0/890573893 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8001a00 con 0x7f01d0150ac0 2023-10-14T09:19:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.510+0000 7f01d4f3b640 1 -- 172.21.15.78:0/890573893 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c00a7050 con 0x7f01d0150ac0 2023-10-14T09:19:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.510+0000 7f01d4f3b640 1 -- 172.21.15.78:0/890573893 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00ab620 con 0x7f01d0150ac0 2023-10-14T09:19:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.510+0000 7f01d81a1640 1 -- 172.21.15.78:0/890573893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01d0150ac0 msgr2=0x7f01d0150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.510+0000 7f01d81a1640 1 --2- 172.21.15.78:0/890573893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01d0150ac0 0x7f01d0150f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f01c00097c0 tx=0x7f01c001c310 comp rx=0 tx=0).stop 2023-10-14T09:19:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.510+0000 7f01d81a1640 1 -- 172.21.15.78:0/890573893 shutdown_connections 2023-10-14T09:19:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.510+0000 7f01d81a1640 1 --2- 172.21.15.78:0/890573893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01d0150ac0 0x7f01d0150f40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.510+0000 7f01d81a1640 1 -- 172.21.15.78:0/890573893 >> 172.21.15.78:0/890573893 conn(0x7f01d00c1d00 msgr2=0x7f01d00c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.510+0000 7f01d81a1640 1 -- 172.21.15.78:0/890573893 shutdown_connections 2023-10-14T09:19:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.510+0000 7f01d81a1640 1 -- 172.21.15.78:0/890573893 wait complete. 2023-10-14T09:19:07.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d81a1640 1 Processor -- start 2023-10-14T09:19:07.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d81a1640 1 -- start start 2023-10-14T09:19:07.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d81a1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01d0139dc0 0x7f01d00bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d81a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d0150ac0 0x7f01d014dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d81a1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01d01532c0 0x7f01d01332e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d81a1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0152ea0 con 0x7f01d0150ac0 2023-10-14T09:19:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d81a1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d006c130 con 0x7f01d0139dc0 2023-10-14T09:19:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d81a1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0071ce0 con 0x7f01d01532c0 2023-10-14T09:19:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d573c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d0150ac0 0x7f01d014dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d573c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d0150ac0 0x7f01d014dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46830/0 (socket says 172.21.15.78:46830) 2023-10-14T09:19:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d573c640 1 -- 172.21.15.78:0/1723778310 learned_addr learned my addr 172.21.15.78:0/1723778310 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d573c640 1 -- 172.21.15.78:0/1723778310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01d01532c0 msgr2=0x7f01d01332e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d573c640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01d01532c0 0x7f01d01332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d573c640 1 -- 172.21.15.78:0/1723778310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01d0139dc0 msgr2=0x7f01d00bbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d5f3d640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01d0139dc0 0x7f01d00bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d573c640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01d0139dc0 0x7f01d00bbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d573c640 1 -- 172.21.15.78:0/1723778310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c0009420 con 0x7f01d0150ac0 2023-10-14T09:19:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d5f3d640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01d0139dc0 0x7f01d00bbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:19:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d573c640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d0150ac0 0x7f01d014dc00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f01c00097c0 tx=0x7f01c00190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01c67fc640 1 -- 172.21.15.78:0/1723778310 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0004020 con 0x7f01d0150ac0 2023-10-14T09:19:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01c67fc640 1 -- 172.21.15.78:0/1723778310 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c0004180 con 0x7f01d0150ac0 2023-10-14T09:19:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01c67fc640 1 -- 172.21.15.78:0/1723778310 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0004510 con 0x7f01d0150ac0 2023-10-14T09:19:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d81a1640 1 -- 172.21.15.78:0/1723778310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d006be50 con 0x7f01d0150ac0 2023-10-14T09:19:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d81a1640 1 -- 172.21.15.78:0/1723778310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d014e140 con 0x7f01d0150ac0 2023-10-14T09:19:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.514+0000 7f01d81a1640 1 -- 172.21.15.78:0/1723778310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d01ed020 con 0x7f01d0150ac0 2023-10-14T09:19:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.518+0000 7f01c67fc640 1 -- 172.21.15.78:0/1723778310 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f01c00b2040 con 0x7f01d0150ac0 2023-10-14T09:19:07.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.518+0000 7f01c67fc640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f01b40664a0 0x7f01b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:07.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.518+0000 7f01c67fc640 1 -- 172.21.15.78:0/1723778310 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f01c011da40 con 0x7f01d0150ac0 2023-10-14T09:19:07.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.518+0000 7f01d5f3d640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f01b40664a0 0x7f01b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:07.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.518+0000 7f01d5f3d640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f01b40664a0 0x7f01b4068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0011f0 tx=0x7f01cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:07.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.522+0000 7f01c67fc640 1 -- 172.21.15.78:0/1723778310 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f01d01ed020 con 0x7f01d0150ac0 2023-10-14T09:19:07.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.678+0000 7f01d81a1640 1 -- 172.21.15.78:0/1723778310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.b", "name": "mds_join_fs"} v 0) v1 -- 0x7f01d01ed020 con 0x7f01d0150ac0 2023-10-14T09:19:07.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01c67fc640 1 -- 172.21.15.78:0/1723778310 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.b", "name": "mds_join_fs"}]=0 v13) v1 ==== 96+0+0 (secure 0 0 0) 0x7f01d01ed020 con 0x7f01d0150ac0 2023-10-14T09:19:07.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 -- 172.21.15.78:0/1723778310 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f01b40664a0 msgr2=0x7f01b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f01b40664a0 0x7f01b4068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0011f0 tx=0x7f01cc009040 comp rx=0 tx=0).stop 2023-10-14T09:19:07.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 -- 172.21.15.78:0/1723778310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d0150ac0 msgr2=0x7f01d014dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d0150ac0 0x7f01d014dc00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f01c00097c0 tx=0x7f01c00190b0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 -- 172.21.15.78:0/1723778310 shutdown_connections 2023-10-14T09:19:07.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f01b40664a0 0x7f01b4068960 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01d01532c0 0x7f01d01332e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01d0150ac0 0x7f01d014dc00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 --2- 172.21.15.78:0/1723778310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01d0139dc0 0x7f01d00bbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 -- 172.21.15.78:0/1723778310 >> 172.21.15.78:0/1723778310 conn(0x7f01d00c1d00 msgr2=0x7f01d00c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:07.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 -- 172.21.15.78:0/1723778310 shutdown_connections 2023-10-14T09:19:07.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.682+0000 7f01d81a1640 1 -- 172.21.15.78:0/1723778310 wait complete. 2023-10-14T09:19:07.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T09:19:07.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fe30f640 1 Processor -- start 2023-10-14T09:19:07.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fe30f640 1 -- start start 2023-10-14T09:19:07.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fe30f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09f8151400 0x7f09f8069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:07.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fe30f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09f80c04c0 0x7f09f815e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:07.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fe30f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f80a7660 con 0x7f09f806dcf0 2023-10-14T09:19:07.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fe30f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f81517e0 con 0x7f09f80c04c0 2023-10-14T09:19:07.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fe30f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f8154820 con 0x7f09f8151400 2023-10-14T09:19:07.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fc8ac640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09f80c04c0 0x7f09f815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:07.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fc8ac640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f09f80c04c0 0x7f09f815e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46834/0 (socket says 172.21.15.78:46834) 2023-10-14T09:19:07.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fc8ac640 1 -- 172.21.15.78:0/2556008885 learned_addr learned my addr 172.21.15.78:0/2556008885 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:07.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09f7fff640 1 --2- 172.21.15.78:0/2556008885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09f8151400 0x7f09f8069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:07.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fc8ac640 1 -- 172.21.15.78:0/2556008885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09f8151400 msgr2=0x7f09f8069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:07.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fc8ac640 1 --2- 172.21.15.78:0/2556008885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09f8151400 0x7f09f8069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fc8ac640 1 -- 172.21.15.78:0/2556008885 >> v1:172.21.15.157:6789/0 conn(0x7f09f806dcf0 legacy=0x7f09f80bfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09fc8ac640 1 -- 172.21.15.78:0/2556008885 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f8154ac0 con 0x7f09f80c04c0 2023-10-14T09:19:07.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.842+0000 7f09f7fff640 1 --2- 172.21.15.78:0/2556008885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09f8151400 0x7f09f8069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:07.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09fc8ac640 1 --2- 172.21.15.78:0/2556008885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09f80c04c0 0x7f09f815e680 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009e50 tx=0x7f09f001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ce91f14a6530d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:07.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09f6ffd640 1 -- 172.21.15.78:0/2556008885 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f00a57f0 con 0x7f09f80c04c0 2023-10-14T09:19:07.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09f6ffd640 1 -- 172.21.15.78:0/2556008885 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f00a5950 con 0x7f09f80c04c0 2023-10-14T09:19:07.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09f6ffd640 1 -- 172.21.15.78:0/2556008885 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f00a5ce0 con 0x7f09f80c04c0 2023-10-14T09:19:07.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09fe30f640 1 -- 172.21.15.78:0/2556008885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09f80c04c0 msgr2=0x7f09f815e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09fe30f640 1 --2- 172.21.15.78:0/2556008885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09f80c04c0 0x7f09f815e680 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009e50 tx=0x7f09f001ca10 comp rx=0 tx=0).stop 2023-10-14T09:19:07.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09fe30f640 1 -- 172.21.15.78:0/2556008885 shutdown_connections 2023-10-14T09:19:07.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09fe30f640 1 --2- 172.21.15.78:0/2556008885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09f80c04c0 0x7f09f815e680 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09fe30f640 1 --2- 172.21.15.78:0/2556008885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09f8151400 0x7f09f8069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09fe30f640 1 -- 172.21.15.78:0/2556008885 >> 172.21.15.78:0/2556008885 conn(0x7f09f80c63a0 msgr2=0x7f09f80c67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:07.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09fe30f640 1 -- 172.21.15.78:0/2556008885 shutdown_connections 2023-10-14T09:19:07.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.846+0000 7f09fe30f640 1 -- 172.21.15.78:0/2556008885 wait complete. 2023-10-14T09:19:07.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09fe30f640 1 Processor -- start 2023-10-14T09:19:07.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09fe30f640 1 -- start start 2023-10-14T09:19:07.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09fe30f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09f806dcf0 0x7f09f8152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:07.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09fe30f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09f80c04c0 0x7f09f81550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:07.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09fe30f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09f8151400 0x7f09f81ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:07.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09fe30f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f81ec900 con 0x7f09f806dcf0 2023-10-14T09:19:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09fe30f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f80c61b0 con 0x7f09f8151400 2023-10-14T09:19:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09fe30f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f81ec2f0 con 0x7f09f80c04c0 2023-10-14T09:19:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09f806dcf0 0x7f09f8152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09f806dcf0 0x7f09f8152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46842/0 (socket says 172.21.15.78:46842) 2023-10-14T09:19:07.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f7fff640 1 -- 172.21.15.78:0/3377094116 learned_addr learned my addr 172.21.15.78:0/3377094116 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09fc8ac640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09f8151400 0x7f09f81ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f77fe640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09f80c04c0 0x7f09f81550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f7fff640 1 -- 172.21.15.78:0/3377094116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09f80c04c0 msgr2=0x7f09f81550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f7fff640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09f80c04c0 0x7f09f81550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f7fff640 1 -- 172.21.15.78:0/3377094116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09f8151400 msgr2=0x7f09f81ef6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:07.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f7fff640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09f8151400 0x7f09f81ef6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:07.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f7fff640 1 -- 172.21.15.78:0/3377094116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0009b30 con 0x7f09f806dcf0 2023-10-14T09:19:07.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f7fff640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09f806dcf0 0x7f09f8152850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f09e800d800 tx=0x7f09e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:07.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f4ff9640 1 -- 172.21.15.78:0/3377094116 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800b6c0 con 0x7f09f806dcf0 2023-10-14T09:19:07.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f4ff9640 1 -- 172.21.15.78:0/3377094116 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e800b820 con 0x7f09f806dcf0 2023-10-14T09:19:07.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09f4ff9640 1 -- 172.21.15.78:0/3377094116 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800bbd0 con 0x7f09f806dcf0 2023-10-14T09:19:07.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09fe30f640 1 -- 172.21.15.78:0/3377094116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f814a5b0 con 0x7f09f806dcf0 2023-10-14T09:19:07.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.850+0000 7f09fe30f640 1 -- 172.21.15.78:0/3377094116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f81ec590 con 0x7f09f806dcf0 2023-10-14T09:19:07.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.854+0000 7f09fe30f640 1 -- 172.21.15.78:0/3377094116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f81ec150 con 0x7f09f806dcf0 2023-10-14T09:19:07.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.854+0000 7f09f4ff9640 1 -- 172.21.15.78:0/3377094116 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f09e800bd30 con 0x7f09f806dcf0 2023-10-14T09:19:07.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.854+0000 7f09f4ff9640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f09e40664a0 0x7f09e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:07.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.854+0000 7f09f4ff9640 1 -- 172.21.15.78:0/3377094116 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f09e8083f20 con 0x7f09f806dcf0 2023-10-14T09:19:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.854+0000 7f09f77fe640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f09e40664a0 0x7f09e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.854+0000 7f09f77fe640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f09e40664a0 0x7f09e4068960 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09f81455e0 tx=0x7f09ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:07.858+0000 7f09f4ff9640 1 -- 172.21.15.78:0/3377094116 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f09f81ec150 con 0x7f09f806dcf0 2023-10-14T09:19:08.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.014+0000 7f09fe30f640 1 -- 172.21.15.78:0/3377094116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f09f81ec150 con 0x7f09f806dcf0 2023-10-14T09:19:08.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09f4ff9640 1 -- 172.21.15.78:0/3377094116 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09f81ec150 con 0x7f09f806dcf0 2023-10-14T09:19:08.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 -- 172.21.15.78:0/3377094116 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f09e40664a0 msgr2=0x7f09e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:08.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f09e40664a0 0x7f09e4068960 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09f81455e0 tx=0x7f09ec009040 comp rx=0 tx=0).stop 2023-10-14T09:19:08.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 -- 172.21.15.78:0/3377094116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09f806dcf0 msgr2=0x7f09f8152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:08.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09f806dcf0 0x7f09f8152850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f09e800d800 tx=0x7f09e800dcc0 comp rx=0 tx=0).stop 2023-10-14T09:19:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 -- 172.21.15.78:0/3377094116 shutdown_connections 2023-10-14T09:19:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09f8151400 0x7f09f81ef6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f09e40664a0 0x7f09e4068960 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f09f80c04c0 0x7f09f81550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 --2- 172.21.15.78:0/3377094116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09f806dcf0 0x7f09f8152850 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 -- 172.21.15.78:0/3377094116 >> 172.21.15.78:0/3377094116 conn(0x7f09f80c63a0 msgr2=0x7f09f80bfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 -- 172.21.15.78:0/3377094116 shutdown_connections 2023-10-14T09:19:08.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.018+0000 7f09fe30f640 1 -- 172.21.15.78:0/3377094116 wait complete. 2023-10-14T09:19:08.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop' 2023-10-14T09:19:08.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe63d5e4640 1 Processor -- start 2023-10-14T09:19:08.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe63d5e4640 1 -- start start 2023-10-14T09:19:08.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe63d5e4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe638151200 0x7fe6380c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:08.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe63d5e4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6381515e0 con 0x7fe6380c4370 2023-10-14T09:19:08.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe63d5e4640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe638157d60 con 0x7fe6380c73b0 2023-10-14T09:19:08.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe63d5e4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe638157b60 con 0x7fe638151200 2023-10-14T09:19:08.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe63cde3640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe6380c4370 0x7fe6381542d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48220/0 (socket says 172.21.15.78:48220) 2023-10-14T09:19:08.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe63cde3640 1 -- 172.21.15.78:0/2641833111 learned_addr learned my addr 172.21.15.78:0/2641833111 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:08.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe637fff640 1 --2- 172.21.15.78:0/2641833111 >> v2:172.21.15.157:3300/0 conn(0x7fe638151200 0x7fe6380c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:08.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe636ffd640 1 -- 172.21.15.78:0/2641833111 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650998603 0 0) 0x7fe6381515e0 con 0x7fe6380c4370 2023-10-14T09:19:08.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe636ffd640 1 -- 172.21.15.78:0/2641833111 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe624003530 con 0x7fe6380c4370 2023-10-14T09:19:08.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe636ffd640 1 -- 172.21.15.78:0/2641833111 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025597040 0 0) 0x7fe638157d60 con 0x7fe6380c73b0 2023-10-14T09:19:08.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe636ffd640 1 -- 172.21.15.78:0/2641833111 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6381515e0 con 0x7fe6380c73b0 2023-10-14T09:19:08.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe637fff640 1 -- 172.21.15.78:0/2641833111 >> v1:172.21.15.157:6789/0 conn(0x7fe6380c73b0 legacy=0x7fe638153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:08.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe637fff640 1 -- 172.21.15.78:0/2641833111 >> v1:172.21.15.78:6789/0 conn(0x7fe6380c4370 legacy=0x7fe6381542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:08.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe636ffd640 1 -- 172.21.15.78:0/2641833111 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1829555495 0 0) 0x7fe624003530 con 0x7fe6380c4370 2023-10-14T09:19:08.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.190+0000 7fe637fff640 1 -- 172.21.15.78:0/2641833111 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6380c64c0 con 0x7fe638151200 2023-10-14T09:19:08.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.194+0000 7fe637fff640 1 --2- 172.21.15.78:0/2641833111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe638151200 0x7fe6380c3e30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6280097c0 tx=0x7fe62801c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4d12a380d1446f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:08.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.194+0000 7fe636ffd640 1 -- 172.21.15.78:0/2641833111 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630001a00 con 0x7fe638151200 2023-10-14T09:19:08.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.194+0000 7fe636ffd640 1 -- 172.21.15.78:0/2641833111 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6280a7050 con 0x7fe638151200 2023-10-14T09:19:08.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.194+0000 7fe636ffd640 1 -- 172.21.15.78:0/2641833111 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6280ab620 con 0x7fe638151200 2023-10-14T09:19:08.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.194+0000 7fe63d5e4640 1 -- 172.21.15.78:0/2641833111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe638151200 msgr2=0x7fe6380c3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:08.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.194+0000 7fe63d5e4640 1 --2- 172.21.15.78:0/2641833111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe638151200 0x7fe6380c3e30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6280097c0 tx=0x7fe62801c280 comp rx=0 tx=0).stop 2023-10-14T09:19:08.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.194+0000 7fe63d5e4640 1 -- 172.21.15.78:0/2641833111 shutdown_connections 2023-10-14T09:19:08.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.194+0000 7fe63d5e4640 1 --2- 172.21.15.78:0/2641833111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe638151200 0x7fe6380c3e30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:08.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.194+0000 7fe63d5e4640 1 -- 172.21.15.78:0/2641833111 >> 172.21.15.78:0/2641833111 conn(0x7fe6380719c0 msgr2=0x7fe638071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:08.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.194+0000 7fe63d5e4640 1 -- 172.21.15.78:0/2641833111 shutdown_connections 2023-10-14T09:19:08.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.194+0000 7fe63d5e4640 1 -- 172.21.15.78:0/2641833111 wait complete. 2023-10-14T09:19:08.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe63d5e4640 1 Processor -- start 2023-10-14T09:19:08.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe63d5e4640 1 -- start start 2023-10-14T09:19:08.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe63d5e4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6380c4370 0x7fe6380c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:08.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe63d5e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380c73b0 0x7fe6381446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:08.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe63d5e4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe638151200 0x7fe638144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:08.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe63d5e4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380bfe30 con 0x7fe6380c73b0 2023-10-14T09:19:08.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe63d5e4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380bf840 con 0x7fe638151200 2023-10-14T09:19:08.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe63d5e4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe638145160 con 0x7fe6380c4370 2023-10-14T09:19:08.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe6377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380c73b0 0x7fe6381446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:08.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe6377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380c73b0 0x7fe6381446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46844/0 (socket says 172.21.15.78:46844) 2023-10-14T09:19:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe6377fe640 1 -- 172.21.15.78:0/953885335 learned_addr learned my addr 172.21.15.78:0/953885335 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe63cde3640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe638151200 0x7fe638144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:08.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe637fff640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6380c4370 0x7fe6380c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:08.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe6377fe640 1 -- 172.21.15.78:0/953885335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6380c4370 msgr2=0x7fe6380c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:08.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe6377fe640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6380c4370 0x7fe6380c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:08.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe6377fe640 1 -- 172.21.15.78:0/953885335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe638151200 msgr2=0x7fe638144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:08.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe6377fe640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe638151200 0x7fe638144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:08.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe6377fe640 1 -- 172.21.15.78:0/953885335 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628009420 con 0x7fe6380c73b0 2023-10-14T09:19:08.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe6377fe640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380c73b0 0x7fe6381446e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c430 tx=0x7fe62000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:08.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe634ff9640 1 -- 172.21.15.78:0/953885335 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200052d0 con 0x7fe6380c73b0 2023-10-14T09:19:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe634ff9640 1 -- 172.21.15.78:0/953885335 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe620005430 con 0x7fe6380c73b0 2023-10-14T09:19:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe63d5e4640 1 -- 172.21.15.78:0/953885335 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6381ec760 con 0x7fe6380c73b0 2023-10-14T09:19:08.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.198+0000 7fe634ff9640 1 -- 172.21.15.78:0/953885335 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620003840 con 0x7fe6380c73b0 2023-10-14T09:19:08.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.202+0000 7fe63d5e4640 1 -- 172.21.15.78:0/953885335 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6380bfa50 con 0x7fe6380c73b0 2023-10-14T09:19:08.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.202+0000 7fe63d5e4640 1 -- 172.21.15.78:0/953885335 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6380679c0 con 0x7fe6380c73b0 2023-10-14T09:19:08.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.202+0000 7fe634ff9640 1 -- 172.21.15.78:0/953885335 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe6200039a0 con 0x7fe6380c73b0 2023-10-14T09:19:08.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.202+0000 7fe634ff9640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe6180664a0 0x7fe618068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.202+0000 7fe634ff9640 1 -- 172.21.15.78:0/953885335 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe620083150 con 0x7fe6380c73b0 2023-10-14T09:19:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.202+0000 7fe637fff640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe6180664a0 0x7fe618068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:08.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.202+0000 7fe637fff640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe6180664a0 0x7fe618068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe6280ad000 tx=0x7fe6280a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.206+0000 7fe634ff9640 1 -- 172.21.15.78:0/953885335 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe620050970 con 0x7fe6380c73b0 2023-10-14T09:19:08.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:08.410+0000 7fe63d5e4640 1 -- 172.21.15.78:0/953885335 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]} v 0) v1 -- 0x7fe6380bcb10 con 0x7fe6380c73b0 2023-10-14T09:19:09.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.350+0000 7fe634ff9640 1 -- 172.21.15.78:0/953885335 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]}]=0 v106) v1 ==== 143+0+0 (secure 0 0 0) 0x7fe620053f90 con 0x7fe6380c73b0 2023-10-14T09:19:09.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.350+0000 7fe63d5e4640 1 -- 172.21.15.78:0/953885335 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe6180664a0 msgr2=0x7fe618068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:09.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.350+0000 7fe63d5e4640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe6180664a0 0x7fe618068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe6280ad000 tx=0x7fe6280a6000 comp rx=0 tx=0).stop 2023-10-14T09:19:09.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.350+0000 7fe63d5e4640 1 -- 172.21.15.78:0/953885335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380c73b0 msgr2=0x7fe6381446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:09.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.350+0000 7fe63d5e4640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380c73b0 0x7fe6381446e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c430 tx=0x7fe62000c8f0 comp rx=0 tx=0).stop 2023-10-14T09:19:09.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.350+0000 7fe63d5e4640 1 -- 172.21.15.78:0/953885335 shutdown_connections 2023-10-14T09:19:09.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.354+0000 7fe63d5e4640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe638151200 0x7fe638144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:09.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.354+0000 7fe63d5e4640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6380c73b0 0x7fe6381446e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:09.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.354+0000 7fe63d5e4640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fe6180664a0 0x7fe618068960 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:09.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.354+0000 7fe63d5e4640 1 --2- 172.21.15.78:0/953885335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe6380c4370 0x7fe6380c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:09.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.354+0000 7fe63d5e4640 1 -- 172.21.15.78:0/953885335 >> 172.21.15.78:0/953885335 conn(0x7fe6380719c0 msgr2=0x7fe63815e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:09.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.354+0000 7fe63d5e4640 1 -- 172.21.15.78:0/953885335 shutdown_connections 2023-10-14T09:19:09.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:09.354+0000 7fe63d5e4640 1 -- 172.21.15.78:0/953885335 wait complete. 2023-10-14T09:19:09.381 INFO:tasks.cephfs_test_runner:That unsetting mds_join_fs will not cause failover if no high-affinity standby exists. ... ERROR 2023-10-14T09:19:09.381 INFO:tasks.cephfs_test_runner: 2023-10-14T09:19:09.381 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T09:19:09.382 INFO:tasks.cephfs_test_runner:ERROR: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2023-10-14T09:19:09.382 INFO:tasks.cephfs_test_runner:That unsetting mds_join_fs will not cause failover if no high-affinity standby exists. 2023-10-14T09:19:09.382 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T09:19:09.383 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T09:19:09.383 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_failover.py", line 104, in test_join_fs_drop 2023-10-14T09:19:09.383 INFO:tasks.cephfs_test_runner: self._reach_target(target) 2023-10-14T09:19:09.383 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_failover.py", line 61, in _reach_target 2023-10-14T09:19:09.384 INFO:tasks.cephfs_test_runner: self.wait_until_true(takeover, 30) 2023-10-14T09:19:09.384 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/ceph_test_case.py", line 345, in wait_until_true 2023-10-14T09:19:09.384 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-10-14T09:19:09.384 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 30s and 0 retries 2023-10-14T09:19:09.385 INFO:tasks.cephfs_test_runner: 2023-10-14T09:19:09.385 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T09:19:09.385 INFO:tasks.cephfs_test_runner:Ran 1 test in 76.918s 2023-10-14T09:19:09.385 INFO:tasks.cephfs_test_runner: 2023-10-14T09:19:09.386 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-14T09:19:09.386 INFO:tasks.cephfs_test_runner: 2023-10-14T09:19:09.386 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T09:19:09.387 INFO:tasks.cephfs_test_runner:ERROR: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2023-10-14T09:19:09.387 INFO:tasks.cephfs_test_runner:That unsetting mds_join_fs will not cause failover if no high-affinity standby exists. 2023-10-14T09:19:09.387 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T09:19:09.387 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T09:19:09.388 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_failover.py", line 104, in test_join_fs_drop 2023-10-14T09:19:09.388 INFO:tasks.cephfs_test_runner: self._reach_target(target) 2023-10-14T09:19:09.388 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/test_failover.py", line 61, in _reach_target 2023-10-14T09:19:09.388 INFO:tasks.cephfs_test_runner: self.wait_until_true(takeover, 30) 2023-10-14T09:19:09.389 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/ceph_test_case.py", line 345, in wait_until_true 2023-10-14T09:19:09.389 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-10-14T09:19:09.389 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 30s and 0 retries 2023-10-14T09:19:09.390 INFO:tasks.cephfs_test_runner: 2023-10-14T09:19:09.390 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2023-10-14T09:19:09.459 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=6e3b15ffef9343d89c613e4c5de9c870 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2023-10-14T09:19:09.461 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-14T09:19:09.471 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-14T09:19:09.483 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-14T09:19:09.483 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-10-14T09:19:09.484 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:19:09.498 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5607 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-10-14T09:19:09.499 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2023-10-14T09:19:09.499 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:19:09.510 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9344 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-10-14T09:19:09.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:19:09.512 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2023-10-14T09:19:09.563 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T09:19:09.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:19:09.564 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T09:19:09.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:19:09.629 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2023-10-14T09:19:09.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:19:09.825 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-10-14T09:19:09.834 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T09:19:09.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:19:09.836 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T09:19:09.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:19:09.905 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-10-14T09:19:10.145 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T09:19:10.159 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T09:19:10.160 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:19:10.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd741c9a640 1 Processor -- start 2023-10-14T09:19:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd741c9a640 1 -- start start 2023-10-14T09:19:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd741c9a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c14ddb0 0x7fd73c0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd741c9a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd73c0c6910 0x7fd73c0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd741c9a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73c06c470 con 0x7fd73c153e80 2023-10-14T09:19:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd741c9a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c0c64f0 con 0x7fd73c0c6910 2023-10-14T09:19:10.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd741c9a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0c5300 con 0x7fd73c14ddb0 2023-10-14T09:19:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd73affd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd73c153e80 0x7fd73c06bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48228/0 (socket says 172.21.15.78:48228) 2023-10-14T09:19:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd73affd640 1 -- 172.21.15.78:0/1947175077 learned_addr learned my addr 172.21.15.78:0/1947175077 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:10.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd73bfff640 1 --2- 172.21.15.78:0/1947175077 >> v2:172.21.15.78:3300/0 conn(0x7fd73c0c6910 0x7fd73c0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd73b7fe640 1 --2- 172.21.15.78:0/1947175077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c14ddb0 0x7fd73c0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd73a7fc640 1 -- 172.21.15.78:0/1947175077 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918679824 0 0) 0x7fd73c06c470 con 0x7fd73c153e80 2023-10-14T09:19:10.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd73a7fc640 1 -- 172.21.15.78:0/1947175077 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd724003530 con 0x7fd73c153e80 2023-10-14T09:19:10.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd73bfff640 1 -- 172.21.15.78:0/1947175077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c14ddb0 msgr2=0x7fd73c0c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:10.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd73bfff640 1 --2- 172.21.15.78:0/1947175077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c14ddb0 0x7fd73c0c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd73bfff640 1 -- 172.21.15.78:0/1947175077 >> v1:172.21.15.78:6789/0 conn(0x7fd73c153e80 legacy=0x7fd73c06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd73bfff640 1 -- 172.21.15.78:0/1947175077 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c06c750 con 0x7fd73c0c6910 2023-10-14T09:19:10.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.298+0000 7fd73b7fe640 1 --2- 172.21.15.78:0/1947175077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c14ddb0 0x7fd73c0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd73bfff640 1 --2- 172.21.15.78:0/1947175077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd73c0c6910 0x7fd73c0c3fe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd734009d90 tx=0x7fd73401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0af0d1946625a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd73a7fc640 1 -- 172.21.15.78:0/1947175077 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340a57e0 con 0x7fd73c0c6910 2023-10-14T09:19:10.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd73a7fc640 1 -- 172.21.15.78:0/1947175077 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7340a5940 con 0x7fd73c0c6910 2023-10-14T09:19:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd73a7fc640 1 -- 172.21.15.78:0/1947175077 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340a5cd0 con 0x7fd73c0c6910 2023-10-14T09:19:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd741c9a640 1 -- 172.21.15.78:0/1947175077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd73c0c6910 msgr2=0x7fd73c0c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd741c9a640 1 --2- 172.21.15.78:0/1947175077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd73c0c6910 0x7fd73c0c3fe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd734009d90 tx=0x7fd73401c830 comp rx=0 tx=0).stop 2023-10-14T09:19:10.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd741c9a640 1 -- 172.21.15.78:0/1947175077 shutdown_connections 2023-10-14T09:19:10.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd741c9a640 1 --2- 172.21.15.78:0/1947175077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd73c0c6910 0x7fd73c0c3fe0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd741c9a640 1 --2- 172.21.15.78:0/1947175077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c14ddb0 0x7fd73c0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd741c9a640 1 -- 172.21.15.78:0/1947175077 >> 172.21.15.78:0/1947175077 conn(0x7fd73c0ab1f0 msgr2=0x7fd73c0ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:10.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd741c9a640 1 -- 172.21.15.78:0/1947175077 shutdown_connections 2023-10-14T09:19:10.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.302+0000 7fd741c9a640 1 -- 172.21.15.78:0/1947175077 wait complete. 2023-10-14T09:19:10.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd741c9a640 1 Processor -- start 2023-10-14T09:19:10.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd741c9a640 1 -- start start 2023-10-14T09:19:10.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd741c9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd73c0c6910 0x7fd73c153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd741c9a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c14ddb0 0x7fd73c146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd741c9a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd73c153e80 0x7fd73c0bd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd741c9a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c158290 con 0x7fd73c0c6910 2023-10-14T09:19:10.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd741c9a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0bc900 con 0x7fd73c153e80 2023-10-14T09:19:10.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd741c9a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c155330 con 0x7fd73c14ddb0 2023-10-14T09:19:10.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd73b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd73c0c6910 0x7fd73c153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd73b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd73c0c6910 0x7fd73c153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46852/0 (socket says 172.21.15.78:46852) 2023-10-14T09:19:10.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd73b7fe640 1 -- 172.21.15.78:0/1441215599 learned_addr learned my addr 172.21.15.78:0/1441215599 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:10.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd73affd640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c14ddb0 0x7fd73c146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd73bfff640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd73c153e80 0x7fd73c0bd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd73b7fe640 1 -- 172.21.15.78:0/1441215599 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c14ddb0 msgr2=0x7fd73c146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd73b7fe640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c14ddb0 0x7fd73c146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd73b7fe640 1 -- 172.21.15.78:0/1441215599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd73c153e80 msgr2=0x7fd73c0bd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd73b7fe640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd73c153e80 0x7fd73c0bd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd73b7fe640 1 -- 172.21.15.78:0/1441215599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd734009a70 con 0x7fd73c0c6910 2023-10-14T09:19:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd73b7fe640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd73c0c6910 0x7fd73c153460 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd72c00d800 tx=0x7fd72c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd723fff640 1 -- 172.21.15.78:0/1441215599 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0096c0 con 0x7fd73c0c6910 2023-10-14T09:19:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd723fff640 1 -- 172.21.15.78:0/1441215599 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c009820 con 0x7fd73c0c6910 2023-10-14T09:19:10.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd723fff640 1 -- 172.21.15.78:0/1441215599 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c009bd0 con 0x7fd73c0c6910 2023-10-14T09:19:10.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd741c9a640 1 -- 172.21.15.78:0/1441215599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c152c60 con 0x7fd73c0c6910 2023-10-14T09:19:10.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.306+0000 7fd741c9a640 1 -- 172.21.15.78:0/1441215599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c146cd0 con 0x7fd73c0c6910 2023-10-14T09:19:10.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.310+0000 7fd741c9a640 1 -- 172.21.15.78:0/1441215599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c074180 con 0x7fd73c0c6910 2023-10-14T09:19:10.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.310+0000 7fd723fff640 1 -- 172.21.15.78:0/1441215599 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd72c009d30 con 0x7fd73c0c6910 2023-10-14T09:19:10.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.310+0000 7fd723fff640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7280664a0 0x7fd728068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.310+0000 7fd723fff640 1 -- 172.21.15.78:0/1441215599 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd72c084290 con 0x7fd73c0c6910 2023-10-14T09:19:10.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.310+0000 7fd73affd640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7280664a0 0x7fd728068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.310+0000 7fd73affd640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7280664a0 0x7fd728068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd73c14bdd0 tx=0x7fd730009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:10.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.314+0000 7fd723fff640 1 -- 172.21.15.78:0/1441215599 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd72c051a00 con 0x7fd73c0c6910 2023-10-14T09:19:10.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.462+0000 7fd741c9a640 1 -- 172.21.15.78:0/1441215599 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd73c14e190 con 0x7fd7280664a0 2023-10-14T09:19:10.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd723fff640 1 -- 172.21.15.78:0/1441215599 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50520 (secure 0 0 0) 0x7fd730001cf0 con 0x7fd7280664a0 2023-10-14T09:19:10.472 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:10.474 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-10-14T09:19:10.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 -- 172.21.15.78:0/1441215599 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7280664a0 msgr2=0x7fd728068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7280664a0 0x7fd728068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd73c14bdd0 tx=0x7fd730009040 comp rx=0 tx=0).stop 2023-10-14T09:19:10.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 -- 172.21.15.78:0/1441215599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd73c0c6910 msgr2=0x7fd73c153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd73c0c6910 0x7fd73c153460 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd72c00d800 tx=0x7fd72c00dcc0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 -- 172.21.15.78:0/1441215599 shutdown_connections 2023-10-14T09:19:10.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd73c153e80 0x7fd73c0bd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fd7280664a0 0x7fd728068960 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd73c14ddb0 0x7fd73c146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 --2- 172.21.15.78:0/1441215599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd73c0c6910 0x7fd73c153460 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 -- 172.21.15.78:0/1441215599 >> 172.21.15.78:0/1441215599 conn(0x7fd73c0ab1f0 msgr2=0x7fd73c14b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:10.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 -- 172.21.15.78:0/1441215599 shutdown_connections 2023-10-14T09:19:10.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.466+0000 7fd741c9a640 1 -- 172.21.15.78:0/1441215599 wait complete. 2023-10-14T09:19:10.492 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-10-14T09:19:09.252710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223452,"kb_used_data":3124,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751268,"statfs":{"total":773094113280,"available":772865298432,"internally_reserved":0,"allocated":3198976,"data_stored":2378165,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001073"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T09:19:04.321647+0000","last_change":"2023-10-14T09:17:14.304224+0000","last_active":"2023-10-14T09:19:04.321647+0000","last_peered":"2023-10-14T09:19:04.321647+0000","last_clean":"2023-10-14T09:19:04.321647+0000","last_became_active":"2023-10-14T09:17:14.303743+0000","last_became_peered":"2023-10-14T09:17:14.303743+0000","last_unstale":"2023-10-14T09:19:04.321647+0000","last_undegraded":"2023-10-14T09:19:04.321647+0000","last_fullsized":"2023-10-14T09:19:04.321647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_clean_scrub_stamp":"2023-10-14T09:17:13.285641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:24.100243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":743437,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.623}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.75}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.5389999999999997,"5min":5.5389999999999997,"15min":5.5389999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.4489999999999998,"5min":5.4489999999999998,"15min":5.4489999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.82499999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":5.4770000000000003,"5min":5.4770000000000003,"15min":5.4770000000000003},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.73499999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.622},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.754}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80700000000000005}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.57799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70199999999999996}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.78400000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.93100000000000005}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.89800000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.62},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.85399999999999998}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.95799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":153069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.62},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68300000000000005}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":6.6749999999999998,"5min":6.6749999999999998,"15min":6.6749999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.745}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":153069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.626}]},{"osd":5,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.60399999999999998}]},{"osd":6,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.70599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":147116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.51300000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.1680000000000001,"5min":4.1680000000000001,"15min":4.1680000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.59199999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.80900000000000005}]},{"osd":5,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":4.4219999999999997},"last":0.86799999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":4.5030000000000001,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.0780000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.5499999999999998,"5min":4.5499999999999998,"15min":4.5499999999999998},"last":0.97699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.505},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.748}]},{"osd":4,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.86599999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.83999999999999997}]},{"osd":6,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.94799999999999995}]},{"osd":7,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.97299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":737414,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58099999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.52700000000000002}]},{"osd":3,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.77700000000000002}]},{"osd":5,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:19:10.496 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:19:10.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.626+0000 7f94952c9640 1 Processor -- start 2023-10-14T09:19:10.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.626+0000 7f94952c9640 1 -- start start 2023-10-14T09:19:10.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f94952c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f949014ddb0 0x7f94900c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f94952c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9490153e80 0x7f949006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f94952c9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949006c470 con 0x7f94900c6910 2023-10-14T09:19:10.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f94952c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94900c64f0 con 0x7f949014ddb0 2023-10-14T09:19:10.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f94952c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900c5300 con 0x7f9490153e80 2023-10-14T09:19:10.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f948effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f949014ddb0 0x7f94900c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f948effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f949014ddb0 0x7f94900c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46866/0 (socket says 172.21.15.78:46866) 2023-10-14T09:19:10.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f948effd640 1 -- 172.21.15.78:0/199439401 learned_addr learned my addr 172.21.15.78:0/199439401 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:10.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f94867fc640 1 --2- 172.21.15.78:0/199439401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9490153e80 0x7f949006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f948effd640 1 -- 172.21.15.78:0/199439401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9490153e80 msgr2=0x7f949006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:10.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f948effd640 1 --2- 172.21.15.78:0/199439401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9490153e80 0x7f949006bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f948effd640 1 -- 172.21.15.78:0/199439401 >> v1:172.21.15.157:6789/0 conn(0x7f94900c6910 legacy=0x7f94900c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:10.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.630+0000 7f948effd640 1 -- 172.21.15.78:0/199439401 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949006c750 con 0x7f949014ddb0 2023-10-14T09:19:10.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f948effd640 1 --2- 172.21.15.78:0/199439401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949014ddb0 0x7f94900c7780 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9480009870 tx=0x7f948001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a163a1dda2a3d543 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:10.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f948e7fc640 1 -- 172.21.15.78:0/199439401 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800ab600 con 0x7f949014ddb0 2023-10-14T09:19:10.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f948e7fc640 1 -- 172.21.15.78:0/199439401 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94800a7050 con 0x7f949014ddb0 2023-10-14T09:19:10.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f948e7fc640 1 -- 172.21.15.78:0/199439401 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800ab980 con 0x7f949014ddb0 2023-10-14T09:19:10.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f94952c9640 1 -- 172.21.15.78:0/199439401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949014ddb0 msgr2=0x7f94900c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f94952c9640 1 --2- 172.21.15.78:0/199439401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949014ddb0 0x7f94900c7780 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9480009870 tx=0x7f948001c3b0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f94952c9640 1 -- 172.21.15.78:0/199439401 shutdown_connections 2023-10-14T09:19:10.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f94952c9640 1 --2- 172.21.15.78:0/199439401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9490153e80 0x7f949006bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f94952c9640 1 --2- 172.21.15.78:0/199439401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f949014ddb0 0x7f94900c7780 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f94952c9640 1 -- 172.21.15.78:0/199439401 >> 172.21.15.78:0/199439401 conn(0x7f94900ab1f0 msgr2=0x7f94900ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:10.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f94952c9640 1 -- 172.21.15.78:0/199439401 shutdown_connections 2023-10-14T09:19:10.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f94952c9640 1 -- 172.21.15.78:0/199439401 wait complete. 2023-10-14T09:19:10.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f94952c9640 1 Processor -- start 2023-10-14T09:19:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.634+0000 7f94952c9640 1 -- start start 2023-10-14T09:19:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f94952c9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94900c6910 0x7f949014ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f94952c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f949014ddb0 0x7f94900c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f94952c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9490153e80 0x7f949014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f94952c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949014f8e0 con 0x7f9490153e80 2023-10-14T09:19:10.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f94952c9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900be500 con 0x7f94900c6910 2023-10-14T09:19:10.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f94952c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949014f0e0 con 0x7f949014ddb0 2023-10-14T09:19:10.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f948f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9490153e80 0x7f949014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f948f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9490153e80 0x7f949014a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46874/0 (socket says 172.21.15.78:46874) 2023-10-14T09:19:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f948f7fe640 1 -- 172.21.15.78:0/681520045 learned_addr learned my addr 172.21.15.78:0/681520045 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f948effd640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94900c6910 0x7f949014ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f94867fc640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f949014ddb0 0x7f94900c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f948f7fe640 1 -- 172.21.15.78:0/681520045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f949014ddb0 msgr2=0x7f94900c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f948f7fe640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f949014ddb0 0x7f94900c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f948f7fe640 1 -- 172.21.15.78:0/681520045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94900c6910 msgr2=0x7f949014ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f948f7fe640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94900c6910 0x7f949014ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f948f7fe640 1 -- 172.21.15.78:0/681520045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94800094d0 con 0x7f9490153e80 2023-10-14T09:19:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f94867fc640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f949014ddb0 0x7f94900c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:10.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f948f7fe640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9490153e80 0x7f949014a0f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f948800b440 tx=0x7f948800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:10.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f9487fff640 1 -- 172.21.15.78:0/681520045 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488011830 con 0x7f9490153e80 2023-10-14T09:19:10.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f9487fff640 1 -- 172.21.15.78:0/681520045 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94880119b0 con 0x7f9490153e80 2023-10-14T09:19:10.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f9487fff640 1 -- 172.21.15.78:0/681520045 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488011d60 con 0x7f9490153e80 2023-10-14T09:19:10.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f94952c9640 1 -- 172.21.15.78:0/681520045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94900bed10 con 0x7f9490153e80 2023-10-14T09:19:10.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f94952c9640 1 -- 172.21.15.78:0/681520045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94900bea30 con 0x7f9490153e80 2023-10-14T09:19:10.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f94952c9640 1 -- 172.21.15.78:0/681520045 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9490074180 con 0x7f9490153e80 2023-10-14T09:19:10.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.638+0000 7f9487fff640 1 -- 172.21.15.78:0/681520045 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f94880193b0 con 0x7f9490153e80 2023-10-14T09:19:10.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.642+0000 7f9487fff640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94700664a0 0x7f9470068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.642+0000 7f9487fff640 1 -- 172.21.15.78:0/681520045 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9488083810 con 0x7f9490153e80 2023-10-14T09:19:10.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.642+0000 7f948effd640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94700664a0 0x7f9470068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.642+0000 7f948effd640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94700664a0 0x7f9470068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f94800ad000 tx=0x7f9480008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:10.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.646+0000 7f9487fff640 1 -- 172.21.15.78:0/681520045 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9488051020 con 0x7f9490153e80 2023-10-14T09:19:10.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.790+0000 7f94952c9640 1 -- 172.21.15.78:0/681520045 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f949014e190 con 0x7f94700664a0 2023-10-14T09:19:10.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f9487fff640 1 -- 172.21.15.78:0/681520045 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50520 (secure 0 0 0) 0x7f94800b5410 con 0x7f94700664a0 2023-10-14T09:19:10.800 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:10.801 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-10-14T09:19:10.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 -- 172.21.15.78:0/681520045 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94700664a0 msgr2=0x7f9470068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94700664a0 0x7f9470068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f94800ad000 tx=0x7f9480008040 comp rx=0 tx=0).stop 2023-10-14T09:19:10.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 -- 172.21.15.78:0/681520045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9490153e80 msgr2=0x7f949014a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9490153e80 0x7f949014a0f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f948800b440 tx=0x7f948800b900 comp rx=0 tx=0).stop 2023-10-14T09:19:10.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 -- 172.21.15.78:0/681520045 shutdown_connections 2023-10-14T09:19:10.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9490153e80 0x7f949014a0f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f94700664a0 0x7f9470068960 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f949014ddb0 0x7f94900c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 --2- 172.21.15.78:0/681520045 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94900c6910 0x7f949014ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 -- 172.21.15.78:0/681520045 >> 172.21.15.78:0/681520045 conn(0x7f94900ab1f0 msgr2=0x7f949014cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:10.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 -- 172.21.15.78:0/681520045 shutdown_connections 2023-10-14T09:19:10.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.794+0000 7f94952c9640 1 -- 172.21.15.78:0/681520045 wait complete. 2023-10-14T09:19:10.820 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-10-14T09:19:09.252710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223452,"kb_used_data":3124,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751268,"statfs":{"total":773094113280,"available":772865298432,"internally_reserved":0,"allocated":3198976,"data_stored":2378165,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001073"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T09:19:04.321647+0000","last_change":"2023-10-14T09:17:14.304224+0000","last_active":"2023-10-14T09:19:04.321647+0000","last_peered":"2023-10-14T09:19:04.321647+0000","last_clean":"2023-10-14T09:19:04.321647+0000","last_became_active":"2023-10-14T09:17:14.303743+0000","last_became_peered":"2023-10-14T09:17:14.303743+0000","last_unstale":"2023-10-14T09:19:04.321647+0000","last_undegraded":"2023-10-14T09:19:04.321647+0000","last_fullsized":"2023-10-14T09:19:04.321647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_clean_scrub_stamp":"2023-10-14T09:17:13.285641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:24.100243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":743437,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.623}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.75}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.5389999999999997,"5min":5.5389999999999997,"15min":5.5389999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.4489999999999998,"5min":5.4489999999999998,"15min":5.4489999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.82499999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":5.4770000000000003,"5min":5.4770000000000003,"15min":5.4770000000000003},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.73499999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.622},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.754}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80700000000000005}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.57799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70199999999999996}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.78400000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.93100000000000005}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.89800000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.62},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.85399999999999998}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.95799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":153069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.62},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68300000000000005}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":6.6749999999999998,"5min":6.6749999999999998,"15min":6.6749999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.745}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":153069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.626}]},{"osd":5,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.60399999999999998}]},{"osd":6,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.70599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":147116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.51300000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.1680000000000001,"5min":4.1680000000000001,"15min":4.1680000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.59199999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.80900000000000005}]},{"osd":5,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":4.4219999999999997},"last":0.86799999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":4.5030000000000001,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.0780000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.5499999999999998,"5min":4.5499999999999998,"15min":4.5499999999999998},"last":0.97699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.505},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.748}]},{"osd":4,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.86599999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.83999999999999997}]},{"osd":6,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.94799999999999995}]},{"osd":7,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.97299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":737414,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58099999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.52700000000000002}]},{"osd":3,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.77700000000000002}]},{"osd":5,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:19:10.822 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T09:19:10.823 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:19:10.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9fe46640 1 Processor -- start 2023-10-14T09:19:10.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9fe46640 1 -- start start 2023-10-14T09:19:10.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9fe46640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac9814ddb0 0x7fac980c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9fe46640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac980c6910 0x7fac980c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9fe46640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9806c470 con 0x7fac98153e80 2023-10-14T09:19:10.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9fe46640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac980c64f0 con 0x7fac9814ddb0 2023-10-14T09:19:10.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9fe46640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac980c5300 con 0x7fac980c6910 2023-10-14T09:19:10.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9dbe2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac9814ddb0 0x7fac980c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9d3e1640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fac98153e80 0x7fac9806bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48244/0 (socket says 172.21.15.78:48244) 2023-10-14T09:19:10.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9d3e1640 1 -- 172.21.15.78:0/1308433814 learned_addr learned my addr 172.21.15.78:0/1308433814 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:10.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9e3e3640 1 --2- 172.21.15.78:0/1308433814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac980c6910 0x7fac980c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9dbe2640 1 -- 172.21.15.78:0/1308433814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac980c6910 msgr2=0x7fac980c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:10.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9dbe2640 1 --2- 172.21.15.78:0/1308433814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac980c6910 0x7fac980c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9dbe2640 1 -- 172.21.15.78:0/1308433814 >> v1:172.21.15.78:6789/0 conn(0x7fac98153e80 legacy=0x7fac9806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9dbe2640 1 -- 172.21.15.78:0/1308433814 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9806c750 con 0x7fac9814ddb0 2023-10-14T09:19:10.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9cbe0640 1 -- 172.21.15.78:0/1308433814 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956943271 0 0) 0x7fac9806c470 con 0x7fac98153e80 2023-10-14T09:19:10.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.954+0000 7fac9e3e3640 1 --2- 172.21.15.78:0/1308433814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac980c6910 0x7fac980c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:10.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9dbe2640 1 --2- 172.21.15.78:0/1308433814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9814ddb0 0x7fac980c7780 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fac940097c0 tx=0x7fac9401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19dd847f54d5e78a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:10.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9cbe0640 1 -- 172.21.15.78:0/1308433814 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac940ab600 con 0x7fac9814ddb0 2023-10-14T09:19:10.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9cbe0640 1 -- 172.21.15.78:0/1308433814 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac940a7050 con 0x7fac9814ddb0 2023-10-14T09:19:10.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9cbe0640 1 -- 172.21.15.78:0/1308433814 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac940ab980 con 0x7fac9814ddb0 2023-10-14T09:19:10.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9fe46640 1 -- 172.21.15.78:0/1308433814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9814ddb0 msgr2=0x7fac980c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9fe46640 1 --2- 172.21.15.78:0/1308433814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9814ddb0 0x7fac980c7780 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fac940097c0 tx=0x7fac9401c360 comp rx=0 tx=0).stop 2023-10-14T09:19:10.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9fe46640 1 -- 172.21.15.78:0/1308433814 shutdown_connections 2023-10-14T09:19:10.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9fe46640 1 --2- 172.21.15.78:0/1308433814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac980c6910 0x7fac980c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9fe46640 1 --2- 172.21.15.78:0/1308433814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9814ddb0 0x7fac980c7780 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9fe46640 1 -- 172.21.15.78:0/1308433814 >> 172.21.15.78:0/1308433814 conn(0x7fac980ab1f0 msgr2=0x7fac980ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:10.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9fe46640 1 -- 172.21.15.78:0/1308433814 shutdown_connections 2023-10-14T09:19:10.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.958+0000 7fac9fe46640 1 -- 172.21.15.78:0/1308433814 wait complete. 2023-10-14T09:19:10.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9fe46640 1 Processor -- start 2023-10-14T09:19:10.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9fe46640 1 -- start start 2023-10-14T09:19:10.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9fe46640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac980c6910 0x7fac9815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9fe46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9814ddb0 0x7fac981ec1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9fe46640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac98153e80 0x7fac981ec700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9fe46640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9814b190 con 0x7fac9814ddb0 2023-10-14T09:19:10.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9fe46640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac981ef8d0 con 0x7fac98153e80 2023-10-14T09:19:10.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9fe46640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac981efbb0 con 0x7fac980c6910 2023-10-14T09:19:10.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9d3e1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9814ddb0 0x7fac981ec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9d3e1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9814ddb0 0x7fac981ec1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46904/0 (socket says 172.21.15.78:46904) 2023-10-14T09:19:10.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9d3e1640 1 -- 172.21.15.78:0/2190157728 learned_addr learned my addr 172.21.15.78:0/2190157728 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:10.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9d3e1640 1 -- 172.21.15.78:0/2190157728 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac980c6910 msgr2=0x7fac9815dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9d3e1640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac980c6910 0x7fac9815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9d3e1640 1 -- 172.21.15.78:0/2190157728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac98153e80 msgr2=0x7fac981ec700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:10.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9d3e1640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac98153e80 0x7fac981ec700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:10.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9d3e1640 1 -- 172.21.15.78:0/2190157728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac94009420 con 0x7fac9814ddb0 2023-10-14T09:19:10.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9d3e1640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9814ddb0 0x7fac981ec1c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fac880011f0 tx=0x7fac8800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:10.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac8e7fc640 1 -- 172.21.15.78:0/2190157728 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac880074e0 con 0x7fac9814ddb0 2023-10-14T09:19:10.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac8e7fc640 1 -- 172.21.15.78:0/2190157728 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac88007640 con 0x7fac9814ddb0 2023-10-14T09:19:10.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9fe46640 1 -- 172.21.15.78:0/2190157728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac981efe90 con 0x7fac9814ddb0 2023-10-14T09:19:10.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac8e7fc640 1 -- 172.21.15.78:0/2190157728 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88004a10 con 0x7fac9814ddb0 2023-10-14T09:19:10.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9fe46640 1 -- 172.21.15.78:0/2190157728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac98157180 con 0x7fac9814ddb0 2023-10-14T09:19:10.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.962+0000 7fac9fe46640 1 -- 172.21.15.78:0/2190157728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac981ef730 con 0x7fac9814ddb0 2023-10-14T09:19:10.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.966+0000 7fac8e7fc640 1 -- 172.21.15.78:0/2190157728 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fac88004b70 con 0x7fac9814ddb0 2023-10-14T09:19:10.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.966+0000 7fac8e7fc640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fac7c0664a0 0x7fac7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:10.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.966+0000 7fac8e7fc640 1 -- 172.21.15.78:0/2190157728 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fac88082e90 con 0x7fac9814ddb0 2023-10-14T09:19:10.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.966+0000 7fac9dbe2640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fac7c0664a0 0x7fac7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:10.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.966+0000 7fac9dbe2640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fac7c0664a0 0x7fac7c068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac940ad000 tx=0x7fac94004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:10.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:10.970+0000 7fac8e7fc640 1 -- 172.21.15.78:0/2190157728 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fac981ef730 con 0x7fac9814ddb0 2023-10-14T09:19:11.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.114+0000 7fac9fe46640 1 -- 172.21.15.78:0/2190157728 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac981efa40 con 0x7fac7c0664a0 2023-10-14T09:19:11.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac8e7fc640 1 -- 172.21.15.78:0/2190157728 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50520 (secure 0 0 0) 0x7fac981efa40 con 0x7fac7c0664a0 2023-10-14T09:19:11.125 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:11.126 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-10-14T09:19:11.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 -- 172.21.15.78:0/2190157728 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fac7c0664a0 msgr2=0x7fac7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:11.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fac7c0664a0 0x7fac7c068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac940ad000 tx=0x7fac94004740 comp rx=0 tx=0).stop 2023-10-14T09:19:11.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 -- 172.21.15.78:0/2190157728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9814ddb0 msgr2=0x7fac981ec1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:11.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9814ddb0 0x7fac981ec1c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fac880011f0 tx=0x7fac8800c9b0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 -- 172.21.15.78:0/2190157728 shutdown_connections 2023-10-14T09:19:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fac98153e80 0x7fac981ec700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac9814ddb0 0x7fac981ec1c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fac7c0664a0 0x7fac7c068960 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 --2- 172.21.15.78:0/2190157728 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fac980c6910 0x7fac9815dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 -- 172.21.15.78:0/2190157728 >> 172.21.15.78:0/2190157728 conn(0x7fac980ab1f0 msgr2=0x7fac981530c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 -- 172.21.15.78:0/2190157728 shutdown_connections 2023-10-14T09:19:11.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.118+0000 7fac9fe46640 1 -- 172.21.15.78:0/2190157728 wait complete. 2023-10-14T09:19:11.143 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2023-10-14T09:19:09.252710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223452,"kb_used_data":3124,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751268,"statfs":{"total":773094113280,"available":772865298432,"internally_reserved":0,"allocated":3198976,"data_stored":2378165,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":225496633},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001073"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-14T09:19:04.321647+0000","last_change":"2023-10-14T09:17:14.304224+0000","last_active":"2023-10-14T09:19:04.321647+0000","last_peered":"2023-10-14T09:19:04.321647+0000","last_clean":"2023-10-14T09:19:04.321647+0000","last_became_active":"2023-10-14T09:17:14.303743+0000","last_became_peered":"2023-10-14T09:17:14.303743+0000","last_unstale":"2023-10-14T09:19:04.321647+0000","last_undegraded":"2023-10-14T09:19:04.321647+0000","last_fullsized":"2023-10-14T09:19:04.321647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_clean_scrub_stamp":"2023-10-14T09:17:13.285641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:24.100243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":743437,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.623}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.75}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.69199999999999995}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.5389999999999997,"5min":5.5389999999999997,"15min":5.5389999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.4489999999999998,"5min":5.4489999999999998,"15min":5.4489999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.82499999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":5.4770000000000003,"5min":5.4770000000000003,"15min":5.4770000000000003},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.73499999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.622},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.754}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80700000000000005}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.57799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70199999999999996}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.78400000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.93100000000000005}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.89800000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.62},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.85399999999999998}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.95799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":153069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.62},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68300000000000005}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":6.6749999999999998,"5min":6.6749999999999998,"15min":6.6749999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.59999999999999998}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.745}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":153069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.626}]},{"osd":5,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.60399999999999998}]},{"osd":6,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.70599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":147116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.51300000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.1680000000000001,"5min":4.1680000000000001,"15min":4.1680000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.59199999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.80900000000000005}]},{"osd":5,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":4.4219999999999997},"last":0.86799999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":4.5030000000000001,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.0780000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.5499999999999998,"5min":4.5499999999999998,"15min":4.5499999999999998},"last":0.97699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.505},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.748}]},{"osd":4,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.86599999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.83999999999999997}]},{"osd":6,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.94799999999999995}]},{"osd":7,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.97299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":737414,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58099999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.52700000000000002}]},{"osd":3,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.77700000000000002}]},{"osd":5,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:19:11.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:19:11.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f242e8c9640 1 Processor -- start 2023-10-14T09:19:11.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f242e8c9640 1 -- start start 2023-10-14T09:19:11.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f242e8c9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f242813b050 0x7f2428155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:11.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f242e8c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f24280a8360 0x7f24280a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:11.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f242e8c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f242806cd70 0x7f242806d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:11.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f242e8c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24280a9340 con 0x7f24280a8360 2023-10-14T09:19:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f242e8c9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2428152a60 con 0x7f242813b050 2023-10-14T09:19:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f242e8c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2428155fb0 con 0x7f242806cd70 2023-10-14T09:19:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f24277fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f24280a8360 0x7f24280a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f24277fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f24280a8360 0x7f24280a87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46918/0 (socket says 172.21.15.78:46918) 2023-10-14T09:19:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f24277fe640 1 -- 172.21.15.78:0/549206750 learned_addr learned my addr 172.21.15.78:0/549206750 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f242ce66640 1 --2- 172.21.15.78:0/549206750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f242806cd70 0x7f242806d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f2427fff640 1 --2- 172.21.15.78:0/549206750 >> v2:172.21.15.157:3300/0 conn(0x7f242813b050 0x7f2428155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f24277fe640 1 -- 172.21.15.78:0/549206750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f242806cd70 msgr2=0x7f242806d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f24277fe640 1 --2- 172.21.15.78:0/549206750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f242806cd70 0x7f242806d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f24277fe640 1 -- 172.21.15.78:0/549206750 >> v2:172.21.15.157:3300/0 conn(0x7f242813b050 msgr2=0x7f2428155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f24277fe640 1 --2- 172.21.15.78:0/549206750 >> v2:172.21.15.157:3300/0 conn(0x7f242813b050 0x7f2428155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.278+0000 7f24277fe640 1 -- 172.21.15.78:0/549206750 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2428151e50 con 0x7f24280a8360 2023-10-14T09:19:11.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f24277fe640 1 --2- 172.21.15.78:0/549206750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24280a8360 0x7f24280a87c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f242806f6f0 tx=0x7f241c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b44f6e52c4eddf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:11.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f2426ffd640 1 -- 172.21.15.78:0/549206750 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0ab600 con 0x7f24280a8360 2023-10-14T09:19:11.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f2426ffd640 1 -- 172.21.15.78:0/549206750 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c0ab760 con 0x7f24280a8360 2023-10-14T09:19:11.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f2426ffd640 1 -- 172.21.15.78:0/549206750 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0abaf0 con 0x7f24280a8360 2023-10-14T09:19:11.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f242e8c9640 1 -- 172.21.15.78:0/549206750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24280a8360 msgr2=0x7f24280a87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:11.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f242e8c9640 1 --2- 172.21.15.78:0/549206750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24280a8360 0x7f24280a87c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f242806f6f0 tx=0x7f241c01c440 comp rx=0 tx=0).stop 2023-10-14T09:19:11.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f242e8c9640 1 -- 172.21.15.78:0/549206750 shutdown_connections 2023-10-14T09:19:11.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f242e8c9640 1 --2- 172.21.15.78:0/549206750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24280a8360 0x7f24280a87c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f242e8c9640 1 --2- 172.21.15.78:0/549206750 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f242806cd70 0x7f242806d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f242e8c9640 1 --2- 172.21.15.78:0/549206750 >> v2:172.21.15.157:3300/0 conn(0x7f242813b050 0x7f2428155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f242e8c9640 1 -- 172.21.15.78:0/549206750 >> 172.21.15.78:0/549206750 conn(0x7f24280c1cc0 msgr2=0x7f24280c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:11.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f242e8c9640 1 -- 172.21.15.78:0/549206750 shutdown_connections 2023-10-14T09:19:11.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.282+0000 7f242e8c9640 1 -- 172.21.15.78:0/549206750 wait complete. 2023-10-14T09:19:11.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242e8c9640 1 Processor -- start 2023-10-14T09:19:11.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242e8c9640 1 -- start start 2023-10-14T09:19:11.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242e8c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f242806cd70 0x7f24281ecec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:11.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242e8c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f24280a8360 0x7f24280be800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:11.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242e8c9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f242813b050 0x7f2428137ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:11.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242e8c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24281ed400 con 0x7f242806cd70 2023-10-14T09:19:11.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242e8c9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24280c3ee0 con 0x7f242813b050 2023-10-14T09:19:11.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242e8c9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24280c3c00 con 0x7f24280a8360 2023-10-14T09:19:11.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2427fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f242806cd70 0x7f24281ecec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:11.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2427fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f242806cd70 0x7f24281ecec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46934/0 (socket says 172.21.15.78:46934) 2023-10-14T09:19:11.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2427fff640 1 -- 172.21.15.78:0/3140840605 learned_addr learned my addr 172.21.15.78:0/3140840605 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:11.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f24277fe640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f24280a8360 0x7f24280be800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:11.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242ce66640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f242813b050 0x7f2428137ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:11.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2427fff640 1 -- 172.21.15.78:0/3140840605 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f24280a8360 msgr2=0x7f24280be800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:11.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2427fff640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f24280a8360 0x7f24280be800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2427fff640 1 -- 172.21.15.78:0/3140840605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f242813b050 msgr2=0x7f2428137ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:11.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2427fff640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f242813b050 0x7f2428137ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2427fff640 1 -- 172.21.15.78:0/3140840605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c0094d0 con 0x7f242806cd70 2023-10-14T09:19:11.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242ce66640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f242813b050 0x7f2428137ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:11.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2427fff640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f242806cd70 0x7f24281ecec0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f241800d5f0 tx=0x7f241800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:11.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2424ff9640 1 -- 172.21.15.78:0/3140840605 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24180125f0 con 0x7f242806cd70 2023-10-14T09:19:11.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2424ff9640 1 -- 172.21.15.78:0/3140840605 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2418012750 con 0x7f242806cd70 2023-10-14T09:19:11.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f2424ff9640 1 -- 172.21.15.78:0/3140840605 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418012ae0 con 0x7f242806cd70 2023-10-14T09:19:11.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242e8c9640 1 -- 172.21.15.78:0/3140840605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24280c2fb0 con 0x7f242806cd70 2023-10-14T09:19:11.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.286+0000 7f242e8c9640 1 -- 172.21.15.78:0/3140840605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24280bed40 con 0x7f242806cd70 2023-10-14T09:19:11.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.290+0000 7f242e8c9640 1 -- 172.21.15.78:0/3140840605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24281500b0 con 0x7f242806cd70 2023-10-14T09:19:11.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.290+0000 7f2424ff9640 1 -- 172.21.15.78:0/3140840605 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2418012c40 con 0x7f242806cd70 2023-10-14T09:19:11.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.290+0000 7f2424ff9640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24140664a0 0x7f2414068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:11.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.290+0000 7f2424ff9640 1 -- 172.21.15.78:0/3140840605 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2418083f60 con 0x7f242806cd70 2023-10-14T09:19:11.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.290+0000 7f24277fe640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24140664a0 0x7f2414068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:11.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.290+0000 7f24277fe640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24140664a0 0x7f2414068960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f241c0af000 tx=0x7f241c0b6040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:11.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.294+0000 7f2424ff9640 1 -- 172.21.15.78:0/3140840605 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24180516d0 con 0x7f242806cd70 2023-10-14T09:19:11.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.446+0000 7f242e8c9640 1 -- 172.21.15.78:0/3140840605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24280c2e10 con 0x7f242806cd70 2023-10-14T09:19:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f2424ff9640 1 -- 172.21.15.78:0/3140840605 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+12986 (secure 0 0 0) 0x7f24280c2e10 con 0x7f242806cd70 2023-10-14T09:19:11.456 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:11.456 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":35,"fsid":"1f80be0e-0937-433c-91b2-bf32e5285783","created":"2023-10-14T09:17:00.276410+0000","modified":"2023-10-14T09:19:07.336644+0000","last_up_change":"2023-10-14T09:17:11.761710+0000","last_in_change":"2023-10-14T09:17:02.813622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T09:17:13.284800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fb7f8a9f-6e8d-42c2-906d-79467322e729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6801","nonce":2033199867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6803","nonce":2033199867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6807","nonce":2033199867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2033199867},{"type":"v1","addr":"172.21.15.78:6805","nonce":2033199867}]},"public_addr":"172.21.15.78:6801/2033199867","cluster_addr":"172.21.15.78:6803/2033199867","heartbeat_back_addr":"172.21.15.78:6807/2033199867","heartbeat_front_addr":"172.21.15.78:6805/2033199867","state":["exists","up"]},{"osd":1,"uuid":"c5c17401-4f3a-449f-b874-f5e42396a285","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6819","nonce":2815629814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6823","nonce":2815629814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6831","nonce":2815629814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":2815629814},{"type":"v1","addr":"172.21.15.78:6827","nonce":2815629814}]},"public_addr":"172.21.15.78:6819/2815629814","cluster_addr":"172.21.15.78:6823/2815629814","heartbeat_back_addr":"172.21.15.78:6831/2815629814","heartbeat_front_addr":"172.21.15.78:6827/2815629814","state":["exists","up"]},{"osd":2,"uuid":"cda00e01-383f-4c56-a121-796e5f7c9c64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6809","nonce":1585824417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6811","nonce":1585824417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6815","nonce":1585824417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1585824417},{"type":"v1","addr":"172.21.15.78:6813","nonce":1585824417}]},"public_addr":"172.21.15.78:6809/1585824417","cluster_addr":"172.21.15.78:6811/1585824417","heartbeat_back_addr":"172.21.15.78:6815/1585824417","heartbeat_front_addr":"172.21.15.78:6813/1585824417","state":["exists","up"]},{"osd":3,"uuid":"c0c32a4a-3e8b-4f04-bf64-2b1c4a37d813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6818","nonce":3754005469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6822","nonce":3754005469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6830","nonce":3754005469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3754005469},{"type":"v1","addr":"172.21.15.78:6826","nonce":3754005469}]},"public_addr":"172.21.15.78:6818/3754005469","cluster_addr":"172.21.15.78:6822/3754005469","heartbeat_back_addr":"172.21.15.78:6830/3754005469","heartbeat_front_addr":"172.21.15.78:6826/3754005469","state":["exists","up"]},{"osd":4,"uuid":"54c76eda-1a80-46b2-a1af-addca7fed3e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6817","nonce":1674405437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6819","nonce":1674405437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6823","nonce":1674405437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1674405437},{"type":"v1","addr":"172.21.15.157:6821","nonce":1674405437}]},"public_addr":"172.21.15.157:6817/1674405437","cluster_addr":"172.21.15.157:6819/1674405437","heartbeat_back_addr":"172.21.15.157:6823/1674405437","heartbeat_front_addr":"172.21.15.157:6821/1674405437","state":["exists","up"]},{"osd":5,"uuid":"88a2bc95-e817-424d-9494-25456a052e54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6801","nonce":1064939114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6803","nonce":1064939114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6807","nonce":1064939114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1064939114},{"type":"v1","addr":"172.21.15.157:6805","nonce":1064939114}]},"public_addr":"172.21.15.157:6801/1064939114","cluster_addr":"172.21.15.157:6803/1064939114","heartbeat_back_addr":"172.21.15.157:6807/1064939114","heartbeat_front_addr":"172.21.15.157:6805/1064939114","state":["exists","up"]},{"osd":6,"uuid":"d2e85be6-a9ed-4e64-bcb1-186878103a71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6809","nonce":3274328420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6811","nonce":3274328420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6815","nonce":3274328420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3274328420},{"type":"v1","addr":"172.21.15.157:6813","nonce":3274328420}]},"public_addr":"172.21.15.157:6809/3274328420","cluster_addr":"172.21.15.157:6811/3274328420","heartbeat_back_addr":"172.21.15.157:6815/3274328420","heartbeat_front_addr":"172.21.15.157:6813/3274328420","state":["exists","up"]},{"osd":7,"uuid":"0627beaf-ae5b-42df-a6a6-9090c3ee77c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6825","nonce":782145234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6827","nonce":782145234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6831","nonce":782145234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":782145234},{"type":"v1","addr":"172.21.15.157:6829","nonce":782145234}]},"public_addr":"172.21.15.157:6825/782145234","cluster_addr":"172.21.15.157:6827/782145234","heartbeat_back_addr":"172.21.15.157:6831/782145234","heartbeat_front_addr":"172.21.15.157:6829/782145234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.336911+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.565894+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.513106+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.578040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.775192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.460553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.384550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T09:17:08.758929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6837/4241140805":"2023-10-15T09:19:04.109751+0000","172.21.15.78:6836/4241140805":"2023-10-15T09:19:04.109751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:19:11.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 -- 172.21.15.78:0/3140840605 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24140664a0 msgr2=0x7f2414068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:11.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24140664a0 0x7f2414068960 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f241c0af000 tx=0x7f241c0b6040 comp rx=0 tx=0).stop 2023-10-14T09:19:11.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 -- 172.21.15.78:0/3140840605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f242806cd70 msgr2=0x7f24281ecec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f242806cd70 0x7f24281ecec0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f241800d5f0 tx=0x7f241800dab0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 -- 172.21.15.78:0/3140840605 shutdown_connections 2023-10-14T09:19:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f242813b050 0x7f2428137ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f24140664a0 0x7f2414068960 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f24280a8360 0x7f24280be800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 --2- 172.21.15.78:0/3140840605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f242806cd70 0x7f24281ecec0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 -- 172.21.15.78:0/3140840605 >> 172.21.15.78:0/3140840605 conn(0x7f24280c1cc0 msgr2=0x7f24281354c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 -- 172.21.15.78:0/3140840605 shutdown_connections 2023-10-14T09:19:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:11.450+0000 7f242e8c9640 1 -- 172.21.15.78:0/3140840605 wait complete. 2023-10-14T09:19:12.477 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T09:19:12.478 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:19:12.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f7662c17640 1 Processor -- start 2023-10-14T09:19:12.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f7662c17640 1 -- start start 2023-10-14T09:19:12.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f7662c17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f765c06d7f0 0x7f765c150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f7662c17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f765c154800 0x7f765c06a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f7662c17640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f765c151430 0x7f765c06aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f7662c17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c0c1390 con 0x7f765c06d7f0 2023-10-14T09:19:12.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f7662c17640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c0c1be0 con 0x7f765c151430 2023-10-14T09:19:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f7662c17640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c154d00 con 0x7f765c154800 2023-10-14T09:19:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f76609b3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f765c06d7f0 0x7f765c150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f76609b3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f765c06d7f0 0x7f765c150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46942/0 (socket says 172.21.15.78:46942) 2023-10-14T09:19:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f76609b3640 1 -- 172.21.15.78:0/690244909 learned_addr learned my addr 172.21.15.78:0/690244909 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f765bfff640 1 --2- 172.21.15.78:0/690244909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f765c154800 0x7f765c06a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f76611b4640 1 --2- 172.21.15.78:0/690244909 >> v2:172.21.15.157:3300/0 conn(0x7f765c151430 0x7f765c06aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f76609b3640 1 -- 172.21.15.78:0/690244909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f765c154800 msgr2=0x7f765c06a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f76609b3640 1 --2- 172.21.15.78:0/690244909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f765c154800 0x7f765c06a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f76609b3640 1 -- 172.21.15.78:0/690244909 >> v2:172.21.15.157:3300/0 conn(0x7f765c151430 msgr2=0x7f765c06aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:12.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f76609b3640 1 --2- 172.21.15.78:0/690244909 >> v2:172.21.15.157:3300/0 conn(0x7f765c151430 0x7f765c06aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.626+0000 7f76609b3640 1 -- 172.21.15.78:0/690244909 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c0c1df0 con 0x7f765c06d7f0 2023-10-14T09:19:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f76609b3640 1 --2- 172.21.15.78:0/690244909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765c06d7f0 0x7f765c150ef0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7650009870 tx=0x7f765001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbce31c16d13c7fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f765b7fe640 1 -- 172.21.15.78:0/690244909 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500ab600 con 0x7f765c06d7f0 2023-10-14T09:19:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f765b7fe640 1 -- 172.21.15.78:0/690244909 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500a7050 con 0x7f765c06d7f0 2023-10-14T09:19:12.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f765b7fe640 1 -- 172.21.15.78:0/690244909 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500ab980 con 0x7f765c06d7f0 2023-10-14T09:19:12.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f7662c17640 1 -- 172.21.15.78:0/690244909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765c06d7f0 msgr2=0x7f765c150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f7662c17640 1 --2- 172.21.15.78:0/690244909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765c06d7f0 0x7f765c150ef0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7650009870 tx=0x7f765001c500 comp rx=0 tx=0).stop 2023-10-14T09:19:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f7662c17640 1 -- 172.21.15.78:0/690244909 shutdown_connections 2023-10-14T09:19:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f7662c17640 1 --2- 172.21.15.78:0/690244909 >> v2:172.21.15.157:3300/0 conn(0x7f765c151430 0x7f765c06aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f7662c17640 1 --2- 172.21.15.78:0/690244909 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f765c154800 0x7f765c06a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f7662c17640 1 --2- 172.21.15.78:0/690244909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765c06d7f0 0x7f765c150ef0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f7662c17640 1 -- 172.21.15.78:0/690244909 >> 172.21.15.78:0/690244909 conn(0x7f765c0c25b0 msgr2=0x7f765c0c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:12.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f7662c17640 1 -- 172.21.15.78:0/690244909 shutdown_connections 2023-10-14T09:19:12.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.630+0000 7f7662c17640 1 -- 172.21.15.78:0/690244909 wait complete. 2023-10-14T09:19:12.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f7662c17640 1 Processor -- start 2023-10-14T09:19:12.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f7662c17640 1 -- start start 2023-10-14T09:19:12.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f7662c17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765c06d7f0 0x7f765c149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f7662c17640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f765c151430 0x7f765c140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f7662c17640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f765c154800 0x7f765c1412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f7662c17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c1ed340 con 0x7f765c06d7f0 2023-10-14T09:19:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f7662c17640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c0bc4c0 con 0x7f765c151430 2023-10-14T09:19:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f7662c17640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c149760 con 0x7f765c154800 2023-10-14T09:19:12.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76609b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765c06d7f0 0x7f765c149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76609b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765c06d7f0 0x7f765c149d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46950/0 (socket says 172.21.15.78:46950) 2023-10-14T09:19:12.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76609b3640 1 -- 172.21.15.78:0/1097018406 learned_addr learned my addr 172.21.15.78:0/1097018406 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:12.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76611b4640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f765c154800 0x7f765c1412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f765bfff640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f765c151430 0x7f765c140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76609b3640 1 -- 172.21.15.78:0/1097018406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f765c154800 msgr2=0x7f765c1412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76609b3640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f765c154800 0x7f765c1412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76609b3640 1 -- 172.21.15.78:0/1097018406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f765c151430 msgr2=0x7f765c140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76609b3640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f765c151430 0x7f765c140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76609b3640 1 -- 172.21.15.78:0/1097018406 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500094d0 con 0x7f765c06d7f0 2023-10-14T09:19:12.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76609b3640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765c06d7f0 0x7f765c149d00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f76500ae040 tx=0x7f765001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:12.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76597fa640 1 -- 172.21.15.78:0/1097018406 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500b6420 con 0x7f765c06d7f0 2023-10-14T09:19:12.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76597fa640 1 -- 172.21.15.78:0/1097018406 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500b65a0 con 0x7f765c06d7f0 2023-10-14T09:19:12.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f7662c17640 1 -- 172.21.15.78:0/1097018406 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c0bc780 con 0x7f765c06d7f0 2023-10-14T09:19:12.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f76597fa640 1 -- 172.21.15.78:0/1097018406 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500b6950 con 0x7f765c06d7f0 2023-10-14T09:19:12.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f7662c17640 1 -- 172.21.15.78:0/1097018406 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c14a240 con 0x7f765c06d7f0 2023-10-14T09:19:12.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.634+0000 7f7662c17640 1 -- 172.21.15.78:0/1097018406 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f765c06dbd0 con 0x7f765c06d7f0 2023-10-14T09:19:12.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.638+0000 7f76597fa640 1 -- 172.21.15.78:0/1097018406 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f76500b2040 con 0x7f765c06d7f0 2023-10-14T09:19:12.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.638+0000 7f76597fa640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76400664d0 0x7f7640068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.638+0000 7f76597fa640 1 -- 172.21.15.78:0/1097018406 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f765011de50 con 0x7f765c06d7f0 2023-10-14T09:19:12.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.638+0000 7f765bfff640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76400664d0 0x7f7640068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.638+0000 7f76597fa640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] conn(0x7f764006c330 0x7f764006e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.638+0000 7f76597fa640 1 -- 172.21.15.78:0/1097018406 --> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f764006ee00 con 0x7f764006c330 2023-10-14T09:19:12.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.638+0000 7f76597fa640 1 -- 172.21.15.78:0/1097018406 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7650120430 con 0x7f765c06d7f0 2023-10-14T09:19:12.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.638+0000 7f76611b4640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] conn(0x7f764006c330 0x7f764006e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.638+0000 7f765bfff640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76400664d0 0x7f7640068990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f765c148de0 tx=0x7f7648008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:12.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.638+0000 7f76611b4640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] conn(0x7f764006c330 0x7f764006e750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:12.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.638+0000 7f76597fa640 1 -- 172.21.15.78:0/1097018406 <== osd.0 v2:172.21.15.78:6800/2033199867 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f764006ee00 con 0x7f764006c330 2023-10-14T09:19:12.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.650+0000 7f7662c17640 1 -- 172.21.15.78:0/1097018406 --> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f765c1ed480 con 0x7f764006c330 2023-10-14T09:19:12.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f76597fa640 1 -- 172.21.15.78:0/1097018406 <== osd.0 v2:172.21.15.78:6800/2033199867 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f76540075b0 con 0x7f764006c330 2023-10-14T09:19:12.663 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:19:12.663 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:19:12.664 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:19:12.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f7662c17640 1 -- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] conn(0x7f764006c330 msgr2=0x7f764006e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f7662c17640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:6800/2033199867,v1:172.21.15.78:6801/2033199867] conn(0x7f764006c330 0x7f764006e750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f7662c17640 1 -- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76400664d0 msgr2=0x7f7640068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f7662c17640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f76400664d0 0x7f7640068990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f765c148de0 tx=0x7f7648008040 comp rx=0 tx=0).stop 2023-10-14T09:19:12.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f7662c17640 1 -- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765c06d7f0 msgr2=0x7f765c149d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f7662c17640 1 --2- 172.21.15.78:0/1097018406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f765c06d7f0 0x7f765c149d00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f76500ae040 tx=0x7f765001ad40 comp rx=0 tx=0).stop 2023-10-14T09:19:12.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f76611b4640 1 -- 172.21.15.78:0/1097018406 reap_dead start 2023-10-14T09:19:12.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f7662c17640 1 -- 172.21.15.78:0/1097018406 shutdown_connections 2023-10-14T09:19:12.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f7662c17640 1 -- 172.21.15.78:0/1097018406 >> 172.21.15.78:0/1097018406 conn(0x7f765c0c25b0 msgr2=0x7f765c147e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:12.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f7662c17640 1 -- 172.21.15.78:0/1097018406 shutdown_connections 2023-10-14T09:19:12.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.654+0000 7f7662c17640 1 -- 172.21.15.78:0/1097018406 wait complete. 2023-10-14T09:19:12.677 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T09:19:12.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.810+0000 7f66f2fd9640 1 Processor -- start 2023-10-14T09:19:12.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.810+0000 7f66f2fd9640 1 -- start start 2023-10-14T09:19:12.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.810+0000 7f66f2fd9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66ec13b050 0x7f66ec155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.810+0000 7f66f2fd9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec152a60 con 0x7f66ec0a87c0 2023-10-14T09:19:12.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.810+0000 7f66f2fd9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec155fb0 con 0x7f66ec0a8360 2023-10-14T09:19:12.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.810+0000 7f66f2fd9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec0a9340 con 0x7f66ec13b050 2023-10-14T09:19:12.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.810+0000 7f66f1576640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f66ec0a87c0 0x7f66ec06d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48252/0 (socket says 172.21.15.78:48252) 2023-10-14T09:19:12.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.810+0000 7f66f1576640 1 -- 172.21.15.78:0/3899700868 learned_addr learned my addr 172.21.15.78:0/3899700868 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:12.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.810+0000 7f66f0d75640 1 --2- 172.21.15.78:0/3899700868 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66ec13b050 0x7f66ec155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66e37fe640 1 -- 172.21.15.78:0/3899700868 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809520566 0 0) 0x7f66ec152a60 con 0x7f66ec0a87c0 2023-10-14T09:19:12.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66e37fe640 1 -- 172.21.15.78:0/3899700868 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d4003530 con 0x7f66ec0a87c0 2023-10-14T09:19:12.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66e37fe640 1 -- 172.21.15.78:0/3899700868 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990426224 0 0) 0x7f66ec155fb0 con 0x7f66ec0a8360 2023-10-14T09:19:12.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66e37fe640 1 -- 172.21.15.78:0/3899700868 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66ec152a60 con 0x7f66ec0a8360 2023-10-14T09:19:12.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66f0d75640 1 -- 172.21.15.78:0/3899700868 >> v1:172.21.15.157:6789/0 conn(0x7f66ec0a8360 legacy=0x7f66ec06cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66e37fe640 1 -- 172.21.15.78:0/3899700868 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3076660013 0 0) 0x7f66d4003530 con 0x7f66ec0a87c0 2023-10-14T09:19:12.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66f0d75640 1 -- 172.21.15.78:0/3899700868 >> v1:172.21.15.78:6789/0 conn(0x7f66ec0a87c0 legacy=0x7f66ec06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66f0d75640 1 -- 172.21.15.78:0/3899700868 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec151e50 con 0x7f66ec13b050 2023-10-14T09:19:12.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66f0d75640 1 --2- 172.21.15.78:0/3899700868 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66ec13b050 0x7f66ec155a70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f66e80097f0 tx=0x7f66e801c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1c767656d909dfb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:12.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66e37fe640 1 -- 172.21.15.78:0/3899700868 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4001a00 con 0x7f66ec13b050 2023-10-14T09:19:12.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66e37fe640 1 -- 172.21.15.78:0/3899700868 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e80a7050 con 0x7f66ec13b050 2023-10-14T09:19:12.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.814+0000 7f66e37fe640 1 -- 172.21.15.78:0/3899700868 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80ab620 con 0x7f66ec13b050 2023-10-14T09:19:12.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3899700868 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66ec13b050 msgr2=0x7f66ec155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 --2- 172.21.15.78:0/3899700868 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66ec13b050 0x7f66ec155a70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f66e80097f0 tx=0x7f66e801c2c0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3899700868 shutdown_connections 2023-10-14T09:19:12.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 --2- 172.21.15.78:0/3899700868 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66ec13b050 0x7f66ec155a70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3899700868 >> 172.21.15.78:0/3899700868 conn(0x7f66ec0c1cc0 msgr2=0x7f66ec0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:12.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3899700868 shutdown_connections 2023-10-14T09:19:12.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3899700868 wait complete. 2023-10-14T09:19:12.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 Processor -- start 2023-10-14T09:19:12.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 -- start start 2023-10-14T09:19:12.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66ec0a8360 0x7f66ec0c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66ec0a87c0 0x7f66ec139160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66ec13b050 0x7f66ec15c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec0c4f50 con 0x7f66ec0a87c0 2023-10-14T09:19:12.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec152e70 con 0x7f66ec0a8360 2023-10-14T09:19:12.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f2fd9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec1ebe70 con 0x7f66ec13b050 2023-10-14T09:19:12.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66e3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66ec0a87c0 0x7f66ec139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66e3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66ec0a87c0 0x7f66ec139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46960/0 (socket says 172.21.15.78:46960) 2023-10-14T09:19:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66e3fff640 1 -- 172.21.15.78:0/3880437362 learned_addr learned my addr 172.21.15.78:0/3880437362 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f0d75640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66ec0a8360 0x7f66ec0c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.818+0000 7f66f1576640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66ec13b050 0x7f66ec15c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e3fff640 1 -- 172.21.15.78:0/3880437362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66ec13b050 msgr2=0x7f66ec15c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e3fff640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66ec13b050 0x7f66ec15c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e3fff640 1 -- 172.21.15.78:0/3880437362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66ec0a8360 msgr2=0x7f66ec0c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e3fff640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66ec0a8360 0x7f66ec0c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e3fff640 1 -- 172.21.15.78:0/3880437362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8009420 con 0x7f66ec0a87c0 2023-10-14T09:19:12.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e3fff640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66ec0a87c0 0x7f66ec139160 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00c490 tx=0x7f66dc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:12.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e17fa640 1 -- 172.21.15.78:0/3880437362 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc0052d0 con 0x7f66ec0a87c0 2023-10-14T09:19:12.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e17fa640 1 -- 172.21.15.78:0/3880437362 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc005430 con 0x7f66ec0a87c0 2023-10-14T09:19:12.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3880437362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec1ec130 con 0x7f66ec0a87c0 2023-10-14T09:19:12.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e17fa640 1 -- 172.21.15.78:0/3880437362 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc012870 con 0x7f66ec0a87c0 2023-10-14T09:19:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3880437362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec1ec6f0 con 0x7f66ec0a87c0 2023-10-14T09:19:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3880437362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec074180 con 0x7f66ec0a87c0 2023-10-14T09:19:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e17fa640 1 -- 172.21.15.78:0/3880437362 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f66dc0129d0 con 0x7f66ec0a87c0 2023-10-14T09:19:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e17fa640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f66d80664a0 0x7f66d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66e17fa640 1 -- 172.21.15.78:0/3880437362 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f66dc0835d0 con 0x7f66ec0a87c0 2023-10-14T09:19:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.822+0000 7f66f0d75640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f66d80664a0 0x7f66d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.826+0000 7f66f0d75640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f66d80664a0 0x7f66d8068960 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f66e80ad000 tx=0x7f66e80a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:12.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.826+0000 7f66e17fa640 1 -- 172.21.15.78:0/3880437362 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f66dc050df0 con 0x7f66ec0a87c0 2023-10-14T09:19:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3880437362 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f66ec1526f0 con 0x7f66d80664a0 2023-10-14T09:19:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66e17fa640 1 -- 172.21.15.78:0/3880437362 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f66e80ab580 con 0x7f66d80664a0 2023-10-14T09:19:12.984 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T09:19:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3880437362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f66d80664a0 msgr2=0x7f66d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f66d80664a0 0x7f66d8068960 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f66e80ad000 tx=0x7f66e80a6000 comp rx=0 tx=0).stop 2023-10-14T09:19:12.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3880437362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66ec0a87c0 msgr2=0x7f66ec139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:12.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66ec0a87c0 0x7f66ec139160 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00c490 tx=0x7f66dc00c950 comp rx=0 tx=0).stop 2023-10-14T09:19:12.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3880437362 shutdown_connections 2023-10-14T09:19:12.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f66d80664a0 0x7f66d8068960 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66ec13b050 0x7f66ec15c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66ec0a87c0 0x7f66ec139160 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 --2- 172.21.15.78:0/3880437362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f66ec0a8360 0x7f66ec0c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:12.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3880437362 >> 172.21.15.78:0/3880437362 conn(0x7f66ec0c1cc0 msgr2=0x7f66ec06cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:12.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3880437362 shutdown_connections 2023-10-14T09:19:12.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:12.978+0000 7f66f2fd9640 1 -- 172.21.15.78:0/3880437362 wait complete. 2023-10-14T09:19:13.005 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T09:19:13.006 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:19:13.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e45ab640 1 Processor -- start 2023-10-14T09:19:13.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e45ab640 1 -- start start 2023-10-14T09:19:13.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e45ab640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc14e0f0 0x7f86dc152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e45ab640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f86dc14ed10 0x7f86dc14f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e45ab640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86dc1531d0 con 0x7f86dc14f6d0 2023-10-14T09:19:13.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e45ab640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86dc153e50 con 0x7f86dc14ed10 2023-10-14T09:19:13.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e45ab640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc1534b0 con 0x7f86dc14e0f0 2023-10-14T09:19:13.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e2b48640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f86dc14f6d0 0x7f86dc150a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48256/0 (socket says 172.21.15.78:48256) 2023-10-14T09:19:13.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e2b48640 1 -- 172.21.15.78:0/2574452455 learned_addr learned my addr 172.21.15.78:0/2574452455 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:13.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e2347640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc14e0f0 0x7f86dc152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1b46640 1 --2- 172.21.15.78:0/2574452455 >> v2:172.21.15.157:3300/0 conn(0x7f86dc14ed10 0x7f86dc14f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199045226 0 0) 0x7f86dc1531d0 con 0x7f86dc14f6d0 2023-10-14T09:19:13.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86c8003530 con 0x7f86dc14f6d0 2023-10-14T09:19:13.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3742589187 0 0) 0x7f86c8003530 con 0x7f86dc14f6d0 2023-10-14T09:19:13.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc14e0f0 msgr2=0x7f86dc152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:13.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc14e0f0 0x7f86dc152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 >> v2:172.21.15.157:3300/0 conn(0x7f86dc14ed10 msgr2=0x7f86dc14f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:13.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 --2- 172.21.15.78:0/2574452455 >> v2:172.21.15.157:3300/0 conn(0x7f86dc14ed10 0x7f86dc14f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc153790 con 0x7f86dc14f6d0 2023-10-14T09:19:13.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f86d4001a00 con 0x7f86dc14f6d0 2023-10-14T09:19:13.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 >> v1:172.21.15.78:6789/0 conn(0x7f86dc14f6d0 legacy=0x7f86dc150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86c8003980 0x7f86c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc14e0f0 0x7f86c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c8004d10 0x7f86c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc153e50 con 0x7f86c8003980 2023-10-14T09:19:13.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc1534b0 con 0x7f86c8004d10 2023-10-14T09:19:13.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c800b990 con 0x7f86dc14e0f0 2023-10-14T09:19:13.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e2347640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86c8003980 0x7f86c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e1b46640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc14e0f0 0x7f86c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e2b48640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c8004d10 0x7f86c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e2347640 1 -- 172.21.15.78:0/2574452455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc14e0f0 msgr2=0x7f86c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:13.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e2347640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc14e0f0 0x7f86c80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e2347640 1 -- 172.21.15.78:0/2574452455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c8004d10 msgr2=0x7f86c8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:13.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e2347640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c8004d10 0x7f86c8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.142+0000 7f86e2347640 1 -- 172.21.15.78:0/2574452455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8003530 con 0x7f86c8003980 2023-10-14T09:19:13.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.146+0000 7f86e2347640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86c8003980 0x7f86c8003da0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009ae0 tx=0x7f86dc1519b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440ca833a5bc45c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.146+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d80a6500 con 0x7f86c8003980 2023-10-14T09:19:13.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.146+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d80a6660 con 0x7f86c8003980 2023-10-14T09:19:13.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.146+0000 7f86e1345640 1 -- 172.21.15.78:0/2574452455 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d80a6a10 con 0x7f86c8003980 2023-10-14T09:19:13.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.146+0000 7f86e45ab640 1 -- 172.21.15.78:0/2574452455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86c8003980 msgr2=0x7f86c8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.146+0000 7f86e45ab640 1 --2- 172.21.15.78:0/2574452455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86c8003980 0x7f86c8003da0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009ae0 tx=0x7f86dc1519b0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.146+0000 7f86e2b48640 1 -- 172.21.15.78:0/2574452455 reap_dead start 2023-10-14T09:19:13.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.146+0000 7f86e45ab640 1 -- 172.21.15.78:0/2574452455 shutdown_connections 2023-10-14T09:19:13.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.146+0000 7f86e45ab640 1 -- 172.21.15.78:0/2574452455 >> 172.21.15.78:0/2574452455 conn(0x7f86dc0c1cc0 msgr2=0x7f86dc0c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:13.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.146+0000 7f86e45ab640 1 -- 172.21.15.78:0/2574452455 shutdown_connections 2023-10-14T09:19:13.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.146+0000 7f86e45ab640 1 -- 172.21.15.78:0/2574452455 wait complete. 2023-10-14T09:19:13.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e45ab640 1 Processor -- start 2023-10-14T09:19:13.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e45ab640 1 -- start start 2023-10-14T09:19:13.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e45ab640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c8003980 0x7f86dc1f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e45ab640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc1469e0 0x7f86dc070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e45ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc14b0f0 0x7f86dc14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e45ab640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc14c7a0 con 0x7f86dc14b0f0 2023-10-14T09:19:13.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e45ab640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc0c3ec0 con 0x7f86c8003980 2023-10-14T09:19:13.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e45ab640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc0c3a30 con 0x7f86dc1469e0 2023-10-14T09:19:13.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e2b48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc14b0f0 0x7f86dc14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e2b48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc14b0f0 0x7f86dc14b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46980/0 (socket says 172.21.15.78:46980) 2023-10-14T09:19:13.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e2b48640 1 -- 172.21.15.78:0/3089986925 learned_addr learned my addr 172.21.15.78:0/3089986925 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:13.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e2347640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c8003980 0x7f86dc1f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e1b46640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc1469e0 0x7f86dc070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e2b48640 1 -- 172.21.15.78:0/3089986925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc1469e0 msgr2=0x7f86dc070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e2b48640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f86dc1469e0 0x7f86dc070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e2b48640 1 -- 172.21.15.78:0/3089986925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c8003980 msgr2=0x7f86dc1f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e2b48640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c8003980 0x7f86dc1f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e2b48640 1 -- 172.21.15.78:0/3089986925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0c48b0 con 0x7f86dc14b0f0 2023-10-14T09:19:13.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e2347640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86c8003980 0x7f86dc1f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:13.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e2b48640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc14b0f0 0x7f86dc14b570 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0bfc90 tx=0x7f86d4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86d2ffd640 1 -- 172.21.15.78:0/3089986925 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d400abf0 con 0x7f86dc14b0f0 2023-10-14T09:19:13.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86d2ffd640 1 -- 172.21.15.78:0/3089986925 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d400ad50 con 0x7f86dc14b0f0 2023-10-14T09:19:13.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86d2ffd640 1 -- 172.21.15.78:0/3089986925 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4013630 con 0x7f86dc14b0f0 2023-10-14T09:19:13.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e45ab640 1 -- 172.21.15.78:0/3089986925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86dc0c4b90 con 0x7f86dc14b0f0 2023-10-14T09:19:13.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.150+0000 7f86e45ab640 1 -- 172.21.15.78:0/3089986925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86dc071430 con 0x7f86dc14b0f0 2023-10-14T09:19:13.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86e45ab640 1 -- 172.21.15.78:0/3089986925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86dc074110 con 0x7f86dc14b0f0 2023-10-14T09:19:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86d2ffd640 1 -- 172.21.15.78:0/3089986925 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f86d4013790 con 0x7f86dc14b0f0 2023-10-14T09:19:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86d2ffd640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f86c00664d0 0x7f86c0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86d2ffd640 1 -- 172.21.15.78:0/3089986925 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f86d40841b0 con 0x7f86dc14b0f0 2023-10-14T09:19:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86d2ffd640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] conn(0x7f86c006c330 0x7f86c006e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86d2ffd640 1 -- 172.21.15.78:0/3089986925 --> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86c006ee00 con 0x7f86c006c330 2023-10-14T09:19:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86d2ffd640 1 -- 172.21.15.78:0/3089986925 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86d4086790 con 0x7f86dc14b0f0 2023-10-14T09:19:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86e2347640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f86c00664d0 0x7f86c0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86e1b46640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] conn(0x7f86c006c330 0x7f86c006e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86e2347640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f86c00664d0 0x7f86c0068990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86d80af000 tx=0x7f86d80a8040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86e1b46640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] conn(0x7f86c006c330 0x7f86c006e750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.154+0000 7f86d2ffd640 1 -- 172.21.15.78:0/3089986925 <== osd.1 v2:172.21.15.78:6817/2815629814 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f86c006ee00 con 0x7f86c006c330 2023-10-14T09:19:13.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e45ab640 1 -- 172.21.15.78:0/3089986925 --> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f86dc0c3890 con 0x7f86c006c330 2023-10-14T09:19:13.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86d2ffd640 1 -- 172.21.15.78:0/3089986925 <== osd.1 v2:172.21.15.78:6817/2815629814 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f86cc009730 con 0x7f86c006c330 2023-10-14T09:19:13.184 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:19:13.184 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:19:13.185 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:19:13.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e45ab640 1 -- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] conn(0x7f86c006c330 msgr2=0x7f86c006e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e45ab640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:6817/2815629814,v1:172.21.15.78:6819/2815629814] conn(0x7f86c006c330 0x7f86c006e750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e45ab640 1 -- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f86c00664d0 msgr2=0x7f86c0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e45ab640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f86c00664d0 0x7f86c0068990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86d80af000 tx=0x7f86d80a8040 comp rx=0 tx=0).stop 2023-10-14T09:19:13.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e45ab640 1 -- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc14b0f0 msgr2=0x7f86dc14b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e45ab640 1 --2- 172.21.15.78:0/3089986925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86dc14b0f0 0x7f86dc14b570 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0bfc90 tx=0x7f86d4007a90 comp rx=0 tx=0).stop 2023-10-14T09:19:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e2b48640 1 -- 172.21.15.78:0/3089986925 reap_dead start 2023-10-14T09:19:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e45ab640 1 -- 172.21.15.78:0/3089986925 shutdown_connections 2023-10-14T09:19:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e45ab640 1 -- 172.21.15.78:0/3089986925 >> 172.21.15.78:0/3089986925 conn(0x7f86dc0c1cc0 msgr2=0x7f86dc14a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e45ab640 1 -- 172.21.15.78:0/3089986925 shutdown_connections 2023-10-14T09:19:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.170+0000 7f86e45ab640 1 -- 172.21.15.78:0/3089986925 wait complete. 2023-10-14T09:19:13.193 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T09:19:13.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.326+0000 7f108dda3640 1 Processor -- start 2023-10-14T09:19:13.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.326+0000 7f108dda3640 1 -- start start 2023-10-14T09:19:13.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.326+0000 7f108dda3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1088154920 0x7f10880c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.326+0000 7f108dda3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1088154490 con 0x7f10880c4810 2023-10-14T09:19:13.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.326+0000 7f108dda3640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10880c5a00 con 0x7f10881514b0 2023-10-14T09:19:13.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.326+0000 7f108dda3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1088153c30 con 0x7f1088154920 2023-10-14T09:19:13.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.330+0000 7f107ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1088154920 0x7f10880c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.330+0000 7f108d5a2640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f10880c4810 0x7f108815e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48262/0 (socket says 172.21.15.78:48262) 2023-10-14T09:19:13.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.330+0000 7f108d5a2640 1 -- 172.21.15.78:0/1570588212 learned_addr learned my addr 172.21.15.78:0/1570588212 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:13.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.330+0000 7f107ffff640 1 -- 172.21.15.78:0/1570588212 >> v1:172.21.15.157:6789/0 conn(0x7f10881514b0 legacy=0x7f10880c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:13.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.330+0000 7f107ffff640 1 -- 172.21.15.78:0/1570588212 >> v1:172.21.15.78:6789/0 conn(0x7f10880c4810 legacy=0x7f108815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.330+0000 7f107ffff640 1 -- 172.21.15.78:0/1570588212 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088153e40 con 0x7f1088154920 2023-10-14T09:19:13.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.330+0000 7f107f7fe640 1 -- 172.21.15.78:0/1570588212 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169288276 0 0) 0x7f1088154490 con 0x7f10880c4810 2023-10-14T09:19:13.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.330+0000 7f107ffff640 1 --2- 172.21.15.78:0/1570588212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1088154920 0x7f10880c7330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f10780097c0 tx=0x7f107801c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1802e506701ea4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.330+0000 7f107f7fe640 1 -- 172.21.15.78:0/1570588212 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780ac640 con 0x7f1088154920 2023-10-14T09:19:13.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.330+0000 7f107f7fe640 1 -- 172.21.15.78:0/1570588212 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10780ac7a0 con 0x7f1088154920 2023-10-14T09:19:13.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.330+0000 7f107f7fe640 1 -- 172.21.15.78:0/1570588212 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780acb30 con 0x7f1088154920 2023-10-14T09:19:13.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 -- 172.21.15.78:0/1570588212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1088154920 msgr2=0x7f10880c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 --2- 172.21.15.78:0/1570588212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1088154920 0x7f10880c7330 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f10780097c0 tx=0x7f107801c2f0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 -- 172.21.15.78:0/1570588212 shutdown_connections 2023-10-14T09:19:13.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 --2- 172.21.15.78:0/1570588212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1088154920 0x7f10880c7330 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 -- 172.21.15.78:0/1570588212 >> 172.21.15.78:0/1570588212 conn(0x7f10880c9430 msgr2=0x7f10880c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:13.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 -- 172.21.15.78:0/1570588212 shutdown_connections 2023-10-14T09:19:13.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 -- 172.21.15.78:0/1570588212 wait complete. 2023-10-14T09:19:13.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 Processor -- start 2023-10-14T09:19:13.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 -- start start 2023-10-14T09:19:13.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10880c4810 0x7f10880c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10881514b0 0x7f1088154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1088154920 0x7f10880bed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10880bfe90 con 0x7f10881514b0 2023-10-14T09:19:13.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10880c2c10 con 0x7f1088154920 2023-10-14T09:19:13.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108dda3640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10880c2000 con 0x7f10880c4810 2023-10-14T09:19:13.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f107ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10881514b0 0x7f1088154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f107ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10881514b0 0x7f1088154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47006/0 (socket says 172.21.15.78:47006) 2023-10-14T09:19:13.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f107ffff640 1 -- 172.21.15.78:0/2546817997 learned_addr learned my addr 172.21.15.78:0/2546817997 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:13.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108d5a2640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1088154920 0x7f10880bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108cda1640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10880c4810 0x7f10880c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f107ffff640 1 -- 172.21.15.78:0/2546817997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10880c4810 msgr2=0x7f10880c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f107ffff640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10880c4810 0x7f10880c3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f107ffff640 1 -- 172.21.15.78:0/2546817997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1088154920 msgr2=0x7f10880bed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f107ffff640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1088154920 0x7f10880bed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f107ffff640 1 -- 172.21.15.78:0/2546817997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1078009420 con 0x7f10881514b0 2023-10-14T09:19:13.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f108cda1640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10880c4810 0x7f10880c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:13.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.334+0000 7f107ffff640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10881514b0 0x7f1088154ee0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1078009710 tx=0x7f1078019090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.338+0000 7f107d7fa640 1 -- 172.21.15.78:0/2546817997 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780ac640 con 0x7f10881514b0 2023-10-14T09:19:13.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.338+0000 7f107d7fa640 1 -- 172.21.15.78:0/2546817997 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10780b6880 con 0x7f10881514b0 2023-10-14T09:19:13.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.338+0000 7f107d7fa640 1 -- 172.21.15.78:0/2546817997 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780b6c30 con 0x7f10881514b0 2023-10-14T09:19:13.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.338+0000 7f108dda3640 1 -- 172.21.15.78:0/2546817997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10880c22e0 con 0x7f10881514b0 2023-10-14T09:19:13.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.338+0000 7f108dda3640 1 -- 172.21.15.78:0/2546817997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10880c28a0 con 0x7f10881514b0 2023-10-14T09:19:13.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.338+0000 7f108dda3640 1 -- 172.21.15.78:0/2546817997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10880c2da0 con 0x7f10881514b0 2023-10-14T09:19:13.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.338+0000 7f107d7fa640 1 -- 172.21.15.78:0/2546817997 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f10780b3040 con 0x7f10881514b0 2023-10-14T09:19:13.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.338+0000 7f107d7fa640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f10740664a0 0x7f1074068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.338+0000 7f107d7fa640 1 -- 172.21.15.78:0/2546817997 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f107811e400 con 0x7f10881514b0 2023-10-14T09:19:13.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.338+0000 7f108cda1640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f10740664a0 0x7f1074068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.338+0000 7f108cda1640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f10740664a0 0x7f1074068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f10840098b0 tx=0x7f1084008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.342+0000 7f107d7fa640 1 -- 172.21.15.78:0/2546817997 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f10780ebc00 con 0x7f10881514b0 2023-10-14T09:19:13.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 -- 172.21.15.78:0/2546817997 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1088162430 con 0x7f10740664a0 2023-10-14T09:19:13.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f107d7fa640 1 -- 172.21.15.78:0/2546817997 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f10840094a0 con 0x7f10740664a0 2023-10-14T09:19:13.500 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T09:19:13.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 -- 172.21.15.78:0/2546817997 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f10740664a0 msgr2=0x7f1074068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f10740664a0 0x7f1074068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f10840098b0 tx=0x7f1084008040 comp rx=0 tx=0).stop 2023-10-14T09:19:13.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 -- 172.21.15.78:0/2546817997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10881514b0 msgr2=0x7f1088154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10881514b0 0x7f1088154ee0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1078009710 tx=0x7f1078019090 comp rx=0 tx=0).stop 2023-10-14T09:19:13.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 -- 172.21.15.78:0/2546817997 shutdown_connections 2023-10-14T09:19:13.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1088154920 0x7f10880bed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10881514b0 0x7f1088154ee0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f10740664a0 0x7f1074068960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 --2- 172.21.15.78:0/2546817997 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f10880c4810 0x7f10880c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 -- 172.21.15.78:0/2546817997 >> 172.21.15.78:0/2546817997 conn(0x7f10880c9430 msgr2=0x7f10880a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:13.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 -- 172.21.15.78:0/2546817997 shutdown_connections 2023-10-14T09:19:13.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.494+0000 7f108dda3640 1 -- 172.21.15.78:0/2546817997 wait complete. 2023-10-14T09:19:13.520 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T09:19:13.521 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:19:13.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.654+0000 7ff8519b8640 1 Processor -- start 2023-10-14T09:19:13.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.654+0000 7ff8519b8640 1 -- start start 2023-10-14T09:19:13.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff8519b8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff84c14ddb0 0x7ff84c0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff8519b8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff84c153e80 0x7ff84c06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff8519b8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84c06c470 con 0x7ff84c0c6910 2023-10-14T09:19:13.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff8519b8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84c0c64f0 con 0x7ff84c14ddb0 2023-10-14T09:19:13.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff8519b8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0c5300 con 0x7ff84c153e80 2023-10-14T09:19:13.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff84affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff84c14ddb0 0x7ff84c0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff84affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff84c14ddb0 0x7ff84c0c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47010/0 (socket says 172.21.15.78:47010) 2023-10-14T09:19:13.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff84affd640 1 -- 172.21.15.78:0/1847505476 learned_addr learned my addr 172.21.15.78:0/1847505476 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:13.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff843fff640 1 --2- 172.21.15.78:0/1847505476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff84c153e80 0x7ff84c06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff84affd640 1 -- 172.21.15.78:0/1847505476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff84c153e80 msgr2=0x7ff84c06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:13.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff84affd640 1 --2- 172.21.15.78:0/1847505476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff84c153e80 0x7ff84c06bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff84affd640 1 -- 172.21.15.78:0/1847505476 >> v1:172.21.15.157:6789/0 conn(0x7ff84c0c6910 legacy=0x7ff84c0c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.658+0000 7ff84affd640 1 -- 172.21.15.78:0/1847505476 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c06c750 con 0x7ff84c14ddb0 2023-10-14T09:19:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff84affd640 1 --2- 172.21.15.78:0/1847505476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c14ddb0 0x7ff84c0c7780 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009870 tx=0x7ff83c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c23ba144a8d5a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff84a7fc640 1 -- 172.21.15.78:0/1847505476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0ab5f0 con 0x7ff84c14ddb0 2023-10-14T09:19:13.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff84a7fc640 1 -- 172.21.15.78:0/1847505476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c0ab750 con 0x7ff84c14ddb0 2023-10-14T09:19:13.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff84a7fc640 1 -- 172.21.15.78:0/1847505476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0abae0 con 0x7ff84c14ddb0 2023-10-14T09:19:13.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff8519b8640 1 -- 172.21.15.78:0/1847505476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c14ddb0 msgr2=0x7ff84c0c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff8519b8640 1 --2- 172.21.15.78:0/1847505476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c14ddb0 0x7ff84c0c7780 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009870 tx=0x7ff83c01c3f0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff8519b8640 1 -- 172.21.15.78:0/1847505476 shutdown_connections 2023-10-14T09:19:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff8519b8640 1 --2- 172.21.15.78:0/1847505476 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff84c153e80 0x7ff84c06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff8519b8640 1 --2- 172.21.15.78:0/1847505476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c14ddb0 0x7ff84c0c7780 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff8519b8640 1 -- 172.21.15.78:0/1847505476 >> 172.21.15.78:0/1847505476 conn(0x7ff84c0ab1f0 msgr2=0x7ff84c0ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff8519b8640 1 -- 172.21.15.78:0/1847505476 shutdown_connections 2023-10-14T09:19:13.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff8519b8640 1 -- 172.21.15.78:0/1847505476 wait complete. 2023-10-14T09:19:13.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff8519b8640 1 Processor -- start 2023-10-14T09:19:13.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.662+0000 7ff8519b8640 1 -- start start 2023-10-14T09:19:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff8519b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c6910 0x7ff84c0bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff8519b8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff84c14ddb0 0x7ff84c0bd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff8519b8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff84c153e80 0x7ff84c0bda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff8519b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c1ece70 con 0x7ff84c0c6910 2023-10-14T09:19:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff8519b8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c1ec8f0 con 0x7ff84c14ddb0 2023-10-14T09:19:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff8519b8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c1ecb90 con 0x7ff84c153e80 2023-10-14T09:19:13.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff84affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c6910 0x7ff84c0bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff84affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c6910 0x7ff84c0bfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47016/0 (socket says 172.21.15.78:47016) 2023-10-14T09:19:13.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff84affd640 1 -- 172.21.15.78:0/4115515605 learned_addr learned my addr 172.21.15.78:0/4115515605 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:13.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff843fff640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff84c14ddb0 0x7ff84c0bd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff84b7fe640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff84c153e80 0x7ff84c0bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff84affd640 1 -- 172.21.15.78:0/4115515605 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff84c153e80 msgr2=0x7ff84c0bda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff84affd640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff84c153e80 0x7ff84c0bda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff84affd640 1 -- 172.21.15.78:0/4115515605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff84c14ddb0 msgr2=0x7ff84c0bd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff84affd640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff84c14ddb0 0x7ff84c0bd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff84affd640 1 -- 172.21.15.78:0/4115515605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0094d0 con 0x7ff84c0c6910 2023-10-14T09:19:13.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff84affd640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c6910 0x7ff84c0bfd70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0ad040 tx=0x7ff83c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff848ff9640 1 -- 172.21.15.78:0/4115515605 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0b4800 con 0x7ff84c0c6910 2023-10-14T09:19:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff848ff9640 1 -- 172.21.15.78:0/4115515605 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c0b4980 con 0x7ff84c0c6910 2023-10-14T09:19:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff8519b8640 1 -- 172.21.15.78:0/4115515605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84c0c2ee0 con 0x7ff84c0c6910 2023-10-14T09:19:13.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff848ff9640 1 -- 172.21.15.78:0/4115515605 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0b4d30 con 0x7ff84c0c6910 2023-10-14T09:19:13.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff8519b8640 1 -- 172.21.15.78:0/4115515605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84c0c02b0 con 0x7ff84c0c6910 2023-10-14T09:19:13.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff8519b8640 1 -- 172.21.15.78:0/4115515605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff84c14e190 con 0x7ff84c0c6910 2023-10-14T09:19:13.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.666+0000 7ff848ff9640 1 -- 172.21.15.78:0/4115515605 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff83c0c7440 con 0x7ff84c0c6910 2023-10-14T09:19:13.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.670+0000 7ff848ff9640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff82c0664d0 0x7ff82c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.670+0000 7ff848ff9640 1 -- 172.21.15.78:0/4115515605 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff83c0a8050 con 0x7ff84c0c6910 2023-10-14T09:19:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.670+0000 7ff848ff9640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] conn(0x7ff82c06c330 0x7ff82c06e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.670+0000 7ff843fff640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff82c0664d0 0x7ff82c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.670+0000 7ff848ff9640 1 -- 172.21.15.78:0/4115515605 --> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff82c06ee00 con 0x7ff82c06c330 2023-10-14T09:19:13.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.670+0000 7ff848ff9640 1 -- 172.21.15.78:0/4115515605 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff83c120860 con 0x7ff84c0c6910 2023-10-14T09:19:13.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.670+0000 7ff84b7fe640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] conn(0x7ff82c06c330 0x7ff82c06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.670+0000 7ff843fff640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff82c0664d0 0x7ff82c068990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff84c06bfd0 tx=0x7ff834008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.670+0000 7ff84b7fe640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] conn(0x7ff82c06c330 0x7ff82c06e750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.670+0000 7ff848ff9640 1 -- 172.21.15.78:0/4115515605 <== osd.2 v2:172.21.15.78:6808/1585824417 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff82c06ee00 con 0x7ff82c06c330 2023-10-14T09:19:13.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff8519b8640 1 -- 172.21.15.78:0/4115515605 --> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff84c074110 con 0x7ff82c06c330 2023-10-14T09:19:13.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff848ff9640 1 -- 172.21.15.78:0/4115515605 <== osd.2 v2:172.21.15.78:6808/1585824417 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff84c074110 con 0x7ff82c06c330 2023-10-14T09:19:13.689 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:19:13.690 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:19:13.690 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:19:13.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff8519b8640 1 -- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] conn(0x7ff82c06c330 msgr2=0x7ff82c06e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff8519b8640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:6808/1585824417,v1:172.21.15.78:6809/1585824417] conn(0x7ff82c06c330 0x7ff82c06e750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff8519b8640 1 -- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff82c0664d0 msgr2=0x7ff82c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff8519b8640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff82c0664d0 0x7ff82c068990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff84c06bfd0 tx=0x7ff834008040 comp rx=0 tx=0).stop 2023-10-14T09:19:13.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff8519b8640 1 -- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c6910 msgr2=0x7ff84c0bfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff8519b8640 1 --2- 172.21.15.78:0/4115515605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff84c0c6910 0x7ff84c0bfd70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0ad040 tx=0x7ff83c01ac30 comp rx=0 tx=0).stop 2023-10-14T09:19:13.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff84b7fe640 1 -- 172.21.15.78:0/4115515605 reap_dead start 2023-10-14T09:19:13.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff8519b8640 1 -- 172.21.15.78:0/4115515605 shutdown_connections 2023-10-14T09:19:13.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff8519b8640 1 -- 172.21.15.78:0/4115515605 >> 172.21.15.78:0/4115515605 conn(0x7ff84c0ab1f0 msgr2=0x7ff84c0c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:13.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff8519b8640 1 -- 172.21.15.78:0/4115515605 shutdown_connections 2023-10-14T09:19:13.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.682+0000 7ff8519b8640 1 -- 172.21.15.78:0/4115515605 wait complete. 2023-10-14T09:19:13.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T09:19:13.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.837+0000 7ff92a817640 1 Processor -- start 2023-10-14T09:19:13.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.837+0000 7ff92a817640 1 -- start start 2023-10-14T09:19:13.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff92a817640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff92414e0f0 0x7ff924152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff92a817640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff924150a90 0x7ff924150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff92a817640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9241531d0 con 0x7ff92414ed10 2023-10-14T09:19:13.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff92a817640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff924153e50 con 0x7ff924150a90 2023-10-14T09:19:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff92a817640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9241534b0 con 0x7ff92414e0f0 2023-10-14T09:19:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff928db4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff924150a90 0x7ff924150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff928db4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff924150a90 0x7ff924150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47020/0 (socket says 172.21.15.78:47020) 2023-10-14T09:19:13.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff928db4640 1 -- 172.21.15.78:0/811434836 learned_addr learned my addr 172.21.15.78:0/811434836 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff923fff640 1 --2- 172.21.15.78:0/811434836 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff92414e0f0 0x7ff924152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff928db4640 1 -- 172.21.15.78:0/811434836 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff92414e0f0 msgr2=0x7ff924152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:13.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff928db4640 1 --2- 172.21.15.78:0/811434836 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff92414e0f0 0x7ff924152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff928db4640 1 -- 172.21.15.78:0/811434836 >> v1:172.21.15.157:6789/0 conn(0x7ff92414ed10 legacy=0x7ff92414f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff928db4640 1 -- 172.21.15.78:0/811434836 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924153790 con 0x7ff924150a90 2023-10-14T09:19:13.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.841+0000 7ff928db4640 1 --2- 172.21.15.78:0/811434836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff924150a90 0x7ff924150ec0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009e50 tx=0x7ff91c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61f8542c6519cf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff922ffd640 1 -- 172.21.15.78:0/811434836 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0a5750 con 0x7ff924150a90 2023-10-14T09:19:13.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff922ffd640 1 -- 172.21.15.78:0/811434836 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c0a58b0 con 0x7ff924150a90 2023-10-14T09:19:13.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff922ffd640 1 -- 172.21.15.78:0/811434836 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0a5c40 con 0x7ff924150a90 2023-10-14T09:19:13.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 -- 172.21.15.78:0/811434836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff924150a90 msgr2=0x7ff924150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 --2- 172.21.15.78:0/811434836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff924150a90 0x7ff924150ec0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009e50 tx=0x7ff91c01c980 comp rx=0 tx=0).stop 2023-10-14T09:19:13.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 -- 172.21.15.78:0/811434836 shutdown_connections 2023-10-14T09:19:13.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 --2- 172.21.15.78:0/811434836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff924150a90 0x7ff924150ec0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 --2- 172.21.15.78:0/811434836 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff92414e0f0 0x7ff924152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 -- 172.21.15.78:0/811434836 >> 172.21.15.78:0/811434836 conn(0x7ff9240c1cc0 msgr2=0x7ff9240c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:13.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 -- 172.21.15.78:0/811434836 shutdown_connections 2023-10-14T09:19:13.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 -- 172.21.15.78:0/811434836 wait complete. 2023-10-14T09:19:13.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 Processor -- start 2023-10-14T09:19:13.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 -- start start 2023-10-14T09:19:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff92414e0f0 0x7ff9240c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff92414ed10 0x7ff924149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff924150a90 0x7ff92406c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92406bbd0 con 0x7ff92414ed10 2023-10-14T09:19:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92406d7a0 con 0x7ff924150a90 2023-10-14T09:19:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff92a817640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92406da60 con 0x7ff92414e0f0 2023-10-14T09:19:13.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.845+0000 7ff9237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff92414ed10 0x7ff924149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff923fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff92414e0f0 0x7ff9240c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff9237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff92414ed10 0x7ff924149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47036/0 (socket says 172.21.15.78:47036) 2023-10-14T09:19:13.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff923fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff92414e0f0 0x7ff9240c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:39744/0 (socket says 172.21.15.78:39744) 2023-10-14T09:19:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff9237fe640 1 -- 172.21.15.78:0/300649276 learned_addr learned my addr 172.21.15.78:0/300649276 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff928db4640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff924150a90 0x7ff92406c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff9237fe640 1 -- 172.21.15.78:0/300649276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff92414e0f0 msgr2=0x7ff9240c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff9237fe640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff92414e0f0 0x7ff9240c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff9237fe640 1 -- 172.21.15.78:0/300649276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff924150a90 msgr2=0x7ff92406c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff9237fe640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff924150a90 0x7ff92406c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:13.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff9237fe640 1 -- 172.21.15.78:0/300649276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c009b30 con 0x7ff92414ed10 2023-10-14T09:19:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff9237fe640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff92414ed10 0x7ff924149ef0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c3c0 tx=0x7ff91800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff920ff9640 1 -- 172.21.15.78:0/300649276 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9180052d0 con 0x7ff92414ed10 2023-10-14T09:19:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff920ff9640 1 -- 172.21.15.78:0/300649276 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918005430 con 0x7ff92414ed10 2023-10-14T09:19:13.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff92a817640 1 -- 172.21.15.78:0/300649276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92406be20 con 0x7ff92414ed10 2023-10-14T09:19:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff920ff9640 1 -- 172.21.15.78:0/300649276 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918003840 con 0x7ff92414ed10 2023-10-14T09:19:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff92a817640 1 -- 172.21.15.78:0/300649276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92414a430 con 0x7ff92414ed10 2023-10-14T09:19:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff92a817640 1 -- 172.21.15.78:0/300649276 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff924074180 con 0x7ff92414ed10 2023-10-14T09:19:13.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff920ff9640 1 -- 172.21.15.78:0/300649276 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff9180039a0 con 0x7ff92414ed10 2023-10-14T09:19:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.849+0000 7ff920ff9640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff9100664a0 0x7ff910068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.853+0000 7ff920ff9640 1 -- 172.21.15.78:0/300649276 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff918082ff0 con 0x7ff92414ed10 2023-10-14T09:19:13.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.853+0000 7ff923fff640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff9100664a0 0x7ff910068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.853+0000 7ff923fff640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff9100664a0 0x7ff910068960 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff914009ac0 tx=0x7ff914009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:13.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:13.853+0000 7ff920ff9640 1 -- 172.21.15.78:0/300649276 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff9180b4090 con 0x7ff92414ed10 2023-10-14T09:19:14.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 -- 172.21.15.78:0/300649276 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff924152ea0 con 0x7ff9100664a0 2023-10-14T09:19:14.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff920ff9640 1 -- 172.21.15.78:0/300649276 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff9140119e0 con 0x7ff9100664a0 2023-10-14T09:19:14.012 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T09:19:14.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 -- 172.21.15.78:0/300649276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff9100664a0 msgr2=0x7ff910068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff9100664a0 0x7ff910068960 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff914009ac0 tx=0x7ff914009190 comp rx=0 tx=0).stop 2023-10-14T09:19:14.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 -- 172.21.15.78:0/300649276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff92414ed10 msgr2=0x7ff924149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff92414ed10 0x7ff924149ef0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff91800c3c0 tx=0x7ff91800c880 comp rx=0 tx=0).stop 2023-10-14T09:19:14.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 -- 172.21.15.78:0/300649276 shutdown_connections 2023-10-14T09:19:14.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff924150a90 0x7ff92406c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff92414ed10 0x7ff924149ef0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff9100664a0 0x7ff910068960 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 --2- 172.21.15.78:0/300649276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff92414e0f0 0x7ff9240c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 -- 172.21.15.78:0/300649276 >> 172.21.15.78:0/300649276 conn(0x7ff9240c1cc0 msgr2=0x7ff92414f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:14.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 -- 172.21.15.78:0/300649276 shutdown_connections 2023-10-14T09:19:14.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.005+0000 7ff92a817640 1 -- 172.21.15.78:0/300649276 wait complete. 2023-10-14T09:19:14.032 INFO:tasks.ceph:Scrubbing osd.3 2023-10-14T09:19:14.032 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:19:14.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.165+0000 7ff5e4a3c640 1 Processor -- start 2023-10-14T09:19:14.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5e4a3c640 1 -- start start 2023-10-14T09:19:14.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5e4a3c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5e00bcb90 0x7ff5e0153b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5e4a3c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5e006ca50 0x7ff5e01540d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5e4a3c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e00c4270 con 0x7ff5e00aec80 2023-10-14T09:19:14.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5e4a3c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e00c7750 con 0x7ff5e006ca50 2023-10-14T09:19:14.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5e4a3c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00c4ac0 con 0x7ff5e00bcb90 2023-10-14T09:19:14.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5dffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5e006ca50 0x7ff5e01540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5dffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5e006ca50 0x7ff5e01540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47054/0 (socket says 172.21.15.78:47054) 2023-10-14T09:19:14.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5dffff640 1 -- 172.21.15.78:0/3867884837 learned_addr learned my addr 172.21.15.78:0/3867884837 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:14.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5dffff640 1 -- 172.21.15.78:0/3867884837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5e00bcb90 msgr2=0x7ff5e0153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5dffff640 1 --2- 172.21.15.78:0/3867884837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5e00bcb90 0x7ff5e0153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5dffff640 1 -- 172.21.15.78:0/3867884837 >> v1:172.21.15.157:6789/0 conn(0x7ff5e00aec80 legacy=0x7ff5e00c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.169+0000 7ff5dffff640 1 -- 172.21.15.78:0/3867884837 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00c4700 con 0x7ff5e006ca50 2023-10-14T09:19:14.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5dffff640 1 --2- 172.21.15.78:0/3867884837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e006ca50 0x7ff5e01540d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009e50 tx=0x7ff5d801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8606d875bec1077c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5de7fc640 1 -- 172.21.15.78:0/3867884837 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80a55c0 con 0x7ff5e006ca50 2023-10-14T09:19:14.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5de7fc640 1 -- 172.21.15.78:0/3867884837 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d80a5720 con 0x7ff5e006ca50 2023-10-14T09:19:14.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5de7fc640 1 -- 172.21.15.78:0/3867884837 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80a5ab0 con 0x7ff5e006ca50 2023-10-14T09:19:14.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/3867884837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e006ca50 msgr2=0x7ff5e01540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5e4a3c640 1 --2- 172.21.15.78:0/3867884837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e006ca50 0x7ff5e01540d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009e50 tx=0x7ff5d801c940 comp rx=0 tx=0).stop 2023-10-14T09:19:14.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/3867884837 shutdown_connections 2023-10-14T09:19:14.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5e4a3c640 1 --2- 172.21.15.78:0/3867884837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e006ca50 0x7ff5e01540d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5e4a3c640 1 --2- 172.21.15.78:0/3867884837 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5e00bcb90 0x7ff5e0153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/3867884837 >> 172.21.15.78:0/3867884837 conn(0x7ff5e0071790 msgr2=0x7ff5e0071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:14.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/3867884837 shutdown_connections 2023-10-14T09:19:14.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/3867884837 wait complete. 2023-10-14T09:19:14.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5e4a3c640 1 Processor -- start 2023-10-14T09:19:14.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.173+0000 7ff5e4a3c640 1 -- start start 2023-10-14T09:19:14.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5e4a3c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5e006ca50 0x7ff5e0150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5e4a3c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5e00aec80 0x7ff5e00ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5e4a3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00bcb90 0x7ff5e01ebcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5e4a3c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0150bc0 con 0x7ff5e00bcb90 2023-10-14T09:19:14.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5e4a3c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e014abe0 con 0x7ff5e006ca50 2023-10-14T09:19:14.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5e4a3c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e01effa0 con 0x7ff5e00aec80 2023-10-14T09:19:14.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00bcb90 0x7ff5e01ebcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00bcb90 0x7ff5e01ebcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47058/0 (socket says 172.21.15.78:47058) 2023-10-14T09:19:14.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5dffff640 1 -- 172.21.15.78:0/2545694392 learned_addr learned my addr 172.21.15.78:0/2545694392 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:14.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5dffff640 1 -- 172.21.15.78:0/2545694392 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5e00aec80 msgr2=0x7ff5e00ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5dffff640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff5e00aec80 0x7ff5e00ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5dffff640 1 -- 172.21.15.78:0/2545694392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5e006ca50 msgr2=0x7ff5e0150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5df7fe640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5e006ca50 0x7ff5e0150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5dffff640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5e006ca50 0x7ff5e0150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5dffff640 1 -- 172.21.15.78:0/2545694392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8009b30 con 0x7ff5e00bcb90 2023-10-14T09:19:14.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5df7fe640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5e006ca50 0x7ff5e0150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:19:14.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5dffff640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00bcb90 0x7ff5e01ebcb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009e50 tx=0x7ff5d80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5c7fff640 1 -- 172.21.15.78:0/2545694392 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80b8670 con 0x7ff5e00bcb90 2023-10-14T09:19:14.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5c7fff640 1 -- 172.21.15.78:0/2545694392 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d80b87d0 con 0x7ff5e00bcb90 2023-10-14T09:19:14.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/2545694392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e014ae30 con 0x7ff5e00bcb90 2023-10-14T09:19:14.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5c7fff640 1 -- 172.21.15.78:0/2545694392 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80b8b40 con 0x7ff5e00bcb90 2023-10-14T09:19:14.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/2545694392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e014b3f0 con 0x7ff5e00bcb90 2023-10-14T09:19:14.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/2545694392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5e00c73e0 con 0x7ff5e00bcb90 2023-10-14T09:19:14.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.177+0000 7ff5c7fff640 1 -- 172.21.15.78:0/2545694392 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff5d80b8ca0 con 0x7ff5e00bcb90 2023-10-14T09:19:14.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.181+0000 7ff5c7fff640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff5cc0664a0 0x7ff5cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.181+0000 7ff5c7fff640 1 -- 172.21.15.78:0/2545694392 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff5d811f160 con 0x7ff5e00bcb90 2023-10-14T09:19:14.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.181+0000 7ff5c7fff640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] conn(0x7ff5cc06c300 0x7ff5cc06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.181+0000 7ff5c7fff640 1 -- 172.21.15.78:0/2545694392 --> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5cc06edd0 con 0x7ff5cc06c300 2023-10-14T09:19:14.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.181+0000 7ff5c7fff640 1 -- 172.21.15.78:0/2545694392 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5d8121740 con 0x7ff5e00bcb90 2023-10-14T09:19:14.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.181+0000 7ff5df7fe640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff5cc0664a0 0x7ff5cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.181+0000 7ff5deffd640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] conn(0x7ff5cc06c300 0x7ff5cc06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.181+0000 7ff5df7fe640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff5cc0664a0 0x7ff5cc068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff5e01510e0 tx=0x7ff5d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.181+0000 7ff5deffd640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] conn(0x7ff5cc06c300 0x7ff5cc06e720 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.181+0000 7ff5c7fff640 1 -- 172.21.15.78:0/2545694392 <== osd.3 v2:172.21.15.78:6816/3754005469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff5cc06edd0 con 0x7ff5cc06c300 2023-10-14T09:19:14.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/2545694392 --> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff5e0158010 con 0x7ff5cc06c300 2023-10-14T09:19:14.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5c7fff640 1 -- 172.21.15.78:0/2545694392 <== osd.3 v2:172.21.15.78:6816/3754005469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff5d40097c0 con 0x7ff5cc06c300 2023-10-14T09:19:14.202 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:19:14.202 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:19:14.202 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:19:14.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] conn(0x7ff5cc06c300 msgr2=0x7ff5cc06e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5e4a3c640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:6816/3754005469,v1:172.21.15.78:6818/3754005469] conn(0x7ff5cc06c300 0x7ff5cc06e720 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff5cc0664a0 msgr2=0x7ff5cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5e4a3c640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7ff5cc0664a0 0x7ff5cc068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff5e01510e0 tx=0x7ff5d0009040 comp rx=0 tx=0).stop 2023-10-14T09:19:14.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00bcb90 msgr2=0x7ff5e01ebcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5e4a3c640 1 --2- 172.21.15.78:0/2545694392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5e00bcb90 0x7ff5e01ebcb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009e50 tx=0x7ff5d80196e0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5dffff640 1 -- 172.21.15.78:0/2545694392 reap_dead start 2023-10-14T09:19:14.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/2545694392 shutdown_connections 2023-10-14T09:19:14.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/2545694392 >> 172.21.15.78:0/2545694392 conn(0x7ff5e0071790 msgr2=0x7ff5e00c8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:14.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/2545694392 shutdown_connections 2023-10-14T09:19:14.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.193+0000 7ff5e4a3c640 1 -- 172.21.15.78:0/2545694392 wait complete. 2023-10-14T09:19:14.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-14T09:19:14.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f2288853640 1 Processor -- start 2023-10-14T09:19:14.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f2288853640 1 -- start start 2023-10-14T09:19:14.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f2288853640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f228414a860 0x7f22841546e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f2288853640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2284157860 0x7f2284157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f2288853640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f228414ac40 con 0x7f22840bcc20 2023-10-14T09:19:14.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f2288853640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2284158250 con 0x7f228414a860 2023-10-14T09:19:14.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f2288853640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22840c3ef0 con 0x7f2284157860 2023-10-14T09:19:14.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f227bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f22840bcc20 0x7f22840ab0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48268/0 (socket says 172.21.15.78:48268) 2023-10-14T09:19:14.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f227bfff640 1 -- 172.21.15.78:0/381062184 learned_addr learned my addr 172.21.15.78:0/381062184 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:14.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f2282d9d640 1 --2- 172.21.15.78:0/381062184 >> v2:172.21.15.157:3300/0 conn(0x7f228414a860 0x7f22841546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228359e640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2284157860 0x7f2284157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173542318 0 0) 0x7f228414ac40 con 0x7f22840bcc20 2023-10-14T09:19:14.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2270003530 con 0x7f22840bcc20 2023-10-14T09:19:14.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3983973178 0 0) 0x7f2270003530 con 0x7f22840bcc20 2023-10-14T09:19:14.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2284157860 msgr2=0x7f2284157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2284157860 0x7f2284157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 >> v2:172.21.15.157:3300/0 conn(0x7f228414a860 msgr2=0x7f22841546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 --2- 172.21.15.78:0/381062184 >> v2:172.21.15.157:3300/0 conn(0x7f228414a860 0x7f22841546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22841573d0 con 0x7f22840bcc20 2023-10-14T09:19:14.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f226c001680 con 0x7f22840bcc20 2023-10-14T09:19:14.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 >> v1:172.21.15.78:6789/0 conn(0x7f22840bcc20 legacy=0x7f22840ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2270003a60 0x7f2270003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2284157860 0x7f22700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2270004d10 0x7f2270005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284158250 con 0x7f2270003a60 2023-10-14T09:19:14.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22840c3ef0 con 0x7f2270004d10 2023-10-14T09:19:14.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227000ba60 con 0x7f2284157860 2023-10-14T09:19:14.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f2282d9d640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2270003a60 0x7f2270003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f227bfff640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2284157860 0x7f22700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.353+0000 7f228359e640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2270004d10 0x7f2270005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2282d9d640 1 -- 172.21.15.78:0/381062184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2284157860 msgr2=0x7f22700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2282d9d640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2284157860 0x7f22700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2282d9d640 1 -- 172.21.15.78:0/381062184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2270004d10 msgr2=0x7f2270005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2282d9d640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2270004d10 0x7f2270005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2282d9d640 1 -- 172.21.15.78:0/381062184 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2270003530 con 0x7f2270003a60 2023-10-14T09:19:14.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2282d9d640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2270003a60 0x7f2270003e80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2274009ae0 tx=0x7f227401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777b3ed99acb3a2c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740a6490 con 0x7f2270003a60 2023-10-14T09:19:14.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22740a65f0 con 0x7f2270003a60 2023-10-14T09:19:14.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f228259c640 1 -- 172.21.15.78:0/381062184 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740a69a0 con 0x7f2270003a60 2023-10-14T09:19:14.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2288853640 1 -- 172.21.15.78:0/381062184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2270003a60 msgr2=0x7f2270003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2288853640 1 --2- 172.21.15.78:0/381062184 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2270003a60 0x7f2270003e80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2274009ae0 tx=0x7f227401c9a0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f228359e640 1 -- 172.21.15.78:0/381062184 reap_dead start 2023-10-14T09:19:14.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2288853640 1 -- 172.21.15.78:0/381062184 shutdown_connections 2023-10-14T09:19:14.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2288853640 1 -- 172.21.15.78:0/381062184 >> 172.21.15.78:0/381062184 conn(0x7f22840c9570 msgr2=0x7f22840c9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:14.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2288853640 1 -- 172.21.15.78:0/381062184 shutdown_connections 2023-10-14T09:19:14.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.357+0000 7f2288853640 1 -- 172.21.15.78:0/381062184 wait complete. 2023-10-14T09:19:14.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f2288853640 1 Processor -- start 2023-10-14T09:19:14.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f2288853640 1 -- start start 2023-10-14T09:19:14.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f2288853640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270003a60 0x7f22841ec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f2288853640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f228414b650 0x7f2284152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f2288853640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f228414d510 0x7f2284159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f2288853640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228414ca30 con 0x7f228414d510 2023-10-14T09:19:14.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f2288853640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228415a920 con 0x7f228414b650 2023-10-14T09:19:14.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f2288853640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228415b410 con 0x7f2270003a60 2023-10-14T09:19:14.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f228359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f228414d510 0x7f2284159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f228359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f228414d510 0x7f2284159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47078/0 (socket says 172.21.15.78:47078) 2023-10-14T09:19:14.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f228359e640 1 -- 172.21.15.78:0/1587395280 learned_addr learned my addr 172.21.15.78:0/1587395280 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:14.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f227bfff640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f228414b650 0x7f2284152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f2282d9d640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270003a60 0x7f22841ec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f228359e640 1 -- 172.21.15.78:0/1587395280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270003a60 msgr2=0x7f22841ec3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f228359e640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270003a60 0x7f22841ec3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f228359e640 1 -- 172.21.15.78:0/1587395280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f228414b650 msgr2=0x7f2284152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f228359e640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f228414b650 0x7f2284152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f228359e640 1 -- 172.21.15.78:0/1587395280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2284154060 con 0x7f228414d510 2023-10-14T09:19:14.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f2282d9d640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270003a60 0x7f22841ec3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:14.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f228359e640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f228414d510 0x7f2284159940 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f22840a9080 tx=0x7f227c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f227b7fe640 1 -- 172.21.15.78:0/1587395280 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c00e040 con 0x7f228414d510 2023-10-14T09:19:14.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f227b7fe640 1 -- 172.21.15.78:0/1587395280 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c00f040 con 0x7f228414d510 2023-10-14T09:19:14.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f227b7fe640 1 -- 172.21.15.78:0/1587395280 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c015430 con 0x7f228414d510 2023-10-14T09:19:14.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.361+0000 7f2288853640 1 -- 172.21.15.78:0/1587395280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228415ab70 con 0x7f228414d510 2023-10-14T09:19:14.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.365+0000 7f2288853640 1 -- 172.21.15.78:0/1587395280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228415b130 con 0x7f228414d510 2023-10-14T09:19:14.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.365+0000 7f2288853640 1 -- 172.21.15.78:0/1587395280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228404e9c0 con 0x7f228414d510 2023-10-14T09:19:14.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.365+0000 7f227b7fe640 1 -- 172.21.15.78:0/1587395280 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f227c015590 con 0x7f228414d510 2023-10-14T09:19:14.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.365+0000 7f227b7fe640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22640664d0 0x7f2264068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.365+0000 7f227b7fe640 1 -- 172.21.15.78:0/1587395280 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f227c0841a0 con 0x7f228414d510 2023-10-14T09:19:14.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.365+0000 7f2282d9d640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22640664d0 0x7f2264068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.365+0000 7f2282d9d640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22640664d0 0x7f2264068990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f22740ad000 tx=0x7f22740b2040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.369+0000 7f227b7fe640 1 -- 172.21.15.78:0/1587395280 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f227c051990 con 0x7f228414d510 2023-10-14T09:19:14.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.521+0000 7f2288853640 1 -- 172.21.15.78:0/1587395280 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f22840c75c0 con 0x7f22640664d0 2023-10-14T09:19:14.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.521+0000 7f227b7fe640 1 -- 172.21.15.78:0/1587395280 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f22740a6760 con 0x7f22640664d0 2023-10-14T09:19:14.529 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2023-10-14T09:19:14.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 -- 172.21.15.78:0/1587395280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22640664d0 msgr2=0x7f2264068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22640664d0 0x7f2264068990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f22740ad000 tx=0x7f22740b2040 comp rx=0 tx=0).stop 2023-10-14T09:19:14.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 -- 172.21.15.78:0/1587395280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f228414d510 msgr2=0x7f2284159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f228414d510 0x7f2284159940 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f22840a9080 tx=0x7f227c00f580 comp rx=0 tx=0).stop 2023-10-14T09:19:14.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 -- 172.21.15.78:0/1587395280 shutdown_connections 2023-10-14T09:19:14.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f228414d510 0x7f2284159940 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f228414b650 0x7f2284152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f22640664d0 0x7f2264068990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 --2- 172.21.15.78:0/1587395280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2270003a60 0x7f22841ec3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 -- 172.21.15.78:0/1587395280 >> 172.21.15.78:0/1587395280 conn(0x7f22840c9570 msgr2=0x7f22840a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:14.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 -- 172.21.15.78:0/1587395280 shutdown_connections 2023-10-14T09:19:14.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.525+0000 7f2288853640 1 -- 172.21.15.78:0/1587395280 wait complete. 2023-10-14T09:19:14.550 INFO:tasks.ceph:Scrubbing osd.4 2023-10-14T09:19:14.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:19:14.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04ec2d6640 1 Processor -- start 2023-10-14T09:19:14.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04ec2d6640 1 -- start start 2023-10-14T09:19:14.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04ec2d6640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f04e414ed10 0x7f04e414f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04ec2d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e414f700 0x7f04e4150a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04ec2d6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e41531d0 con 0x7f04e414e0f0 2023-10-14T09:19:14.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04ec2d6640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e4153e50 con 0x7f04e414ed10 2023-10-14T09:19:14.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04ec2d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e41534b0 con 0x7f04e414f700 2023-10-14T09:19:14.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04ea072640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f04e414e0f0 0x7f04e4152960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48274/0 (socket says 172.21.15.78:48274) 2023-10-14T09:19:14.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04ea072640 1 -- 172.21.15.78:0/1489297341 learned_addr learned my addr 172.21.15.78:0/1489297341 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:14.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9871640 1 --2- 172.21.15.78:0/1489297341 >> v2:172.21.15.157:3300/0 conn(0x7f04e414ed10 0x7f04e414f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330511313 0 0) 0x7f04e41531d0 con 0x7f04e414e0f0 2023-10-14T09:19:14.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04ea873640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e414f700 0x7f04e4150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d0003530 con 0x7f04e414e0f0 2023-10-14T09:19:14.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3386049998 0 0) 0x7f04d0003530 con 0x7f04e414e0f0 2023-10-14T09:19:14.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e414f700 msgr2=0x7f04e4150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e414f700 0x7f04e4150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 >> v2:172.21.15.157:3300/0 conn(0x7f04e414ed10 msgr2=0x7f04e414f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 --2- 172.21.15.78:0/1489297341 >> v2:172.21.15.157:3300/0 conn(0x7f04e414ed10 0x7f04e414f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e4153790 con 0x7f04e414e0f0 2023-10-14T09:19:14.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f04e0001680 con 0x7f04e414e0f0 2023-10-14T09:19:14.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 >> v1:172.21.15.78:6789/0 conn(0x7f04e414e0f0 legacy=0x7f04e4152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04d0003980 0x7f04d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04d00047d0 0x7f04d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e414f700 0x7f04d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e4153e50 con 0x7f04d0003980 2023-10-14T09:19:14.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e41534b0 con 0x7f04d00047d0 2023-10-14T09:19:14.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.685+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d000b990 con 0x7f04e414f700 2023-10-14T09:19:14.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04ea072640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04d0003980 0x7f04d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04ea873640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e414f700 0x7f04d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04e9871640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04d00047d0 0x7f04d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04ea072640 1 -- 172.21.15.78:0/1489297341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e414f700 msgr2=0x7f04d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04ea072640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e414f700 0x7f04d0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04ea072640 1 -- 172.21.15.78:0/1489297341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04d00047d0 msgr2=0x7f04d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04ea072640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04d00047d0 0x7f04d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04ea072640 1 -- 172.21.15.78:0/1489297341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d0003530 con 0x7f04d0003980 2023-10-14T09:19:14.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04ea072640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04d0003980 0x7f04d0003da0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f04e000c270 tx=0x7f04e001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ece7bf3316ad0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e00058e0 con 0x7f04d0003980 2023-10-14T09:19:14.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e0005a40 con 0x7f04d0003980 2023-10-14T09:19:14.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04e9070640 1 -- 172.21.15.78:0/1489297341 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0005e10 con 0x7f04d0003980 2023-10-14T09:19:14.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04ec2d6640 1 -- 172.21.15.78:0/1489297341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04d0003980 msgr2=0x7f04d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04ec2d6640 1 --2- 172.21.15.78:0/1489297341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04d0003980 0x7f04d0003da0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f04e000c270 tx=0x7f04e001cc60 comp rx=0 tx=0).stop 2023-10-14T09:19:14.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.689+0000 7f04ea873640 1 -- 172.21.15.78:0/1489297341 reap_dead start 2023-10-14T09:19:14.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 -- 172.21.15.78:0/1489297341 shutdown_connections 2023-10-14T09:19:14.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 -- 172.21.15.78:0/1489297341 >> 172.21.15.78:0/1489297341 conn(0x7f04e40c1cc0 msgr2=0x7f04e40c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:14.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 -- 172.21.15.78:0/1489297341 shutdown_connections 2023-10-14T09:19:14.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 -- 172.21.15.78:0/1489297341 wait complete. 2023-10-14T09:19:14.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 Processor -- start 2023-10-14T09:19:14.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 -- start start 2023-10-14T09:19:14.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04d0003980 0x7f04e406caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e4149a40 0x7f04e40c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04e40c3d80 0x7f04e4151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e406c2e0 con 0x7f04d0003980 2023-10-14T09:19:14.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e406bdf0 con 0x7f04e40c3d80 2023-10-14T09:19:14.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ec2d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e40c4c50 con 0x7f04e4149a40 2023-10-14T09:19:14.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ea873640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04e40c3d80 0x7f04e4151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04e9871640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e4149a40 0x7f04e40c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ea072640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04d0003980 0x7f04e406caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ea873640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04e40c3d80 0x7f04e4151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:36378/0 (socket says 172.21.15.78:36378) 2023-10-14T09:19:14.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04e9871640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e4149a40 0x7f04e40c3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.78:39822/0 (socket says 172.21.15.78:39822) 2023-10-14T09:19:14.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ea873640 1 -- 172.21.15.78:0/4082954868 learned_addr learned my addr 172.21.15.78:0/4082954868 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:14.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ea072640 1 -- 172.21.15.78:0/4082954868 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e4149a40 msgr2=0x7f04e40c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ea072640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04e4149a40 0x7f04e40c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ea072640 1 -- 172.21.15.78:0/4082954868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04e40c3d80 msgr2=0x7f04e4151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ea072640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04e40c3d80 0x7f04e4151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ea072640 1 -- 172.21.15.78:0/4082954868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e40c4920 con 0x7f04d0003980 2023-10-14T09:19:14.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.693+0000 7f04ea873640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04e40c3d80 0x7f04e4151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:19:14.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04ea072640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04d0003980 0x7f04e406caf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009000 tx=0x7f04d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04daffd640 1 -- 172.21.15.78:0/4082954868 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0005e30 con 0x7f04d0003980 2023-10-14T09:19:14.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04daffd640 1 -- 172.21.15.78:0/4082954868 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e00047f0 con 0x7f04d0003980 2023-10-14T09:19:14.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04daffd640 1 -- 172.21.15.78:0/4082954868 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0004b60 con 0x7f04d0003980 2023-10-14T09:19:14.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04ec2d6640 1 -- 172.21.15.78:0/4082954868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e40c3110 con 0x7f04d0003980 2023-10-14T09:19:14.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04ec2d6640 1 -- 172.21.15.78:0/4082954868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e406c000 con 0x7f04d0003980 2023-10-14T09:19:14.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04ec2d6640 1 -- 172.21.15.78:0/4082954868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04e4074110 con 0x7f04d0003980 2023-10-14T09:19:14.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04daffd640 1 -- 172.21.15.78:0/4082954868 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f04e0004cc0 con 0x7f04d0003980 2023-10-14T09:19:14.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04daffd640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f04c80664a0 0x7f04c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04daffd640 1 -- 172.21.15.78:0/4082954868 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f04e011cc30 con 0x7f04d0003980 2023-10-14T09:19:14.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04daffd640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] conn(0x7f04c806c300 0x7f04c806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04e9871640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f04c80664a0 0x7f04c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04daffd640 1 -- 172.21.15.78:0/4082954868 --> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04c806edd0 con 0x7f04c806c300 2023-10-14T09:19:14.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04daffd640 1 -- 172.21.15.78:0/4082954868 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04e01212a0 con 0x7f04d0003980 2023-10-14T09:19:14.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.697+0000 7f04ea873640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] conn(0x7f04c806c300 0x7f04c806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.701+0000 7f04e9871640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f04c80664a0 0x7f04c8068960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f04e41ec050 tx=0x7f04d4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.701+0000 7f04ea873640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] conn(0x7f04c806c300 0x7f04c806e720 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.701+0000 7f04daffd640 1 -- 172.21.15.78:0/4082954868 <== osd.4 v2:172.21.15.157:6816/1674405437 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f04c806edd0 con 0x7f04c806c300 2023-10-14T09:19:14.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ec2d6640 1 -- 172.21.15.78:0/4082954868 --> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f04e40c4d90 con 0x7f04c806c300 2023-10-14T09:19:14.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04daffd640 1 -- 172.21.15.78:0/4082954868 <== osd.4 v2:172.21.15.157:6816/1674405437 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f04dc00f040 con 0x7f04c806c300 2023-10-14T09:19:14.728 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:19:14.728 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:19:14.728 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:19:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ec2d6640 1 -- 172.21.15.78:0/4082954868 >> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] conn(0x7f04c806c300 msgr2=0x7f04c806e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ec2d6640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.157:6816/1674405437,v1:172.21.15.157:6817/1674405437] conn(0x7f04c806c300 0x7f04c806e720 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ec2d6640 1 -- 172.21.15.78:0/4082954868 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f04c80664a0 msgr2=0x7f04c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ec2d6640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f04c80664a0 0x7f04c8068960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f04e41ec050 tx=0x7f04d4009190 comp rx=0 tx=0).stop 2023-10-14T09:19:14.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ec2d6640 1 -- 172.21.15.78:0/4082954868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04d0003980 msgr2=0x7f04e406caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ec2d6640 1 --2- 172.21.15.78:0/4082954868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04d0003980 0x7f04e406caf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009000 tx=0x7f04d0005800 comp rx=0 tx=0).stop 2023-10-14T09:19:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ea873640 1 -- 172.21.15.78:0/4082954868 reap_dead start 2023-10-14T09:19:14.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ec2d6640 1 -- 172.21.15.78:0/4082954868 shutdown_connections 2023-10-14T09:19:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ec2d6640 1 -- 172.21.15.78:0/4082954868 >> 172.21.15.78:0/4082954868 conn(0x7f04e40c1cc0 msgr2=0x7f04e40aa540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ec2d6640 1 -- 172.21.15.78:0/4082954868 shutdown_connections 2023-10-14T09:19:14.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.713+0000 7f04ec2d6640 1 -- 172.21.15.78:0/4082954868 wait complete. 2023-10-14T09:19:14.739 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-14T09:19:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.869+0000 7f91e5f1d640 1 Processor -- start 2023-10-14T09:19:14.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.869+0000 7f91e5f1d640 1 -- start start 2023-10-14T09:19:14.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.869+0000 7f91e5f1d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e014ed10 0x7f91e014f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91e5f1d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e01531d0 con 0x7f91e014f700 2023-10-14T09:19:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91e5f1d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e01534b0 con 0x7f91e014e0f0 2023-10-14T09:19:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91e5f1d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e0153e50 con 0x7f91e014ed10 2023-10-14T09:19:14.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91dffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f91e014f700 0x7f91e0150a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48278/0 (socket says 172.21.15.78:48278) 2023-10-14T09:19:14.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91dffff640 1 -- 172.21.15.78:0/2693688601 learned_addr learned my addr 172.21.15.78:0/2693688601 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:14.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91d7fff640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e014ed10 0x7f91e014f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160773058 0 0) 0x7f91e01531d0 con 0x7f91e014f700 2023-10-14T09:19:14.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91cc005740 con 0x7f91e014f700 2023-10-14T09:19:14.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3406372734 0 0) 0x7f91cc005740 con 0x7f91e014f700 2023-10-14T09:19:14.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e014ed10 msgr2=0x7f91e014f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e014ed10 0x7f91e014f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 >> v1:172.21.15.157:6789/0 conn(0x7f91e014e0f0 legacy=0x7f91e0152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e0153790 con 0x7f91e014f700 2023-10-14T09:19:14.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f91d8001a00 con 0x7f91e014f700 2023-10-14T09:19:14.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 >> v1:172.21.15.78:6789/0 conn(0x7f91e014f700 legacy=0x7f91e0150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e014ed10 0x7f91cc005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91cc006140 0x7f91cc0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 0x7f91cc0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e0153e50 con 0x7f91cc006f20 2023-10-14T09:19:14.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc00dd30 con 0x7f91cc006140 2023-10-14T09:19:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc00def0 con 0x7f91e014ed10 2023-10-14T09:19:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91dffff640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 0x7f91cc0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91df7fe640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e014ed10 0x7f91cc005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91d7fff640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91cc006140 0x7f91cc0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91dffff640 1 -- 172.21.15.78:0/2693688601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e014ed10 msgr2=0x7f91cc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91dffff640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e014ed10 0x7f91cc005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91dffff640 1 -- 172.21.15.78:0/2693688601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91cc006140 msgr2=0x7f91cc0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91dffff640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91cc006140 0x7f91cc0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.873+0000 7f91dffff640 1 -- 172.21.15.78:0/2693688601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc005740 con 0x7f91cc006f20 2023-10-14T09:19:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91dffff640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 0x7f91cc0073a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f91d800a830 tx=0x7f91d801faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c50ab0d3712864 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d80aa6d0 con 0x7f91cc006f20 2023-10-14T09:19:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d80aa830 con 0x7f91cc006f20 2023-10-14T09:19:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91deffd640 1 -- 172.21.15.78:0/2693688601 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d80aac20 con 0x7f91cc006f20 2023-10-14T09:19:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91e5f1d640 1 -- 172.21.15.78:0/2693688601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 msgr2=0x7f91cc0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91e5f1d640 1 --2- 172.21.15.78:0/2693688601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 0x7f91cc0073a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f91d800a830 tx=0x7f91d801faa0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91dffff640 1 -- 172.21.15.78:0/2693688601 reap_dead start 2023-10-14T09:19:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91e5f1d640 1 -- 172.21.15.78:0/2693688601 shutdown_connections 2023-10-14T09:19:14.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91e5f1d640 1 -- 172.21.15.78:0/2693688601 >> 172.21.15.78:0/2693688601 conn(0x7f91e00c1cc0 msgr2=0x7f91e00c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:14.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91e5f1d640 1 -- 172.21.15.78:0/2693688601 shutdown_connections 2023-10-14T09:19:14.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91e5f1d640 1 -- 172.21.15.78:0/2693688601 wait complete. 2023-10-14T09:19:14.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91e5f1d640 1 Processor -- start 2023-10-14T09:19:14.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.877+0000 7f91e5f1d640 1 -- start start 2023-10-14T09:19:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91e5f1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 0x7f91e0141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91e5f1d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e006d7f0 0x7f91e0142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91e5f1d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91e01e8180 0x7f91e01e8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91e5f1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e006d400 con 0x7f91cc006f20 2023-10-14T09:19:14.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91e5f1d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00c2fd0 con 0x7f91e01e8180 2023-10-14T09:19:14.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91e5f1d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e006ce40 con 0x7f91e006d7f0 2023-10-14T09:19:14.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91df7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 0x7f91e0141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91df7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 0x7f91e0141bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47108/0 (socket says 172.21.15.78:47108) 2023-10-14T09:19:14.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91df7fe640 1 -- 172.21.15.78:0/1590174410 learned_addr learned my addr 172.21.15.78:0/1590174410 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:14.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91dffff640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91e01e8180 0x7f91e01e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91d7fff640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e006d7f0 0x7f91e0142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91df7fe640 1 -- 172.21.15.78:0/1590174410 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e006d7f0 msgr2=0x7f91e0142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91df7fe640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e006d7f0 0x7f91e0142110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91df7fe640 1 -- 172.21.15.78:0/1590174410 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91e01e8180 msgr2=0x7f91e01e8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91df7fe640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91e01e8180 0x7f91e01e8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91df7fe640 1 -- 172.21.15.78:0/1590174410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e006d120 con 0x7f91cc006f20 2023-10-14T09:19:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91df7fe640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 0x7f91e0141bd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f91d000f5e0 tx=0x7f91d000faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91dcff9640 1 -- 172.21.15.78:0/1590174410 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00052e0 con 0x7f91cc006f20 2023-10-14T09:19:14.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91dcff9640 1 -- 172.21.15.78:0/1590174410 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d0005440 con 0x7f91cc006f20 2023-10-14T09:19:14.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91e5f1d640 1 -- 172.21.15.78:0/1590174410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e00bf4e0 con 0x7f91cc006f20 2023-10-14T09:19:14.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91dcff9640 1 -- 172.21.15.78:0/1590174410 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0003820 con 0x7f91cc006f20 2023-10-14T09:19:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91e5f1d640 1 -- 172.21.15.78:0/1590174410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e00c3460 con 0x7f91cc006f20 2023-10-14T09:19:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91e5f1d640 1 -- 172.21.15.78:0/1590174410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e0074180 con 0x7f91cc006f20 2023-10-14T09:19:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.881+0000 7f91dcff9640 1 -- 172.21.15.78:0/1590174410 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f91d0003980 con 0x7f91cc006f20 2023-10-14T09:19:14.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.885+0000 7f91dcff9640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91c00664a0 0x7f91c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:14.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.885+0000 7f91dcff9640 1 -- 172.21.15.78:0/1590174410 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f91d0083ab0 con 0x7f91cc006f20 2023-10-14T09:19:14.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.885+0000 7f91d7fff640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91c00664a0 0x7f91c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:14.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.885+0000 7f91d7fff640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91c00664a0 0x7f91c0068960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f91e014a060 tx=0x7f91c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:14.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:14.885+0000 7f91dcff9640 1 -- 172.21.15.78:0/1590174410 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f91d0051220 con 0x7f91cc006f20 2023-10-14T09:19:15.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.037+0000 7f91e5f1d640 1 -- 172.21.15.78:0/1590174410 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f91e006cfb0 con 0x7f91c00664a0 2023-10-14T09:19:15.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.037+0000 7f91dcff9640 1 -- 172.21.15.78:0/1590174410 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f91e006cfb0 con 0x7f91c00664a0 2023-10-14T09:19:15.045 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2023-10-14T09:19:15.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 -- 172.21.15.78:0/1590174410 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91c00664a0 msgr2=0x7f91c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91c00664a0 0x7f91c0068960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f91e014a060 tx=0x7f91c8008040 comp rx=0 tx=0).stop 2023-10-14T09:19:15.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 -- 172.21.15.78:0/1590174410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 msgr2=0x7f91e0141bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 0x7f91e0141bd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f91d000f5e0 tx=0x7f91d000faa0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 -- 172.21.15.78:0/1590174410 shutdown_connections 2023-10-14T09:19:15.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f91e01e8180 0x7f91e01e8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f91c00664a0 0x7f91c0068960 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f91e006d7f0 0x7f91e0142110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 --2- 172.21.15.78:0/1590174410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc006f20 0x7f91e0141bd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 -- 172.21.15.78:0/1590174410 >> 172.21.15.78:0/1590174410 conn(0x7f91e00c1cc0 msgr2=0x7f91e014a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:15.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 -- 172.21.15.78:0/1590174410 shutdown_connections 2023-10-14T09:19:15.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.041+0000 7f91e5f1d640 1 -- 172.21.15.78:0/1590174410 wait complete. 2023-10-14T09:19:15.066 INFO:tasks.ceph:Scrubbing osd.5 2023-10-14T09:19:15.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:19:15.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.201+0000 7fcf6e377640 1 Processor -- start 2023-10-14T09:19:15.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.201+0000 7fcf6e377640 1 -- start start 2023-10-14T09:19:15.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.201+0000 7fcf6e377640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcf680c51d0 0x7fcf680c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.201+0000 7fcf6e377640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf6806b470 0x7fcf680c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.201+0000 7fcf6e377640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf681573a0 con 0x7fcf680c4180 2023-10-14T09:19:15.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.201+0000 7fcf6e377640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf680c46d0 con 0x7fcf6806b470 2023-10-14T09:19:15.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.201+0000 7fcf6e377640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6806a630 con 0x7fcf680c51d0 2023-10-14T09:19:15.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.201+0000 7fcf6db76640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf6806b470 0x7fcf680c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.201+0000 7fcf6db76640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf6806b470 0x7fcf680c55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47112/0 (socket says 172.21.15.78:47112) 2023-10-14T09:19:15.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.201+0000 7fcf6db76640 1 -- 172.21.15.78:0/1547573363 learned_addr learned my addr 172.21.15.78:0/1547573363 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:15.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.201+0000 7fcf6d375640 1 --2- 172.21.15.78:0/1547573363 >> v2:172.21.15.157:3300/0 conn(0x7fcf680c51d0 0x7fcf680c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6db76640 1 -- 172.21.15.78:0/1547573363 >> v2:172.21.15.157:3300/0 conn(0x7fcf680c51d0 msgr2=0x7fcf680c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:15.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6db76640 1 --2- 172.21.15.78:0/1547573363 >> v2:172.21.15.157:3300/0 conn(0x7fcf680c51d0 0x7fcf680c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6db76640 1 -- 172.21.15.78:0/1547573363 >> v1:172.21.15.157:6789/0 conn(0x7fcf680c4180 legacy=0x7fcf68157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6db76640 1 -- 172.21.15.78:0/1547573363 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf68157070 con 0x7fcf6806b470 2023-10-14T09:19:15.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6db76640 1 --2- 172.21.15.78:0/1547573363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf6806b470 0x7fcf680c55b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcf6806ce60 tx=0x7fcf6001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3916c2f626593c9d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf5ffff640 1 -- 172.21.15.78:0/1547573363 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600a57d0 con 0x7fcf6806b470 2023-10-14T09:19:15.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf5ffff640 1 -- 172.21.15.78:0/1547573363 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf600a5930 con 0x7fcf6806b470 2023-10-14T09:19:15.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf5ffff640 1 -- 172.21.15.78:0/1547573363 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600a5cc0 con 0x7fcf6806b470 2023-10-14T09:19:15.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6e377640 1 -- 172.21.15.78:0/1547573363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf6806b470 msgr2=0x7fcf680c55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6e377640 1 --2- 172.21.15.78:0/1547573363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf6806b470 0x7fcf680c55b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcf6806ce60 tx=0x7fcf6001c910 comp rx=0 tx=0).stop 2023-10-14T09:19:15.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6e377640 1 -- 172.21.15.78:0/1547573363 shutdown_connections 2023-10-14T09:19:15.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6e377640 1 --2- 172.21.15.78:0/1547573363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf6806b470 0x7fcf680c55b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6e377640 1 --2- 172.21.15.78:0/1547573363 >> v2:172.21.15.157:3300/0 conn(0x7fcf680c51d0 0x7fcf680c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6e377640 1 -- 172.21.15.78:0/1547573363 >> 172.21.15.78:0/1547573363 conn(0x7fcf680c9430 msgr2=0x7fcf680c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:15.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6e377640 1 -- 172.21.15.78:0/1547573363 shutdown_connections 2023-10-14T09:19:15.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.205+0000 7fcf6e377640 1 -- 172.21.15.78:0/1547573363 wait complete. 2023-10-14T09:19:15.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6e377640 1 Processor -- start 2023-10-14T09:19:15.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6e377640 1 -- start start 2023-10-14T09:19:15.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6e377640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf6806b470 0x7fcf680c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6e377640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf680c4180 0x7fcf680a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6e377640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf680c51d0 0x7fcf680a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6e377640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680aa7a0 con 0x7fcf680c51d0 2023-10-14T09:19:15.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6e377640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6814ab30 con 0x7fcf6806b470 2023-10-14T09:19:15.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6e377640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68149c50 con 0x7fcf680c4180 2023-10-14T09:19:15.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6db76640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf680c51d0 0x7fcf680a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6db76640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf680c51d0 0x7fcf680a92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47124/0 (socket says 172.21.15.78:47124) 2023-10-14T09:19:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6db76640 1 -- 172.21.15.78:0/2702409682 learned_addr learned my addr 172.21.15.78:0/2702409682 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6d375640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf6806b470 0x7fcf680c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6cb74640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf680c4180 0x7fcf680a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6db76640 1 -- 172.21.15.78:0/2702409682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf680c4180 msgr2=0x7fcf680a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6db76640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf680c4180 0x7fcf680a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6db76640 1 -- 172.21.15.78:0/2702409682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf6806b470 msgr2=0x7fcf680c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6db76640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf6806b470 0x7fcf680c2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6db76640 1 -- 172.21.15.78:0/2702409682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf60009b30 con 0x7fcf680c51d0 2023-10-14T09:19:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6db76640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf680c51d0 0x7fcf680a92f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fcf600af040 tx=0x7fcf600196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf5dffb640 1 -- 172.21.15.78:0/2702409682 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600b8670 con 0x7fcf680c51d0 2023-10-14T09:19:15.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf5dffb640 1 -- 172.21.15.78:0/2702409682 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf600b87d0 con 0x7fcf680c51d0 2023-10-14T09:19:15.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf5dffb640 1 -- 172.21.15.78:0/2702409682 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600b8b60 con 0x7fcf680c51d0 2023-10-14T09:19:15.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.209+0000 7fcf6e377640 1 -- 172.21.15.78:0/2702409682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf68149f30 con 0x7fcf680c51d0 2023-10-14T09:19:15.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf6e377640 1 -- 172.21.15.78:0/2702409682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf680c30a0 con 0x7fcf680c51d0 2023-10-14T09:19:15.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf6e377640 1 -- 172.21.15.78:0/2702409682 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf68157f40 con 0x7fcf680c51d0 2023-10-14T09:19:15.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf5dffb640 1 -- 172.21.15.78:0/2702409682 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcf600b8cc0 con 0x7fcf680c51d0 2023-10-14T09:19:15.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf5dffb640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fcf4c0664a0 0x7fcf4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf5dffb640 1 -- 172.21.15.78:0/2702409682 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcf6011fa90 con 0x7fcf680c51d0 2023-10-14T09:19:15.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf6d375640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fcf4c0664a0 0x7fcf4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf5dffb640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] conn(0x7fcf4c06c300 0x7fcf4c06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf5dffb640 1 -- 172.21.15.78:0/2702409682 --> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf4c06edd0 con 0x7fcf4c06c300 2023-10-14T09:19:15.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf5dffb640 1 -- 172.21.15.78:0/2702409682 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf6011fe00 con 0x7fcf680c51d0 2023-10-14T09:19:15.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf6cb74640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] conn(0x7fcf4c06c300 0x7fcf4c06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf6d375640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fcf4c0664a0 0x7fcf4c068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcf680ae5c0 tx=0x7fcf64009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.213+0000 7fcf6cb74640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] conn(0x7fcf4c06c300 0x7fcf4c06e720 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.217+0000 7fcf5dffb640 1 -- 172.21.15.78:0/2702409682 <== osd.5 v2:172.21.15.157:6800/1064939114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fcf4c06edd0 con 0x7fcf4c06c300 2023-10-14T09:19:15.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6e377640 1 -- 172.21.15.78:0/2702409682 --> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcf68074110 con 0x7fcf4c06c300 2023-10-14T09:19:15.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf5dffb640 1 -- 172.21.15.78:0/2702409682 <== osd.5 v2:172.21.15.157:6800/1064939114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcf68074110 con 0x7fcf4c06c300 2023-10-14T09:19:15.237 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:19:15.237 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:19:15.238 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:19:15.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6e377640 1 -- 172.21.15.78:0/2702409682 >> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] conn(0x7fcf4c06c300 msgr2=0x7fcf4c06e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6e377640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.157:6800/1064939114,v1:172.21.15.157:6801/1064939114] conn(0x7fcf4c06c300 0x7fcf4c06e720 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6e377640 1 -- 172.21.15.78:0/2702409682 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fcf4c0664a0 msgr2=0x7fcf4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6e377640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7fcf4c0664a0 0x7fcf4c068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcf680ae5c0 tx=0x7fcf64009190 comp rx=0 tx=0).stop 2023-10-14T09:19:15.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6e377640 1 -- 172.21.15.78:0/2702409682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf680c51d0 msgr2=0x7fcf680a92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6e377640 1 --2- 172.21.15.78:0/2702409682 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf680c51d0 0x7fcf680a92f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fcf600af040 tx=0x7fcf600196b0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6db76640 1 -- 172.21.15.78:0/2702409682 reap_dead start 2023-10-14T09:19:15.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6e377640 1 -- 172.21.15.78:0/2702409682 shutdown_connections 2023-10-14T09:19:15.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6e377640 1 -- 172.21.15.78:0/2702409682 >> 172.21.15.78:0/2702409682 conn(0x7fcf680c9430 msgr2=0x7fcf68157830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:15.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6e377640 1 -- 172.21.15.78:0/2702409682 shutdown_connections 2023-10-14T09:19:15.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.229+0000 7fcf6e377640 1 -- 172.21.15.78:0/2702409682 wait complete. 2023-10-14T09:19:15.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-14T09:19:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.385+0000 7f7e3f365640 1 Processor -- start 2023-10-14T09:19:15.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.385+0000 7f7e3f365640 1 -- start start 2023-10-14T09:19:15.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3f365640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7e38153e80 0x7f7e380c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3f365640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3806c470 con 0x7f7e380c6910 2023-10-14T09:19:15.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3f365640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3806c750 con 0x7f7e3814ddb0 2023-10-14T09:19:15.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3f365640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e380c64f0 con 0x7f7e38153e80 2023-10-14T09:19:15.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3d902640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7e380c6910 0x7f7e380c3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48282/0 (socket says 172.21.15.78:48282) 2023-10-14T09:19:15.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3d902640 1 -- 172.21.15.78:0/765453514 learned_addr learned my addr 172.21.15.78:0/765453514 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:15.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3c900640 1 --2- 172.21.15.78:0/765453514 >> v2:172.21.15.157:3300/0 conn(0x7f7e38153e80 0x7f7e380c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240779416 0 0) 0x7f7e3806c470 con 0x7f7e380c6910 2023-10-14T09:19:15.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e24003530 con 0x7f7e380c6910 2023-10-14T09:19:15.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213938668 0 0) 0x7f7e3806c750 con 0x7f7e3814ddb0 2023-10-14T09:19:15.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e3806c470 con 0x7f7e3814ddb0 2023-10-14T09:19:15.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2048280428 0 0) 0x7f7e24003530 con 0x7f7e380c6910 2023-10-14T09:19:15.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 >> v2:172.21.15.157:3300/0 conn(0x7f7e38153e80 msgr2=0x7f7e380c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:15.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 --2- 172.21.15.78:0/765453514 >> v2:172.21.15.157:3300/0 conn(0x7f7e38153e80 0x7f7e380c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 >> v1:172.21.15.157:6789/0 conn(0x7f7e3814ddb0 legacy=0x7f7e3806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3806ca30 con 0x7f7e380c6910 2023-10-14T09:19:15.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f7e30001a00 con 0x7f7e380c6910 2023-10-14T09:19:15.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 >> v1:172.21.15.78:6789/0 conn(0x7f7e380c6910 legacy=0x7f7e380c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 --2- 172.21.15.78:0/765453514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e24003b10 0x7f7e24003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 --2- 172.21.15.78:0/765453514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e240047d0 0x7f7e24004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 --2- 172.21.15.78:0/765453514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e24005200 0x7f7e2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c64f0 con 0x7f7e240047d0 2023-10-14T09:19:15.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2400c160 con 0x7f7e24003b10 2023-10-14T09:19:15.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2400c320 con 0x7f7e24005200 2023-10-14T09:19:15.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3c900640 1 --2- 172.21.15.78:0/765453514 >> v2:172.21.15.157:3300/0 conn(0x7f7e38153e80 0x7f7e380c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:19:15.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3c900640 1 --2- 172.21.15.78:0/765453514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e240047d0 0x7f7e24004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3d902640 1 --2- 172.21.15.78:0/765453514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e24005200 0x7f7e2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3d101640 1 --2- 172.21.15.78:0/765453514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e24003b10 0x7f7e24003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3c900640 1 -- 172.21.15.78:0/765453514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e24005200 msgr2=0x7f7e2400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:15.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3c900640 1 --2- 172.21.15.78:0/765453514 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e24005200 0x7f7e2400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3c900640 1 -- 172.21.15.78:0/765453514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e24003b10 msgr2=0x7f7e24003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:15.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3c900640 1 --2- 172.21.15.78:0/765453514 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e24003b10 0x7f7e24003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3c900640 1 -- 172.21.15.78:0/765453514 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e24003530 con 0x7f7e240047d0 2023-10-14T09:19:15.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.389+0000 7f7e3d902640 1 -- 172.21.15.78:0/765453514 reap_dead start 2023-10-14T09:19:15.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.393+0000 7f7e3c900640 1 --2- 172.21.15.78:0/765453514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e240047d0 0x7f7e24004c50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009c90 tx=0x7f7e2801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a3ff543711cdde server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.393+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28004020 con 0x7f7e240047d0 2023-10-14T09:19:15.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.393+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e28004180 con 0x7f7e240047d0 2023-10-14T09:19:15.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.393+0000 7f7e2ffff640 1 -- 172.21.15.78:0/765453514 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280a5690 con 0x7f7e240047d0 2023-10-14T09:19:15.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.393+0000 7f7e3f365640 1 -- 172.21.15.78:0/765453514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e240047d0 msgr2=0x7f7e24004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.393+0000 7f7e3f365640 1 --2- 172.21.15.78:0/765453514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e240047d0 0x7f7e24004c50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009c90 tx=0x7f7e2801cbf0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.393+0000 7f7e3f365640 1 -- 172.21.15.78:0/765453514 shutdown_connections 2023-10-14T09:19:15.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.393+0000 7f7e3f365640 1 --2- 172.21.15.78:0/765453514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e240047d0 0x7f7e24004c50 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.393+0000 7f7e3f365640 1 -- 172.21.15.78:0/765453514 >> 172.21.15.78:0/765453514 conn(0x7f7e380ab1f0 msgr2=0x7f7e380ab600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:15.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.393+0000 7f7e3f365640 1 -- 172.21.15.78:0/765453514 shutdown_connections 2023-10-14T09:19:15.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.393+0000 7f7e3f365640 1 -- 172.21.15.78:0/765453514 wait complete. 2023-10-14T09:19:15.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3f365640 1 Processor -- start 2023-10-14T09:19:15.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3f365640 1 -- start start 2023-10-14T09:19:15.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3f365640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e240047d0 0x7f7e381efec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3f365640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e380c0b40 0x7f7e381f0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3f365640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e380c16c0 0x7f7e380c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3f365640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c3a20 con 0x7f7e380c0b40 2023-10-14T09:19:15.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3f365640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e381f0940 con 0x7f7e240047d0 2023-10-14T09:19:15.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3f365640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380c1230 con 0x7f7e380c16c0 2023-10-14T09:19:15.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3c900640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e380c0b40 0x7f7e381f0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3c900640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e380c0b40 0x7f7e381f0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47154/0 (socket says 172.21.15.78:47154) 2023-10-14T09:19:15.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3c900640 1 -- 172.21.15.78:0/1106463376 learned_addr learned my addr 172.21.15.78:0/1106463376 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:15.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3d101640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e240047d0 0x7f7e381efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3d902640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e380c16c0 0x7f7e380c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3c900640 1 -- 172.21.15.78:0/1106463376 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e380c16c0 msgr2=0x7f7e380c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3c900640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e380c16c0 0x7f7e380c1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3c900640 1 -- 172.21.15.78:0/1106463376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e240047d0 msgr2=0x7f7e381efec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3c900640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e240047d0 0x7f7e381efec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3c900640 1 -- 172.21.15.78:0/1106463376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e380bfaf0 con 0x7f7e380c0b40 2023-10-14T09:19:15.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3c900640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e380c0b40 0x7f7e381f0400 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7e2801ca20 tx=0x7f7e24005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e2dffb640 1 -- 172.21.15.78:0/1106463376 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280044f0 con 0x7f7e380c0b40 2023-10-14T09:19:15.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e2dffb640 1 -- 172.21.15.78:0/1106463376 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2800f080 con 0x7f7e380c0b40 2023-10-14T09:19:15.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e2dffb640 1 -- 172.21.15.78:0/1106463376 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e280a58d0 con 0x7f7e380c0b40 2023-10-14T09:19:15.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3f365640 1 -- 172.21.15.78:0/1106463376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e380bfdd0 con 0x7f7e380c0b40 2023-10-14T09:19:15.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3f365640 1 -- 172.21.15.78:0/1106463376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e380bedf0 con 0x7f7e380c0b40 2023-10-14T09:19:15.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.397+0000 7f7e3f365640 1 -- 172.21.15.78:0/1106463376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e380c13e0 con 0x7f7e380c0b40 2023-10-14T09:19:15.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.401+0000 7f7e2dffb640 1 -- 172.21.15.78:0/1106463376 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7e280a5a30 con 0x7f7e380c0b40 2023-10-14T09:19:15.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.401+0000 7f7e2dffb640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7e1c0664a0 0x7f7e1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.401+0000 7f7e2dffb640 1 -- 172.21.15.78:0/1106463376 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7e2811e030 con 0x7f7e380c0b40 2023-10-14T09:19:15.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.401+0000 7f7e3d101640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7e1c0664a0 0x7f7e1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.401+0000 7f7e3d101640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7e1c0664a0 0x7f7e1c068960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7e34000c10 tx=0x7f7e34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.405+0000 7f7e2dffb640 1 -- 172.21.15.78:0/1106463376 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7e380c13e0 con 0x7f7e380c0b40 2023-10-14T09:19:15.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.553+0000 7f7e3f365640 1 -- 172.21.15.78:0/1106463376 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e38067000 con 0x7f7e1c0664a0 2023-10-14T09:19:15.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.553+0000 7f7e2dffb640 1 -- 172.21.15.78:0/1106463376 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7e340014a0 con 0x7f7e1c0664a0 2023-10-14T09:19:15.563 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2023-10-14T09:19:15.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 -- 172.21.15.78:0/1106463376 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7e1c0664a0 msgr2=0x7f7e1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7e1c0664a0 0x7f7e1c068960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7e34000c10 tx=0x7f7e34009040 comp rx=0 tx=0).stop 2023-10-14T09:19:15.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 -- 172.21.15.78:0/1106463376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e380c0b40 msgr2=0x7f7e381f0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e380c0b40 0x7f7e381f0400 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7e2801ca20 tx=0x7f7e24005800 comp rx=0 tx=0).stop 2023-10-14T09:19:15.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 -- 172.21.15.78:0/1106463376 shutdown_connections 2023-10-14T09:19:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f7e1c0664a0 0x7f7e1c068960 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e380c16c0 0x7f7e380c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e380c0b40 0x7f7e381f0400 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 --2- 172.21.15.78:0/1106463376 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e240047d0 0x7f7e381efec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 -- 172.21.15.78:0/1106463376 >> 172.21.15.78:0/1106463376 conn(0x7f7e380ab1f0 msgr2=0x7f7e380a9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 -- 172.21.15.78:0/1106463376 shutdown_connections 2023-10-14T09:19:15.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.557+0000 7f7e3f365640 1 -- 172.21.15.78:0/1106463376 wait complete. 2023-10-14T09:19:15.583 INFO:tasks.ceph:Scrubbing osd.6 2023-10-14T09:19:15.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:19:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.717+0000 7f9d3833e640 1 Processor -- start 2023-10-14T09:19:15.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.717+0000 7f9d3833e640 1 -- start start 2023-10-14T09:19:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.717+0000 7f9d3833e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d3013b050 0x7f9d30155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.717+0000 7f9d3833e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d300a8360 0x7f9d300a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.717+0000 7f9d3833e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d30152a60 con 0x7f9d3006cd70 2023-10-14T09:19:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.717+0000 7f9d3833e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d300a9340 con 0x7f9d300a8360 2023-10-14T09:19:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.717+0000 7f9d3833e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d30155fb0 con 0x7f9d3013b050 2023-10-14T09:19:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.717+0000 7f9d358d9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d300a8360 0x7f9d300a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.717+0000 7f9d358d9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9d300a8360 0x7f9d300a87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47170/0 (socket says 172.21.15.78:47170) 2023-10-14T09:19:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.717+0000 7f9d358d9640 1 -- 172.21.15.78:0/3799058264 learned_addr learned my addr 172.21.15.78:0/3799058264 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.721+0000 7f9d360da640 1 --2- 172.21.15.78:0/3799058264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d3013b050 0x7f9d30155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.721+0000 7f9d358d9640 1 -- 172.21.15.78:0/3799058264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d3013b050 msgr2=0x7f9d30155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.721+0000 7f9d358d9640 1 --2- 172.21.15.78:0/3799058264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d3013b050 0x7f9d30155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.721+0000 7f9d358d9640 1 -- 172.21.15.78:0/3799058264 >> v1:172.21.15.157:6789/0 conn(0x7f9d3006cd70 legacy=0x7f9d3006d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.721+0000 7f9d358d9640 1 -- 172.21.15.78:0/3799058264 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d30151e50 con 0x7f9d300a8360 2023-10-14T09:19:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.721+0000 7f9d358d9640 1 --2- 172.21.15.78:0/3799058264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d300a8360 0x7f9d300a87c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009870 tx=0x7f9d2001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a6d1ff8db1c875 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.721+0000 7f9d350d8640 1 -- 172.21.15.78:0/3799058264 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d200ab680 con 0x7f9d300a8360 2023-10-14T09:19:15.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.721+0000 7f9d350d8640 1 -- 172.21.15.78:0/3799058264 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d200ab7e0 con 0x7f9d300a8360 2023-10-14T09:19:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.721+0000 7f9d350d8640 1 -- 172.21.15.78:0/3799058264 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d200abb70 con 0x7f9d300a8360 2023-10-14T09:19:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 -- 172.21.15.78:0/3799058264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d300a8360 msgr2=0x7f9d300a87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 --2- 172.21.15.78:0/3799058264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d300a8360 0x7f9d300a87c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009870 tx=0x7f9d2001c480 comp rx=0 tx=0).stop 2023-10-14T09:19:15.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 -- 172.21.15.78:0/3799058264 shutdown_connections 2023-10-14T09:19:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 --2- 172.21.15.78:0/3799058264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d300a8360 0x7f9d300a87c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 --2- 172.21.15.78:0/3799058264 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d3013b050 0x7f9d30155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 -- 172.21.15.78:0/3799058264 >> 172.21.15.78:0/3799058264 conn(0x7f9d300c1cc0 msgr2=0x7f9d300c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 -- 172.21.15.78:0/3799058264 shutdown_connections 2023-10-14T09:19:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 -- 172.21.15.78:0/3799058264 wait complete. 2023-10-14T09:19:15.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 Processor -- start 2023-10-14T09:19:15.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 -- start start 2023-10-14T09:19:15.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d3006cd70 0x7f9d30153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d300a8360 0x7f9d30155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d3013b050 0x7f9d30155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d301ecca0 con 0x7f9d300a8360 2023-10-14T09:19:15.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300c4b90 con 0x7f9d3013b050 2023-10-14T09:19:15.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d3833e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300c4e70 con 0x7f9d3006cd70 2023-10-14T09:19:15.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d358d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d300a8360 0x7f9d30155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d358d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d300a8360 0x7f9d30155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47182/0 (socket says 172.21.15.78:47182) 2023-10-14T09:19:15.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d358d9640 1 -- 172.21.15.78:0/635150639 learned_addr learned my addr 172.21.15.78:0/635150639 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:15.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d360da640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d3006cd70 0x7f9d30153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d368db640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d3013b050 0x7f9d30155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d358d9640 1 -- 172.21.15.78:0/635150639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d3006cd70 msgr2=0x7f9d30153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d358d9640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9d3006cd70 0x7f9d30153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d358d9640 1 -- 172.21.15.78:0/635150639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d3013b050 msgr2=0x7f9d30155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d358d9640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9d3013b050 0x7f9d30155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.725+0000 7f9d358d9640 1 -- 172.21.15.78:0/635150639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200094d0 con 0x7f9d300a8360 2023-10-14T09:19:15.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d358d9640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d300a8360 0x7f9d30155530 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9d2001a0b0 tx=0x7f9d2001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d26ffd640 1 -- 172.21.15.78:0/635150639 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d200ab680 con 0x7f9d300a8360 2023-10-14T09:19:15.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d26ffd640 1 -- 172.21.15.78:0/635150639 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d200b4800 con 0x7f9d300a8360 2023-10-14T09:19:15.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d26ffd640 1 -- 172.21.15.78:0/635150639 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d200b4bb0 con 0x7f9d300a8360 2023-10-14T09:19:15.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d3833e640 1 -- 172.21.15.78:0/635150639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d30154d30 con 0x7f9d300a8360 2023-10-14T09:19:15.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d3833e640 1 -- 172.21.15.78:0/635150639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d301536c0 con 0x7f9d300a8360 2023-10-14T09:19:15.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d3833e640 1 -- 172.21.15.78:0/635150639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d300c4d00 con 0x7f9d300a8360 2023-10-14T09:19:15.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d26ffd640 1 -- 172.21.15.78:0/635150639 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9d200b4d10 con 0x7f9d300a8360 2023-10-14T09:19:15.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d26ffd640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9d140664d0 0x7f9d14068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d26ffd640 1 -- 172.21.15.78:0/635150639 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9d2011e8e0 con 0x7f9d300a8360 2023-10-14T09:19:15.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d360da640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9d140664d0 0x7f9d14068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d26ffd640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] conn(0x7f9d1406c330 0x7f9d1406e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d26ffd640 1 -- 172.21.15.78:0/635150639 --> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d1406ee00 con 0x7f9d1406c330 2023-10-14T09:19:15.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d26ffd640 1 -- 172.21.15.78:0/635150639 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d201232a0 con 0x7f9d300a8360 2023-10-14T09:19:15.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d360da640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9d140664d0 0x7f9d14068990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9d30150010 tx=0x7f9d2c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.729+0000 7f9d368db640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] conn(0x7f9d1406c330 0x7f9d1406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.733+0000 7f9d368db640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] conn(0x7f9d1406c330 0x7f9d1406e750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.733+0000 7f9d26ffd640 1 -- 172.21.15.78:0/635150639 <== osd.6 v2:172.21.15.157:6808/3274328420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9d1406ee00 con 0x7f9d1406c330 2023-10-14T09:19:15.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d3833e640 1 -- 172.21.15.78:0/635150639 --> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9d301526f0 con 0x7f9d1406c330 2023-10-14T09:19:15.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d26ffd640 1 -- 172.21.15.78:0/635150639 <== osd.6 v2:172.21.15.157:6808/3274328420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9d28001aa0 con 0x7f9d1406c330 2023-10-14T09:19:15.753 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:19:15.754 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:19:15.754 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:19:15.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d3833e640 1 -- 172.21.15.78:0/635150639 >> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] conn(0x7f9d1406c330 msgr2=0x7f9d1406e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d3833e640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.157:6808/3274328420,v1:172.21.15.157:6809/3274328420] conn(0x7f9d1406c330 0x7f9d1406e750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d3833e640 1 -- 172.21.15.78:0/635150639 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9d140664d0 msgr2=0x7f9d14068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d3833e640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f9d140664d0 0x7f9d14068990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9d30150010 tx=0x7f9d2c009190 comp rx=0 tx=0).stop 2023-10-14T09:19:15.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d3833e640 1 -- 172.21.15.78:0/635150639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d300a8360 msgr2=0x7f9d30155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d3833e640 1 --2- 172.21.15.78:0/635150639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d300a8360 0x7f9d30155530 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9d2001a0b0 tx=0x7f9d2001acc0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d368db640 1 -- 172.21.15.78:0/635150639 reap_dead start 2023-10-14T09:19:15.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d3833e640 1 -- 172.21.15.78:0/635150639 shutdown_connections 2023-10-14T09:19:15.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d3833e640 1 -- 172.21.15.78:0/635150639 >> 172.21.15.78:0/635150639 conn(0x7f9d300c1cc0 msgr2=0x7f9d300be570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:15.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d3833e640 1 -- 172.21.15.78:0/635150639 shutdown_connections 2023-10-14T09:19:15.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.745+0000 7f9d3833e640 1 -- 172.21.15.78:0/635150639 wait complete. 2023-10-14T09:19:15.772 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-14T09:19:15.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.901+0000 7f57f5079640 1 Processor -- start 2023-10-14T09:19:15.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.901+0000 7f57f5079640 1 -- start start 2023-10-14T09:19:15.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57f5079640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57f00c1eb0 0x7f57f00c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57f5079640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f57f00c7d30 0x7f57f00c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57f5079640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f0151810 con 0x7f57f0151430 2023-10-14T09:19:15.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57f5079640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f00c27d0 con 0x7f57f00c7d30 2023-10-14T09:19:15.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57f5079640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f006f760 con 0x7f57f00c1eb0 2023-10-14T09:19:15.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57ef59e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f57f00c7d30 0x7f57f00c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57ef59e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f57f00c7d30 0x7f57f00c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.78:36480/0 (socket says 172.21.15.78:36480) 2023-10-14T09:19:15.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57ef59e640 1 -- 172.21.15.78:0/1201972012 learned_addr learned my addr 172.21.15.78:0/1201972012 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:15.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57ee59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57f00c1eb0 0x7f57f00c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57ef59e640 1 -- 172.21.15.78:0/1201972012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57f00c1eb0 msgr2=0x7f57f00c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:15.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57ef59e640 1 --2- 172.21.15.78:0/1201972012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57f00c1eb0 0x7f57f00c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57ef59e640 1 -- 172.21.15.78:0/1201972012 >> v1:172.21.15.157:6789/0 conn(0x7f57f0151430 legacy=0x7f57f01547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.905+0000 7f57ef59e640 1 -- 172.21.15.78:0/1201972012 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f006fa00 con 0x7f57f00c7d30 2023-10-14T09:19:15.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57ef59e640 1 --2- 172.21.15.78:0/1201972012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57f00c7d30 0x7f57f00c4180 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009e50 tx=0x7f57e801c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=351aa551fc4d7979 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57edd9b640 1 -- 172.21.15.78:0/1201972012 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e80a5740 con 0x7f57f00c7d30 2023-10-14T09:19:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57edd9b640 1 -- 172.21.15.78:0/1201972012 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e80a58a0 con 0x7f57f00c7d30 2023-10-14T09:19:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57edd9b640 1 -- 172.21.15.78:0/1201972012 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e80a5c30 con 0x7f57f00c7d30 2023-10-14T09:19:15.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57f5079640 1 -- 172.21.15.78:0/1201972012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57f00c7d30 msgr2=0x7f57f00c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57f5079640 1 --2- 172.21.15.78:0/1201972012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57f00c7d30 0x7f57f00c4180 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009e50 tx=0x7f57e801c880 comp rx=0 tx=0).stop 2023-10-14T09:19:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57f5079640 1 -- 172.21.15.78:0/1201972012 shutdown_connections 2023-10-14T09:19:15.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57f5079640 1 --2- 172.21.15.78:0/1201972012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57f00c7d30 0x7f57f00c4180 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57f5079640 1 --2- 172.21.15.78:0/1201972012 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57f00c1eb0 0x7f57f00c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57f5079640 1 -- 172.21.15.78:0/1201972012 >> 172.21.15.78:0/1201972012 conn(0x7f57f006a060 msgr2=0x7f57f006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:15.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57f5079640 1 -- 172.21.15.78:0/1201972012 shutdown_connections 2023-10-14T09:19:15.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57f5079640 1 -- 172.21.15.78:0/1201972012 wait complete. 2023-10-14T09:19:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57f5079640 1 Processor -- start 2023-10-14T09:19:15.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.909+0000 7f57f5079640 1 -- start start 2023-10-14T09:19:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57f5079640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00c1eb0 0x7f57f00c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57f5079640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57f00c7d30 0x7f57f014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57f5079640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57f0151430 0x7f57f014eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57f5079640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0150890 con 0x7f57f00c1eb0 2023-10-14T09:19:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57f5079640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f01ec7e0 con 0x7f57f0151430 2023-10-14T09:19:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57f5079640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f01ecac0 con 0x7f57f00c7d30 2023-10-14T09:19:15.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57eed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00c1eb0 0x7f57f00c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57ee59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57f00c7d30 0x7f57f014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57eed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00c1eb0 0x7f57f00c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47186/0 (socket says 172.21.15.78:47186) 2023-10-14T09:19:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57eed9d640 1 -- 172.21.15.78:0/1148146878 learned_addr learned my addr 172.21.15.78:0/1148146878 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:15.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57ef59e640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57f0151430 0x7f57f014eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57eed9d640 1 -- 172.21.15.78:0/1148146878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57f00c7d30 msgr2=0x7f57f014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57eed9d640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57f00c7d30 0x7f57f014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57eed9d640 1 -- 172.21.15.78:0/1148146878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57f0151430 msgr2=0x7f57f014eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57eed9d640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57f0151430 0x7f57f014eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57eed9d640 1 -- 172.21.15.78:0/1148146878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8009b30 con 0x7f57f00c1eb0 2023-10-14T09:19:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57eed9d640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00c1eb0 0x7f57f00c5c30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f57e000c500 tx=0x7f57e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57d77fe640 1 -- 172.21.15.78:0/1148146878 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0005220 con 0x7f57f00c1eb0 2023-10-14T09:19:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57d77fe640 1 -- 172.21.15.78:0/1148146878 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e0005380 con 0x7f57f00c1eb0 2023-10-14T09:19:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57f5079640 1 -- 172.21.15.78:0/1148146878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f014c4a0 con 0x7f57f00c1eb0 2023-10-14T09:19:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57d77fe640 1 -- 172.21.15.78:0/1148146878 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0007270 con 0x7f57f00c1eb0 2023-10-14T09:19:15.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57f5079640 1 -- 172.21.15.78:0/1148146878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f00c6170 con 0x7f57f00c1eb0 2023-10-14T09:19:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57f5079640 1 -- 172.21.15.78:0/1148146878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f014c300 con 0x7f57f00c1eb0 2023-10-14T09:19:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.913+0000 7f57d77fe640 1 -- 172.21.15.78:0/1148146878 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f57e00073d0 con 0x7f57f00c1eb0 2023-10-14T09:19:15.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.917+0000 7f57d77fe640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57dc0664d0 0x7f57dc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.917+0000 7f57d77fe640 1 -- 172.21.15.78:0/1148146878 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f57e00833a0 con 0x7f57f00c1eb0 2023-10-14T09:19:15.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.917+0000 7f57ee59c640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57dc0664d0 0x7f57dc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:15.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.917+0000 7f57ee59c640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57dc0664d0 0x7f57dc068990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f57f014ff40 tx=0x7f57e4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:15.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:15.921+0000 7f57d77fe640 1 -- 172.21.15.78:0/1148146878 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f57f014c300 con 0x7f57f00c1eb0 2023-10-14T09:19:16.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 -- 172.21.15.78:0/1148146878 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f57f01ec950 con 0x7f57dc0664d0 2023-10-14T09:19:16.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57d77fe640 1 -- 172.21.15.78:0/1148146878 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f57f01ec950 con 0x7f57dc0664d0 2023-10-14T09:19:16.077 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2023-10-14T09:19:16.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 -- 172.21.15.78:0/1148146878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57dc0664d0 msgr2=0x7f57dc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57dc0664d0 0x7f57dc068990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f57f014ff40 tx=0x7f57e4009190 comp rx=0 tx=0).stop 2023-10-14T09:19:16.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 -- 172.21.15.78:0/1148146878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00c1eb0 msgr2=0x7f57f00c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00c1eb0 0x7f57f00c5c30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f57e000c500 tx=0x7f57e000c9c0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 -- 172.21.15.78:0/1148146878 shutdown_connections 2023-10-14T09:19:16.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57f0151430 0x7f57f014eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f57dc0664d0 0x7f57dc068990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f57f00c7d30 0x7f57f014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 --2- 172.21.15.78:0/1148146878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57f00c1eb0 0x7f57f00c5c30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 -- 172.21.15.78:0/1148146878 >> 172.21.15.78:0/1148146878 conn(0x7f57f006a060 msgr2=0x7f57f00a8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 -- 172.21.15.78:0/1148146878 shutdown_connections 2023-10-14T09:19:16.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.069+0000 7f57f5079640 1 -- 172.21.15.78:0/1148146878 wait complete. 2023-10-14T09:19:16.098 INFO:tasks.ceph:Scrubbing osd.7 2023-10-14T09:19:16.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-14T09:19:16.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.233+0000 7f50cb068640 1 Processor -- start 2023-10-14T09:19:16.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.233+0000 7f50cb068640 1 -- start start 2023-10-14T09:19:16.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50cb068640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50c41572f0 0x7f50c4154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50cb068640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50c40be950 0x7f50c4071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50cb068640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c4070c90 con 0x7f50c40be570 2023-10-14T09:19:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50cb068640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c40bee00 con 0x7f50c40be950 2023-10-14T09:19:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50cb068640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c4157860 con 0x7f50c41572f0 2023-10-14T09:19:16.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50c9605640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f50c40be950 0x7f50c4071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50c8e04640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f50c40be570 0x7f50c4071120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48290/0 (socket says 172.21.15.78:48290) 2023-10-14T09:19:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50c8e04640 1 -- 172.21.15.78:0/2213166211 learned_addr learned my addr 172.21.15.78:0/2213166211 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50c9605640 1 --2- 172.21.15.78:0/2213166211 >> v2:172.21.15.78:3300/0 conn(0x7f50c40be950 0x7f50c4071830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47192/0 (socket says 172.21.15.78:47192) 2023-10-14T09:19:16.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50bbfff640 1 --2- 172.21.15.78:0/2213166211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50c41572f0 0x7f50c4154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50c9605640 1 -- 172.21.15.78:0/2213166211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50c41572f0 msgr2=0x7f50c4154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:16.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50c9605640 1 --2- 172.21.15.78:0/2213166211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50c41572f0 0x7f50c4154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50c9605640 1 -- 172.21.15.78:0/2213166211 >> v1:172.21.15.78:6789/0 conn(0x7f50c40be570 legacy=0x7f50c4071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50c9605640 1 -- 172.21.15.78:0/2213166211 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c4157b40 con 0x7f50c40be950 2023-10-14T09:19:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50bb7fe640 1 -- 172.21.15.78:0/2213166211 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567558787 0 0) 0x7f50c4070c90 con 0x7f50c40be570 2023-10-14T09:19:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50c9605640 1 --2- 172.21.15.78:0/2213166211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c40be950 0x7f50c4071830 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009d90 tx=0x7f50bc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6fff17a5eacfe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.237+0000 7f50bb7fe640 1 -- 172.21.15.78:0/2213166211 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0a59e0 con 0x7f50c40be950 2023-10-14T09:19:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50bb7fe640 1 -- 172.21.15.78:0/2213166211 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc0a5b40 con 0x7f50c40be950 2023-10-14T09:19:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50bb7fe640 1 -- 172.21.15.78:0/2213166211 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0ad440 con 0x7f50c40be950 2023-10-14T09:19:16.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 -- 172.21.15.78:0/2213166211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c40be950 msgr2=0x7f50c4071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 --2- 172.21.15.78:0/2213166211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c40be950 0x7f50c4071830 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009d90 tx=0x7f50bc01c920 comp rx=0 tx=0).stop 2023-10-14T09:19:16.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 -- 172.21.15.78:0/2213166211 shutdown_connections 2023-10-14T09:19:16.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 --2- 172.21.15.78:0/2213166211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c40be950 0x7f50c4071830 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 --2- 172.21.15.78:0/2213166211 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50c41572f0 0x7f50c4154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 -- 172.21.15.78:0/2213166211 >> 172.21.15.78:0/2213166211 conn(0x7f50c40c1cc0 msgr2=0x7f50c40c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:16.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 -- 172.21.15.78:0/2213166211 shutdown_connections 2023-10-14T09:19:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 -- 172.21.15.78:0/2213166211 wait complete. 2023-10-14T09:19:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 Processor -- start 2023-10-14T09:19:16.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 -- start start 2023-10-14T09:19:16.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c40be570 0x7f50c41ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c40be950 0x7f50c4151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50c41572f0 0x7f50c414bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c41ed2b0 con 0x7f50c40be570 2023-10-14T09:19:16.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c414ce80 con 0x7f50c40be950 2023-10-14T09:19:16.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50cb068640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40c4820 con 0x7f50c41572f0 2023-10-14T09:19:16.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50c8e04640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c40be570 0x7f50c41ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50c8e04640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c40be570 0x7f50c41ecd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47206/0 (socket says 172.21.15.78:47206) 2023-10-14T09:19:16.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50c8e04640 1 -- 172.21.15.78:0/3483556385 learned_addr learned my addr 172.21.15.78:0/3483556385 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:16.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50c9605640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50c41572f0 0x7f50c414bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.241+0000 7f50bbfff640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c40be950 0x7f50c4151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50c8e04640 1 -- 172.21.15.78:0/3483556385 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50c41572f0 msgr2=0x7f50c414bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50c8e04640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50c41572f0 0x7f50c414bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50c8e04640 1 -- 172.21.15.78:0/3483556385 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c40be950 msgr2=0x7f50c4151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50c8e04640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f50c40be950 0x7f50c4151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50c8e04640 1 -- 172.21.15.78:0/3483556385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc009a70 con 0x7f50c40be570 2023-10-14T09:19:16.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50c8e04640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c40be570 0x7f50c41ecd70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f50c00011f0 tx=0x7f50c000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:16.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50b97fa640 1 -- 172.21.15.78:0/3483556385 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c00074e0 con 0x7f50c40be570 2023-10-14T09:19:16.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50b97fa640 1 -- 172.21.15.78:0/3483556385 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c0007640 con 0x7f50c40be570 2023-10-14T09:19:16.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50cb068640 1 -- 172.21.15.78:0/3483556385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c40c4b00 con 0x7f50c40be570 2023-10-14T09:19:16.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50b97fa640 1 -- 172.21.15.78:0/3483556385 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c0004a10 con 0x7f50c40be570 2023-10-14T09:19:16.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50cb068640 1 -- 172.21.15.78:0/3483556385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c414d0d0 con 0x7f50c40be570 2023-10-14T09:19:16.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50cb068640 1 -- 172.21.15.78:0/3483556385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50c413d3a0 con 0x7f50c40be570 2023-10-14T09:19:16.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50b97fa640 1 -- 172.21.15.78:0/3483556385 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f50c0004b70 con 0x7f50c40be570 2023-10-14T09:19:16.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50b97fa640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f50b00664a0 0x7f50b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50b97fa640 1 -- 172.21.15.78:0/3483556385 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f50c0082e50 con 0x7f50c40be570 2023-10-14T09:19:16.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50b97fa640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] conn(0x7f50b006c300 0x7f50b006e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50b97fa640 1 -- 172.21.15.78:0/3483556385 --> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50b006edd0 con 0x7f50b006c300 2023-10-14T09:19:16.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50b97fa640 1 -- 172.21.15.78:0/3483556385 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50c0085430 con 0x7f50c40be570 2023-10-14T09:19:16.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.245+0000 7f50bbfff640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f50b00664a0 0x7f50b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.249+0000 7f50c9605640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] conn(0x7f50b006c300 0x7f50b006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.249+0000 7f50bbfff640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f50b00664a0 0x7f50b0068960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f50c40c4230 tx=0x7f50b4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:16.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.249+0000 7f50c9605640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] conn(0x7f50b006c300 0x7f50b006e720 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:16.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.249+0000 7f50b97fa640 1 -- 172.21.15.78:0/3483556385 <== osd.7 v2:172.21.15.157:6824/782145234 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f50b006edd0 con 0x7f50b006c300 2023-10-14T09:19:16.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.261+0000 7f50cb068640 1 -- 172.21.15.78:0/3483556385 --> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f50c4071d70 con 0x7f50b006c300 2023-10-14T09:19:16.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.261+0000 7f50b97fa640 1 -- 172.21.15.78:0/3483556385 <== osd.7 v2:172.21.15.157:6824/782145234 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f50bc009450 con 0x7f50b006c300 2023-10-14T09:19:16.270 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-10-14T09:19:16.270 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T09:19:16.270 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-10-14T09:19:16.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.261+0000 7f50cb068640 1 -- 172.21.15.78:0/3483556385 >> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] conn(0x7f50b006c300 msgr2=0x7f50b006e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.261+0000 7f50cb068640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.157:6824/782145234,v1:172.21.15.157:6825/782145234] conn(0x7f50b006c300 0x7f50b006e720 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.261+0000 7f50cb068640 1 -- 172.21.15.78:0/3483556385 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f50b00664a0 msgr2=0x7f50b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.261+0000 7f50cb068640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f50b00664a0 0x7f50b0068960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f50c40c4230 tx=0x7f50b4009190 comp rx=0 tx=0).stop 2023-10-14T09:19:16.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.261+0000 7f50cb068640 1 -- 172.21.15.78:0/3483556385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c40be570 msgr2=0x7f50c41ecd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.261+0000 7f50cb068640 1 --2- 172.21.15.78:0/3483556385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c40be570 0x7f50c41ecd70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f50c00011f0 tx=0x7f50c000c9b0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.261+0000 7f50c9605640 1 -- 172.21.15.78:0/3483556385 reap_dead start 2023-10-14T09:19:16.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.261+0000 7f50cb068640 1 -- 172.21.15.78:0/3483556385 shutdown_connections 2023-10-14T09:19:16.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.261+0000 7f50cb068640 1 -- 172.21.15.78:0/3483556385 >> 172.21.15.78:0/3483556385 conn(0x7f50c40c1cc0 msgr2=0x7f50c4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:16.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.265+0000 7f50cb068640 1 -- 172.21.15.78:0/3483556385 shutdown_connections 2023-10-14T09:19:16.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.265+0000 7f50cb068640 1 -- 172.21.15.78:0/3483556385 wait complete. 2023-10-14T09:19:16.288 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-14T09:19:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3759c46640 1 Processor -- start 2023-10-14T09:19:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3759c46640 1 -- start start 2023-10-14T09:19:16.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3759c46640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f375406fc10 0x7f37540c02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3759c46640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37540700a0 con 0x7f37540c1230 2023-10-14T09:19:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3759c46640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375406bcc0 con 0x7f375406d750 2023-10-14T09:19:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3759c46640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375406c340 con 0x7f375406fc10 2023-10-14T09:19:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37537fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f37540c1230 0x7f375406c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48302/0 (socket says 172.21.15.78:48302) 2023-10-14T09:19:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37537fe640 1 -- 172.21.15.78:0/2986777196 learned_addr learned my addr 172.21.15.78:0/2986777196 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:16.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498165690 0 0) 0x7f37540700a0 con 0x7f37540c1230 2023-10-14T09:19:16.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f373c003530 con 0x7f37540c1230 2023-10-14T09:19:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3753fff640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f375406fc10 0x7f37540c02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2718537163 0 0) 0x7f373c003530 con 0x7f37540c1230 2023-10-14T09:19:16.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f375406fc10 msgr2=0x7f37540c02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f375406fc10 0x7f37540c02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 >> v1:172.21.15.157:6789/0 conn(0x7f375406d750 legacy=0x7f37540bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754150dd0 con 0x7f37540c1230 2023-10-14T09:19:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3936033875 0 0) 0x7f3744001680 con 0x7f37540c1230 2023-10-14T09:19:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3753fff640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f375406fc10 0x7f37540c02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:19:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 >> v1:172.21.15.78:6789/0 conn(0x7f37540c1230 legacy=0x7f375406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f375406fc10 0x7f373c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f373c003fa0 0x7f373c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f373c004d10 0x7f373c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375406c340 con 0x7f373c004d10 2023-10-14T09:19:16.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c00baf0 con 0x7f373c003fa0 2023-10-14T09:19:16.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c00bcb0 con 0x7f375406fc10 2023-10-14T09:19:16.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3753fff640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f373c004d10 0x7f373c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f37537fe640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f375406fc10 0x7f373c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3752ffd640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f373c003fa0 0x7f373c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3753fff640 1 -- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f375406fc10 msgr2=0x7f373c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3753fff640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f375406fc10 0x7f373c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3753fff640 1 -- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f373c003fa0 msgr2=0x7f373c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3753fff640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f373c003fa0 0x7f373c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.421+0000 7f3753fff640 1 -- 172.21.15.78:0/2986777196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c003530 con 0x7f373c004d10 2023-10-14T09:19:16.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.425+0000 7f3753fff640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f373c004d10 0x7f373c005190 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f374c0073e0 tx=0x7f374c01cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713d51d41c9adfae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:16.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.425+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0a5da0 con 0x7f373c004d10 2023-10-14T09:19:16.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.425+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c0ad440 con 0x7f373c004d10 2023-10-14T09:19:16.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.425+0000 7f37527fc640 1 -- 172.21.15.78:0/2986777196 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0ad7b0 con 0x7f373c004d10 2023-10-14T09:19:16.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.425+0000 7f3759c46640 1 -- 172.21.15.78:0/2986777196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f373c004d10 msgr2=0x7f373c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.425+0000 7f3759c46640 1 --2- 172.21.15.78:0/2986777196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f373c004d10 0x7f373c005190 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f374c0073e0 tx=0x7f374c01cea0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.425+0000 7f3753fff640 1 -- 172.21.15.78:0/2986777196 reap_dead start 2023-10-14T09:19:16.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.425+0000 7f3759c46640 1 -- 172.21.15.78:0/2986777196 shutdown_connections 2023-10-14T09:19:16.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.425+0000 7f3759c46640 1 -- 172.21.15.78:0/2986777196 >> 172.21.15.78:0/2986777196 conn(0x7f37540c1cc0 msgr2=0x7f37540c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:16.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.425+0000 7f3759c46640 1 -- 172.21.15.78:0/2986777196 shutdown_connections 2023-10-14T09:19:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.425+0000 7f3759c46640 1 -- 172.21.15.78:0/2986777196 wait complete. 2023-10-14T09:19:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3759c46640 1 Processor -- start 2023-10-14T09:19:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3759c46640 1 -- start start 2023-10-14T09:19:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3759c46640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f373c004d10 0x7f37540a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3759c46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37541dd450 0x7f3754145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3759c46640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37540a9d10 0x7f3754145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3759c46640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37541ecc70 con 0x7f37541dd450 2023-10-14T09:19:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3759c46640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37541ebe10 con 0x7f373c004d10 2023-10-14T09:19:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3759c46640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37541ec060 con 0x7f37540a9d10 2023-10-14T09:19:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3752ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37541dd450 0x7f3754145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3752ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37541dd450 0x7f3754145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47228/0 (socket says 172.21.15.78:47228) 2023-10-14T09:19:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3752ffd640 1 -- 172.21.15.78:0/518707373 learned_addr learned my addr 172.21.15.78:0/518707373 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f37537fe640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f373c004d10 0x7f37540a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3753fff640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37540a9d10 0x7f3754145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3752ffd640 1 -- 172.21.15.78:0/518707373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37540a9d10 msgr2=0x7f3754145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3752ffd640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37540a9d10 0x7f3754145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3752ffd640 1 -- 172.21.15.78:0/518707373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f373c004d10 msgr2=0x7f37540a97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3752ffd640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f373c004d10 0x7f37540a97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3752ffd640 1 -- 172.21.15.78:0/518707373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37541ec340 con 0x7f37541dd450 2023-10-14T09:19:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f37537fe640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f373c004d10 0x7f37540a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:19:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3753fff640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37540a9d10 0x7f3754145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:19:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3752ffd640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37541dd450 0x7f3754145690 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f374800f5e0 tx=0x7f374800faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:16.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f373bfff640 1 -- 172.21.15.78:0/518707373 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480052e0 con 0x7f37541dd450 2023-10-14T09:19:16.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f373bfff640 1 -- 172.21.15.78:0/518707373 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3748005440 con 0x7f37541dd450 2023-10-14T09:19:16.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3759c46640 1 -- 172.21.15.78:0/518707373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37541ec620 con 0x7f37541dd450 2023-10-14T09:19:16.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f373bfff640 1 -- 172.21.15.78:0/518707373 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748003820 con 0x7f37541dd450 2023-10-14T09:19:16.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.429+0000 7f3759c46640 1 -- 172.21.15.78:0/518707373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375406c940 con 0x7f37541dd450 2023-10-14T09:19:16.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.433+0000 7f3759c46640 1 -- 172.21.15.78:0/518707373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3754074180 con 0x7f37541dd450 2023-10-14T09:19:16.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.433+0000 7f373bfff640 1 -- 172.21.15.78:0/518707373 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3748003980 con 0x7f37541dd450 2023-10-14T09:19:16.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.433+0000 7f373bfff640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f37400664d0 0x7f3740068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.433+0000 7f373bfff640 1 -- 172.21.15.78:0/518707373 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3748083a40 con 0x7f37541dd450 2023-10-14T09:19:16.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.433+0000 7f37537fe640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f37400664d0 0x7f3740068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.433+0000 7f37537fe640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f37400664d0 0x7f3740068990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f37440017b0 tx=0x7f3744009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:16.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.437+0000 7f373bfff640 1 -- 172.21.15.78:0/518707373 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f37480511b0 con 0x7f37541dd450 2023-10-14T09:19:16.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.585+0000 7f3759c46640 1 -- 172.21.15.78:0/518707373 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f375406bf60 con 0x7f37400664d0 2023-10-14T09:19:16.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f373bfff640 1 -- 172.21.15.78:0/518707373 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3744007e90 con 0x7f37400664d0 2023-10-14T09:19:16.595 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2023-10-14T09:19:16.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 -- 172.21.15.78:0/518707373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f37400664d0 msgr2=0x7f3740068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f37400664d0 0x7f3740068990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f37440017b0 tx=0x7f3744009040 comp rx=0 tx=0).stop 2023-10-14T09:19:16.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 -- 172.21.15.78:0/518707373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37541dd450 msgr2=0x7f3754145690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37541dd450 0x7f3754145690 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f374800f5e0 tx=0x7f374800faa0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 -- 172.21.15.78:0/518707373 shutdown_connections 2023-10-14T09:19:16.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f37400664d0 0x7f3740068990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37540a9d10 0x7f3754145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37541dd450 0x7f3754145690 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 --2- 172.21.15.78:0/518707373 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f373c004d10 0x7f37540a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 -- 172.21.15.78:0/518707373 >> 172.21.15.78:0/518707373 conn(0x7f37540c1cc0 msgr2=0x7f37540c0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:16.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 -- 172.21.15.78:0/518707373 shutdown_connections 2023-10-14T09:19:16.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.589+0000 7f3759c46640 1 -- 172.21.15.78:0/518707373 wait complete. 2023-10-14T09:19:16.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:19:16.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.745+0000 7f792a33b640 1 Processor -- start 2023-10-14T09:19:16.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.745+0000 7f792a33b640 1 -- start start 2023-10-14T09:19:16.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.745+0000 7f792a33b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f79241514b0 0x7f79240c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f792a33b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79240c4810 0x7f792415e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f792a33b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7924154490 con 0x7f7924154920 2023-10-14T09:19:16.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f792a33b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7924153c30 con 0x7f79241514b0 2023-10-14T09:19:16.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f792a33b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79240c5a00 con 0x7f79240c4810 2023-10-14T09:19:16.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f7928b38640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7924154920 0x7f79240c7330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:48316/0 (socket says 172.21.15.78:48316) 2023-10-14T09:19:16.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f7928b38640 1 -- 172.21.15.78:0/434236633 learned_addr learned my addr 172.21.15.78:0/434236633 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:16.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f7929339640 1 --2- 172.21.15.78:0/434236633 >> v2:172.21.15.78:3300/0 conn(0x7f79241514b0 0x7f79240c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f7929339640 1 -- 172.21.15.78:0/434236633 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79240c4810 msgr2=0x7f792415e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:16.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f7929b3a640 1 --2- 172.21.15.78:0/434236633 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79240c4810 0x7f792415e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f7929339640 1 --2- 172.21.15.78:0/434236633 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79240c4810 0x7f792415e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f7929339640 1 -- 172.21.15.78:0/434236633 >> v1:172.21.15.78:6789/0 conn(0x7f7924154920 legacy=0x7f79240c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f791bfff640 1 -- 172.21.15.78:0/434236633 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632559806 0 0) 0x7f7924154490 con 0x7f7924154920 2023-10-14T09:19:16.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f7929339640 1 -- 172.21.15.78:0/434236633 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7924153e40 con 0x7f79241514b0 2023-10-14T09:19:16.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f7929b3a640 1 --2- 172.21.15.78:0/434236633 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79240c4810 0x7f792415e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:19:16.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f7929339640 1 --2- 172.21.15.78:0/434236633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79241514b0 0x7f79240c4d60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f79200097c0 tx=0x7f792001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9f5d68d2e0278d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:16.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f791bfff640 1 -- 172.21.15.78:0/434236633 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920004230 con 0x7f79241514b0 2023-10-14T09:19:16.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f791bfff640 1 -- 172.21.15.78:0/434236633 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79200a7050 con 0x7f79241514b0 2023-10-14T09:19:16.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.749+0000 7f791bfff640 1 -- 172.21.15.78:0/434236633 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920003620 con 0x7f79241514b0 2023-10-14T09:19:16.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 -- 172.21.15.78:0/434236633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79241514b0 msgr2=0x7f79240c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 --2- 172.21.15.78:0/434236633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79241514b0 0x7f79240c4d60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f79200097c0 tx=0x7f792001c330 comp rx=0 tx=0).stop 2023-10-14T09:19:16.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 -- 172.21.15.78:0/434236633 shutdown_connections 2023-10-14T09:19:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 --2- 172.21.15.78:0/434236633 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79240c4810 0x7f792415e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 --2- 172.21.15.78:0/434236633 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79241514b0 0x7f79240c4d60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 -- 172.21.15.78:0/434236633 >> 172.21.15.78:0/434236633 conn(0x7f79240c9430 msgr2=0x7f79240c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 -- 172.21.15.78:0/434236633 shutdown_connections 2023-10-14T09:19:16.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 -- 172.21.15.78:0/434236633 wait complete. 2023-10-14T09:19:16.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 Processor -- start 2023-10-14T09:19:16.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 -- start start 2023-10-14T09:19:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79240c4810 0x7f792414b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79241514b0 0x7f79241451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7924154920 0x7f79241456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79240af150 con 0x7f79240c4810 2023-10-14T09:19:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79241ec710 con 0x7f7924154920 2023-10-14T09:19:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f792a33b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792414de00 con 0x7f79241514b0 2023-10-14T09:19:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f7929339640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79240c4810 0x7f792414b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f7929339640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79240c4810 0x7f792414b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47256/0 (socket says 172.21.15.78:47256) 2023-10-14T09:19:16.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f7929339640 1 -- 172.21.15.78:0/3613647638 learned_addr learned my addr 172.21.15.78:0/3613647638 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:16.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f7929339640 1 -- 172.21.15.78:0/3613647638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79241514b0 msgr2=0x7f79241451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.753+0000 7f7928b38640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79241514b0 0x7f79241451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7929339640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79241514b0 0x7f79241451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7929339640 1 -- 172.21.15.78:0/3613647638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7924154920 msgr2=0x7f79241456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7929339640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7924154920 0x7f79241456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7929339640 1 -- 172.21.15.78:0/3613647638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7920009420 con 0x7f79240c4810 2023-10-14T09:19:16.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7929339640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79240c4810 0x7f792414b9c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7920009710 tx=0x7f79200190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:16.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7919ffb640 1 -- 172.21.15.78:0/3613647638 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920003c70 con 0x7f79240c4810 2023-10-14T09:19:16.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7919ffb640 1 -- 172.21.15.78:0/3613647638 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7920003dd0 con 0x7f79240c4810 2023-10-14T09:19:16.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7919ffb640 1 -- 172.21.15.78:0/3613647638 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79200ab680 con 0x7f79240c4810 2023-10-14T09:19:16.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f792a33b640 1 -- 172.21.15.78:0/3613647638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79240ad450 con 0x7f79240c4810 2023-10-14T09:19:16.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f792a33b640 1 -- 172.21.15.78:0/3613647638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79240aa520 con 0x7f79240c4810 2023-10-14T09:19:16.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f792a33b640 1 -- 172.21.15.78:0/3613647638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792404e9c0 con 0x7f79240c4810 2023-10-14T09:19:16.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7919ffb640 1 -- 172.21.15.78:0/3613647638 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f79200b2040 con 0x7f79240c4810 2023-10-14T09:19:16.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7919ffb640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79080664a0 0x7f7908068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:16.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7919ffb640 1 -- 172.21.15.78:0/3613647638 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f792011dde0 con 0x7f79240c4810 2023-10-14T09:19:16.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.757+0000 7f7928b38640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79080664a0 0x7f7908068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.761+0000 7f7928b38640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79080664a0 0x7f7908068960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7924152ef0 tx=0x7f7914009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.761+0000 7f7919ffb640 1 -- 172.21.15.78:0/3613647638 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f79200eb4c0 con 0x7f79240c4810 2023-10-14T09:19:16.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.909+0000 7f792a33b640 1 -- 172.21.15.78:0/3613647638 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7924161250 con 0x7f79080664a0 2023-10-14T09:19:16.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f7919ffb640 1 -- 172.21.15.78:0/3613647638 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50443 (secure 0 0 0) 0x7f7914001c80 con 0x7f79080664a0 2023-10-14T09:19:16.920 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:16.921 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-10-14T09:19:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 -- 172.21.15.78:0/3613647638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79080664a0 msgr2=0x7f7908068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79080664a0 0x7f7908068960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7924152ef0 tx=0x7f7914009040 comp rx=0 tx=0).stop 2023-10-14T09:19:16.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 -- 172.21.15.78:0/3613647638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79240c4810 msgr2=0x7f792414b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79240c4810 0x7f792414b9c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7920009710 tx=0x7f79200190d0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 -- 172.21.15.78:0/3613647638 shutdown_connections 2023-10-14T09:19:16.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7924154920 0x7f79241456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f79080664a0 0x7f7908068960 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f79241514b0 0x7f79241451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 --2- 172.21.15.78:0/3613647638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79240c4810 0x7f792414b9c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:16.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 -- 172.21.15.78:0/3613647638 >> 172.21.15.78:0/3613647638 conn(0x7f79240c9430 msgr2=0x7f7924151e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:16.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 -- 172.21.15.78:0/3613647638 shutdown_connections 2023-10-14T09:19:16.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:16.913+0000 7f792a33b640 1 -- 172.21.15.78:0/3613647638 wait complete. 2023-10-14T09:19:16.940 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-10-14T09:19:15.253576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":227788,"kb_used_data":3296,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754746932,"statfs":{"total":773094113280,"available":772860858368,"internally_reserved":0,"allocated":3375104,"data_stored":2449888,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":229756473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.916922"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-14T09:19:06.341935+0000","last_change":"2023-10-14T09:17:14.304224+0000","last_active":"2023-10-14T09:19:06.341935+0000","last_peered":"2023-10-14T09:19:06.341935+0000","last_clean":"2023-10-14T09:19:06.341935+0000","last_became_active":"2023-10-14T09:17:14.303743+0000","last_became_peered":"2023-10-14T09:17:14.303743+0000","last_unstale":"2023-10-14T09:19:06.341935+0000","last_undegraded":"2023-10-14T09:19:06.341935+0000","last_fullsized":"2023-10-14T09:19:06.341935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T09:17:13.285641+0000","last_clean_scrub_stamp":"2023-10-14T09:17:13.285641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:24.100243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":471040,"data_stored":749012,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.504},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.69799999999999995}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.82999999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.58499999999999996}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.89100000000000001}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.624},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.752}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.87},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.91000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.5389999999999997,"5min":5.5389999999999997,"15min":5.5389999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.60999999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.4489999999999998,"5min":5.4489999999999998,"15min":5.4489999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":5.4770000000000003,"5min":5.4770000000000003,"15min":5.4770000000000003},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":5.5119999999999996,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.751},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.71299999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.496}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52200000000000002}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.68500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.68100000000000005}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.70399999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.626},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.499},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.64100000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.63600000000000001}]},{"osd":2,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.76800000000000002}]},{"osd":3,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":6.6749999999999998,"5min":6.6749999999999998,"15min":6.6749999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.89800000000000002}]},{"osd":5,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.745}]},{"osd":6,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.99099999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":1.0640000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.496},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.51700000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.77300000000000002}]},{"osd":6,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Oct 14 09:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.75700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.499}]},{"osd":1,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.41799999999999998}]},{"osd":3,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":4.1680000000000001,"5min":4.1680000000000001,"15min":4.1680000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.75800000000000001}]},{"osd":5,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":4.4219999999999997},"last":0.69799999999999995}]},{"osd":6,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":4.5030000000000001,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.88800000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:18:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.5499999999999998,"5min":4.5499999999999998,"15min":4.5499999999999998},"last":0.82499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.505},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.748}]},{"osd":4,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.86599999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.83999999999999997}]},{"osd":6,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.94799999999999995}]},{"osd":7,"last update":"Sat Oct 14 09:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.97299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":749012,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.505}]},{"osd":4,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:19:16.946 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T09:17:13.285641+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=17, tm_sec=13, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=9, tm_min=19, tm_sec=11, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T09:19:16.946 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T09:19:25.477 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:19:25.482 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:19:36.947 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T09:19:37.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.085+0000 7f2c2869e640 1 Processor -- start 2023-10-14T09:19:37.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.085+0000 7f2c2869e640 1 -- start start 2023-10-14T09:19:37.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.085+0000 7f2c2869e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c200c1230 0x7f2c2006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.085+0000 7f2c2869e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2c2006d750 0x7f2c200c0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.085+0000 7f2c2869e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2006bcc0 con 0x7f2c200c0450 2023-10-14T09:19:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.085+0000 7f2c2869e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2006c340 con 0x7f2c2006d750 2023-10-14T09:19:37.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.085+0000 7f2c2869e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2006ce70 con 0x7f2c200c1230 2023-10-14T09:19:37.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.085+0000 7f2c2643a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2c200c0450 0x7f2c2006c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37942/0 (socket says 172.21.15.78:37942) 2023-10-14T09:19:37.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c2643a640 1 -- 172.21.15.78:0/590112546 learned_addr learned my addr 172.21.15.78:0/590112546 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:37.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c26c3b640 1 --2- 172.21.15.78:0/590112546 >> v2:172.21.15.78:3300/0 conn(0x7f2c2006d750 0x7f2c200c0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c25c39640 1 --2- 172.21.15.78:0/590112546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c200c1230 0x7f2c2006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c26c3b640 1 -- 172.21.15.78:0/590112546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c200c1230 msgr2=0x7f2c2006fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:37.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c26c3b640 1 --2- 172.21.15.78:0/590112546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c200c1230 0x7f2c2006fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c26c3b640 1 -- 172.21.15.78:0/590112546 >> v1:172.21.15.78:6789/0 conn(0x7f2c200c0450 legacy=0x7f2c2006c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c25438640 1 -- 172.21.15.78:0/590112546 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809212319 0 0) 0x7f2c2006bcc0 con 0x7f2c200c0450 2023-10-14T09:19:37.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c26c3b640 1 -- 172.21.15.78:0/590112546 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20150dd0 con 0x7f2c2006d750 2023-10-14T09:19:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c26c3b640 1 --2- 172.21.15.78:0/590112546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2006d750 0x7f2c200c0830 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009dc0 tx=0x7f2c1801d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7f6253ea25a64 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:37.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c25438640 1 -- 172.21.15.78:0/590112546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c180a5880 con 0x7f2c2006d750 2023-10-14T09:19:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c25438640 1 -- 172.21.15.78:0/590112546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c180a59e0 con 0x7f2c2006d750 2023-10-14T09:19:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.089+0000 7f2c25438640 1 -- 172.21.15.78:0/590112546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c180a5d70 con 0x7f2c2006d750 2023-10-14T09:19:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 -- 172.21.15.78:0/590112546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2006d750 msgr2=0x7f2c200c0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 --2- 172.21.15.78:0/590112546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2006d750 0x7f2c200c0830 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009dc0 tx=0x7f2c1801d390 comp rx=0 tx=0).stop 2023-10-14T09:19:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 -- 172.21.15.78:0/590112546 shutdown_connections 2023-10-14T09:19:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 --2- 172.21.15.78:0/590112546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2006d750 0x7f2c200c0830 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 --2- 172.21.15.78:0/590112546 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c200c1230 0x7f2c2006fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 -- 172.21.15.78:0/590112546 >> 172.21.15.78:0/590112546 conn(0x7f2c200c1cc0 msgr2=0x7f2c200c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:37.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 -- 172.21.15.78:0/590112546 shutdown_connections 2023-10-14T09:19:37.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 -- 172.21.15.78:0/590112546 wait complete. 2023-10-14T09:19:37.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 Processor -- start 2023-10-14T09:19:37.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 -- start start 2023-10-14T09:19:37.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2006d750 0x7f2c2014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c200c0450 0x7f2c200a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c200c1230 0x7f2c20142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200aabe0 con 0x7f2c2006d750 2023-10-14T09:19:37.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20152f90 con 0x7f2c200c0450 2023-10-14T09:19:37.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2869e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20143770 con 0x7f2c200c1230 2023-10-14T09:19:37.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2643a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2006d750 0x7f2c2014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2643a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2006d750 0x7f2c2014f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43790/0 (socket says 172.21.15.78:43790) 2023-10-14T09:19:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2643a640 1 -- 172.21.15.78:0/2019602560 learned_addr learned my addr 172.21.15.78:0/2019602560 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c26c3b640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c200c1230 0x7f2c20142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c25c39640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c200c0450 0x7f2c200a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2643a640 1 -- 172.21.15.78:0/2019602560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c200c1230 msgr2=0x7f2c20142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2643a640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c200c1230 0x7f2c20142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2643a640 1 -- 172.21.15.78:0/2019602560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c200c0450 msgr2=0x7f2c200a9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2643a640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c200c0450 0x7f2c200a9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.093+0000 7f2c2643a640 1 -- 172.21.15.78:0/2019602560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c18009a70 con 0x7f2c2006d750 2023-10-14T09:19:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.097+0000 7f2c2643a640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2006d750 0x7f2c2014f2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00c480 tx=0x7f2c1c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.097+0000 7f2c16ffd640 1 -- 172.21.15.78:0/2019602560 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c0074e0 con 0x7f2c2006d750 2023-10-14T09:19:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.097+0000 7f2c16ffd640 1 -- 172.21.15.78:0/2019602560 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c007660 con 0x7f2c2006d750 2023-10-14T09:19:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.097+0000 7f2c16ffd640 1 -- 172.21.15.78:0/2019602560 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c004a30 con 0x7f2c2006d750 2023-10-14T09:19:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.097+0000 7f2c2869e640 1 -- 172.21.15.78:0/2019602560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c201439c0 con 0x7f2c2006d750 2023-10-14T09:19:37.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.097+0000 7f2c2869e640 1 -- 172.21.15.78:0/2019602560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2014f830 con 0x7f2c2006d750 2023-10-14T09:19:37.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.097+0000 7f2c2869e640 1 -- 172.21.15.78:0/2019602560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c201efda0 con 0x7f2c2006d750 2023-10-14T09:19:37.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.097+0000 7f2c16ffd640 1 -- 172.21.15.78:0/2019602560 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2c1c004b90 con 0x7f2c2006d750 2023-10-14T09:19:37.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.097+0000 7f2c16ffd640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2c040664a0 0x7f2c04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.097+0000 7f2c16ffd640 1 -- 172.21.15.78:0/2019602560 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2c1c082d70 con 0x7f2c2006d750 2023-10-14T09:19:37.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.097+0000 7f2c25c39640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2c040664a0 0x7f2c04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.101+0000 7f2c25c39640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2c040664a0 0x7f2c04068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2c20150920 tx=0x7f2c10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:37.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.101+0000 7f2c16ffd640 1 -- 172.21.15.78:0/2019602560 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2c1c053f70 con 0x7f2c2006d750 2023-10-14T09:19:37.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.249+0000 7f2c2869e640 1 -- 172.21.15.78:0/2019602560 --> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c200aa960 con 0x7f2c040664a0 2023-10-14T09:19:37.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.249+0000 7f2c16ffd640 1 -- 172.21.15.78:0/2019602560 <== mgr.4106 v2:172.21.15.78:6832/3520689651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50525 (secure 0 0 0) 0x7f2c200aa960 con 0x7f2c040664a0 2023-10-14T09:19:37.258 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:37.259 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-10-14T09:19:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 -- 172.21.15.78:0/2019602560 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2c040664a0 msgr2=0x7f2c04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2c040664a0 0x7f2c04068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2c20150920 tx=0x7f2c10008040 comp rx=0 tx=0).stop 2023-10-14T09:19:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 -- 172.21.15.78:0/2019602560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2006d750 msgr2=0x7f2c2014f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2006d750 0x7f2c2014f2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00c480 tx=0x7f2c1c00c940 comp rx=0 tx=0).stop 2023-10-14T09:19:37.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 -- 172.21.15.78:0/2019602560 shutdown_connections 2023-10-14T09:19:37.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f2c040664a0 0x7f2c04068960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2c200c1230 0x7f2c20142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c200c0450 0x7f2c200a9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 --2- 172.21.15.78:0/2019602560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2006d750 0x7f2c2014f2f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 -- 172.21.15.78:0/2019602560 >> 172.21.15.78:0/2019602560 conn(0x7f2c200c1cc0 msgr2=0x7f2c20146c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:37.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 -- 172.21.15.78:0/2019602560 shutdown_connections 2023-10-14T09:19:37.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.253+0000 7f2c2869e640 1 -- 172.21.15.78:0/2019602560 wait complete. 2023-10-14T09:19:37.280 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-10-14T09:19:35.257763+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":227776,"kb_used_data":3296,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754746944,"statfs":{"total":773094113280,"available":772860870656,"internally_reserved":0,"allocated":3375104,"data_stored":2449888,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12743,"internal_metadata":229756473},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002500"},"pg_stats":[{"pgid":"1.0","version":"35'119","reported_seq":190,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T09:19:18.115912+0000","last_change":"2023-10-14T09:19:18.115971+0000","last_active":"2023-10-14T09:19:18.115912+0000","last_peered":"2023-10-14T09:19:18.115912+0000","last_clean":"2023-10-14T09:19:18.115912+0000","last_became_active":"2023-10-14T09:17:14.303743+0000","last_became_peered":"2023-10-14T09:17:14.303743+0000","last_unstale":"2023-10-14T09:19:18.115912+0000","last_undegraded":"2023-10-14T09:19:18.115912+0000","last_fullsized":"2023-10-14T09:19:18.115912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2023-10-14T09:19:18.115813+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2023-10-14T09:19:18.115813+0000","last_clean_scrub_stamp":"2023-10-14T09:19:18.115813+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:24:15.263856+0000","scrub_duration":0.006522112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67300,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":471040,"data_stored":749012,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71599999999999997,"15min":0.71499999999999997},"min":{"1min":0.46200000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1479999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.56699999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89200000000000002,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.78900000000000003}]},{"osd":1,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.69399999999999995,"15min":0.68200000000000005},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.101,"5min":1.129,"15min":1.129},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.51900000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0009999999999999,"5min":1.196,"15min":1.196},"last":0.67500000000000004}]},{"osd":2,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.71399999999999997,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78400000000000003,"15min":0.78600000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0720000000000001,"5min":1.8009999999999999,"15min":1.8009999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.72799999999999998,"15min":0.71799999999999997},"min":{"1min":0.59899999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.80400000000000005,"15min":0.80200000000000005},"min":{"1min":0.64600000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.115,"5min":1.831,"15min":1.831},"last":0.74399999999999999}]},{"osd":4,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.137,"5min":1.389,"15min":1.389},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.70299999999999996,"15min":0.69599999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.72299999999999998}]},{"osd":5,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.79200000000000004,"15min":0.81000000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.202,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.339,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.65600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.91100000000000003,"15min":0.95299999999999996},"min":{"1min":0.497,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93500000000000005,"5min":5.5389999999999997,"15min":5.5389999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95299999999999996,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.84699999999999998}]},{"osd":1,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.94399999999999995,"15min":0.97999999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.93200000000000005,"5min":5.4489999999999998,"15min":5.4489999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.90000000000000002,"5min":1.157,"15min":1.157},"last":0.73699999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.91300000000000003,"15min":0.94699999999999995},"min":{"1min":0.46000000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.86899999999999999,"5min":5.4770000000000003,"15min":5.4770000000000003},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73099999999999998,"15min":0.73799999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.84899999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.96499999999999997}]},{"osd":3,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.97199999999999998,"15min":1.014},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94499999999999995,"5min":5.5119999999999996,"15min":5.5119999999999996},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.76800000000000002}]},{"osd":4,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66700000000000004,"15min":0.67500000000000004},"min":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73599999999999999,"15min":0.75},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.84599999999999997,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.98999999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.75,"15min":0.76200000000000001},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98299999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.77300000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.89300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.497,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83899999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.69499999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86499999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61199999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85699999999999998,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71599999999999997,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86599999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.79300000000000004}]},{"osd":2,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.57499999999999996,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.81899999999999995,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.50700000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93100000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.66900000000000004}]},{"osd":3,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.89900000000000002,"5min":1.296,"15min":1.296},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.92800000000000005,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.746}]},{"osd":4,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.39400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.77800000000000002,"5min":1.113,"15min":1.113},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78200000000000003,"15min":0.79700000000000004},"min":{"1min":0.504,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.496}]},{"osd":6,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85599999999999998,"5min":1.327,"15min":1.327},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94899999999999995,"5min":1.175,"15min":1.175},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.81200000000000006,"15min":0.82299999999999995},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92800000000000005,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95799999999999996,"5min":1.464,"15min":1.464},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.751,"15min":0.75900000000000001},"min":{"1min":0.45500000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85399999999999998,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.78400000000000003,"15min":0.79900000000000004},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.81299999999999994,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.57899999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94899999999999995,"5min":1.881,"15min":1.881},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.57199999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.86699999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.75}]},{"osd":2,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.80200000000000005,"15min":0.81999999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.90100000000000002,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.85499999999999998,"15min":0.87},"min":{"1min":0.52800000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.95099999999999996,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.79500000000000004}]},{"osd":3,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":1.0640000000000001,"15min":1.0860000000000001},"min":{"1min":0.60599999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.9980000000000002,"5min":6.6749999999999998,"15min":6.6749999999999998},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.878,"5min":0.86599999999999999,"15min":0.86399999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":3.9420000000000002,"5min":3.9420000000000002,"15min":3.9420000000000002},"last":0.72299999999999998}]},{"osd":5,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66700000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.84899999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.434}]},{"osd":6,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.80200000000000005,"15min":0.79000000000000004},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":4.0469999999999997,"5min":4.0469999999999997,"15min":4.0469999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.99099999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93999999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.81899999999999995,"15min":0.80100000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.0919999999999996,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.77300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42799999999999999,"15min":0.42999999999999999},"min":{"1min":0.27100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.377},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.61699999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Sat Oct 14 09:19:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.32600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67300000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65800000000000003,"5min":0.87,"15min":0.87},"last":0.58299999999999996}]},{"osd":2,"last update":"Sat Oct 14 09:19:18 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.40100000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.63500000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.621,"15min":0.63700000000000001},"min":{"1min":0.39800000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.66700000000000004,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Oct 14 09:19:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.876,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.52200000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.995,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.79800000000000004}]},{"osd":5,"last update":"Sat Oct 14 09:19:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.86899999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.84199999999999997,"15min":0.86099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.95399999999999996,"5min":1.911,"15min":1.911},"last":0.86799999999999999}]},{"osd":6,"last update":"Sat Oct 14 09:19:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.86899999999999999,"15min":0.88900000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95199999999999996,"5min":1.837,"15min":1.837},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.872,"15min":0.89600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.94299999999999995,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:19:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.89400000000000002,"15min":0.91400000000000003},"min":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97499999999999998,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.83299999999999996,"15min":0.84699999999999998},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.93100000000000005,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.88500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.64300000000000002,"5min":1.369,"15min":1.369},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.66800000000000004,"5min":1.659,"15min":1.659},"last":0.48599999999999999}]},{"osd":1,"last update":"Sat Oct 14 09:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.63100000000000001,"15min":0.65900000000000003},"min":{"1min":0.33200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.74099999999999999,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.53300000000000003,"15min":0.53800000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90200000000000002,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.45600000000000002}]},{"osd":3,"last update":"Sat Oct 14 09:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.70399999999999996,"15min":0.73199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77600000000000002,"5min":4.1680000000000001,"15min":4.1680000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.42499999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.748,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Oct 14 09:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.57199999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97999999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.73099999999999998,"15min":0.72799999999999998},"min":{"1min":0.56499999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.113,"5min":1.522,"15min":1.522},"last":0.80000000000000004}]},{"osd":5,"last update":"Sat Oct 14 09:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.58699999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.998,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.94599999999999995,"15min":0.97399999999999998},"min":{"1min":0.61399999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1339999999999999,"5min":4.4219999999999997,"15min":4.4219999999999997},"last":0.81399999999999995}]},{"osd":6,"last update":"Sat Oct 14 09:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.93799999999999994,"15min":0.96699999999999997},"min":{"1min":0.55100000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96699999999999997,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0780000000000001,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Oct 14 09:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.054,"5min":1.625,"15min":1.625},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.97799999999999998,"15min":1.0109999999999999},"min":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.093,"5min":4.5499999999999998,"15min":4.5499999999999998},"last":0.745}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":158644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 09:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44800000000000001,"15min":0.45100000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60099999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72899999999999998,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Oct 14 09:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.32300000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.62,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.432},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53600000000000003,"15min":0.54100000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.55800000000000005}]},{"osd":3,"last update":"Sat Oct 14 09:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.83399999999999996,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.625},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.36799999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60499999999999998}]},{"osd":4,"last update":"Sat Oct 14 09:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.875,"5min":1.538,"15min":1.538},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.81000000000000005},"min":{"1min":0.60699999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.95399999999999996,"5min":1.411,"15min":1.411},"last":1.0409999999999999}]},{"osd":5,"last update":"Sat Oct 14 09:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79600000000000004,"15min":0.79700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0309999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.84899999999999998,"15min":0.86299999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.98599999999999999,"5min":2.27,"15min":2.27},"last":0.93000000000000005}]},{"osd":6,"last update":"Sat Oct 14 09:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80500000000000005,"15min":0.80800000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.004,"5min":1.244,"15min":1.244},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94799999999999995,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.91000000000000003}]},{"osd":7,"last update":"Sat Oct 14 09:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.85399999999999998,"15min":0.85999999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95799999999999996,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81999999999999995,"15min":0.82999999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.97299999999999998,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.94299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":471040,"data_stored":749012,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40200000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.60299999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.44900000000000001,"15min":0.45100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.59899999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76100000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.505}]},{"osd":3,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50600000000000001,"15min":0.505},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.66600000000000004,"5min":0.874,"15min":0.874},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73699999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.54600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.004,"5min":1.419,"15min":1.419},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89900000000000002,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.92100000000000004}]},{"osd":5,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.57099999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93899999999999995,"5min":1.444,"15min":1.444},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97599999999999998,"5min":1.206,"15min":1.206},"last":0.89400000000000002}]},{"osd":6,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.92700000000000005,"5min":1.494,"15min":1.494},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.018,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.86799999999999999}]},{"osd":7,"last update":"Sat Oct 14 09:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.80800000000000005,"15min":0.81599999999999995},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.91200000000000003,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.86099999999999999,"15min":0.871},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.034,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.83899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33650,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T09:19:37.282 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T09:19:37.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f617d6d6640 1 Processor -- start 2023-10-14T09:19:37.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f617d6d6640 1 -- start start 2023-10-14T09:19:37.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f617d6d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617806cc50 0x7f61780c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f617d6d6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61780c7af0 con 0x7f6178153d90 2023-10-14T09:19:37.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f617d6d6640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6178157360 con 0x7f61780c4030 2023-10-14T09:19:37.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f617d6d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61780c5300 con 0x7f617806cc50 2023-10-14T09:19:37.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f61777fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6178153d90 0x7f61781541c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37944/0 (socket says 172.21.15.78:37944) 2023-10-14T09:19:37.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f61777fe640 1 -- 172.21.15.78:0/3686478159 learned_addr learned my addr 172.21.15.78:0/3686478159 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:37.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f616e7fc640 1 --2- 172.21.15.78:0/3686478159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617806cc50 0x7f61780c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f61767fc640 1 -- 172.21.15.78:0/3686478159 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241533707 0 0) 0x7f61780c7af0 con 0x7f6178153d90 2023-10-14T09:19:37.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f61767fc640 1 -- 172.21.15.78:0/3686478159 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6164003530 con 0x7f6178153d90 2023-10-14T09:19:37.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f61767fc640 1 -- 172.21.15.78:0/3686478159 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846513619 0 0) 0x7f6178157360 con 0x7f61780c4030 2023-10-14T09:19:37.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f616e7fc640 1 -- 172.21.15.78:0/3686478159 >> v1:172.21.15.157:6789/0 conn(0x7f61780c4030 legacy=0x7f61780c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f616e7fc640 1 -- 172.21.15.78:0/3686478159 >> v1:172.21.15.78:6789/0 conn(0x7f6178153d90 legacy=0x7f61781541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.413+0000 7f616e7fc640 1 -- 172.21.15.78:0/3686478159 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6178157ee0 con 0x7f617806cc50 2023-10-14T09:19:37.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.417+0000 7f616e7fc640 1 --2- 172.21.15.78:0/3686478159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617806cc50 0x7f61780c75b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f61600097f0 tx=0x7f616001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f8b12ca48f972 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:37.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.417+0000 7f61767fc640 1 -- 172.21.15.78:0/3686478159 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61600a7070 con 0x7f617806cc50 2023-10-14T09:19:37.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.417+0000 7f61767fc640 1 -- 172.21.15.78:0/3686478159 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61600ab430 con 0x7f617806cc50 2023-10-14T09:19:37.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.417+0000 7f61767fc640 1 -- 172.21.15.78:0/3686478159 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61600ab7c0 con 0x7f617806cc50 2023-10-14T09:19:37.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.417+0000 7f617d6d6640 1 -- 172.21.15.78:0/3686478159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617806cc50 msgr2=0x7f61780c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.417+0000 7f617d6d6640 1 --2- 172.21.15.78:0/3686478159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617806cc50 0x7f61780c75b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f61600097f0 tx=0x7f616001c430 comp rx=0 tx=0).stop 2023-10-14T09:19:37.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.417+0000 7f617d6d6640 1 -- 172.21.15.78:0/3686478159 shutdown_connections 2023-10-14T09:19:37.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.417+0000 7f617d6d6640 1 --2- 172.21.15.78:0/3686478159 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617806cc50 0x7f61780c75b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.417+0000 7f617d6d6640 1 -- 172.21.15.78:0/3686478159 >> 172.21.15.78:0/3686478159 conn(0x7f61780ab240 msgr2=0x7f61780ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:37.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.417+0000 7f617d6d6640 1 -- 172.21.15.78:0/3686478159 shutdown_connections 2023-10-14T09:19:37.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.417+0000 7f617d6d6640 1 -- 172.21.15.78:0/3686478159 wait complete. 2023-10-14T09:19:37.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f617d6d6640 1 Processor -- start 2023-10-14T09:19:37.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f617d6d6640 1 -- start start 2023-10-14T09:19:37.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f617d6d6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617806cc50 0x7f61780bd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f617d6d6640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61780c4030 0x7f617814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f617d6d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6178153d90 0x7f617814ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f617d6d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61780be8b0 con 0x7f6178153d90 2023-10-14T09:19:37.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f617d6d6640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6178152c80 con 0x7f61780c4030 2023-10-14T09:19:37.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f617d6d6640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61781527f0 con 0x7f617806cc50 2023-10-14T09:19:37.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f61777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6178153d90 0x7f617814ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f61777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6178153d90 0x7f617814ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43800/0 (socket says 172.21.15.78:43800) 2023-10-14T09:19:37.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f61777fe640 1 -- 172.21.15.78:0/2209511717 learned_addr learned my addr 172.21.15.78:0/2209511717 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:37.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f616e7fc640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61780c4030 0x7f617814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f6176ffd640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617806cc50 0x7f61780bd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f61777fe640 1 -- 172.21.15.78:0/2209511717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617806cc50 msgr2=0x7f61780bd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f61777fe640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617806cc50 0x7f61780bd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f61777fe640 1 -- 172.21.15.78:0/2209511717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61780c4030 msgr2=0x7f617814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f61777fe640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61780c4030 0x7f617814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f61777fe640 1 -- 172.21.15.78:0/2209511717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6160009420 con 0x7f6178153d90 2023-10-14T09:19:37.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f61777fe640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6178153d90 0x7f617814ce80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f617000ca20 tx=0x7f617000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:37.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f616ffff640 1 -- 172.21.15.78:0/2209511717 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000abd0 con 0x7f6178153d90 2023-10-14T09:19:37.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f616ffff640 1 -- 172.21.15.78:0/2209511717 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617000ad30 con 0x7f6178153d90 2023-10-14T09:19:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f617d6d6640 1 -- 172.21.15.78:0/2209511717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61780c6610 con 0x7f6178153d90 2023-10-14T09:19:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f616ffff640 1 -- 172.21.15.78:0/2209511717 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000aea0 con 0x7f6178153d90 2023-10-14T09:19:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.421+0000 7f617d6d6640 1 -- 172.21.15.78:0/2209511717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61780c3460 con 0x7f6178153d90 2023-10-14T09:19:37.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.425+0000 7f617d6d6640 1 -- 172.21.15.78:0/2209511717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6178152960 con 0x7f6178153d90 2023-10-14T09:19:37.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.425+0000 7f616ffff640 1 -- 172.21.15.78:0/2209511717 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6170007070 con 0x7f6178153d90 2023-10-14T09:19:37.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.425+0000 7f616ffff640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f61580664d0 0x7f6158068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.425+0000 7f616ffff640 1 -- 172.21.15.78:0/2209511717 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f61700839a0 con 0x7f6178153d90 2023-10-14T09:19:37.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.425+0000 7f6176ffd640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f61580664d0 0x7f6158068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.425+0000 7f6176ffd640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f61580664d0 0x7f6158068990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6168000f70 tx=0x7f6168009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:37.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.429+0000 7f616ffff640 1 -- 172.21.15.78:0/2209511717 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f61700511c0 con 0x7f6178153d90 2023-10-14T09:19:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.581+0000 7f617d6d6640 1 -- 172.21.15.78:0/2209511717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f6178074110 con 0x7f6178153d90 2023-10-14T09:19:37.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.585+0000 7f616ffff640 1 -- 172.21.15.78:0/2209511717 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v15)=0 v15) v1 ==== 123+0+0 (secure 0 0 0) 0x7f61700170c0 con 0x7f6178153d90 2023-10-14T09:19:37.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.585+0000 7f616ffff640 1 -- 172.21.15.78:0/2209511717 <== mon.0 v2:172.21.15.78:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f61700511c0 con 0x7f6178153d90 2023-10-14T09:19:37.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 -- 172.21.15.78:0/2209511717 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f61580664d0 msgr2=0x7f6158068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f61580664d0 0x7f6158068990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6168000f70 tx=0x7f6168009040 comp rx=0 tx=0).stop 2023-10-14T09:19:37.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 -- 172.21.15.78:0/2209511717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6178153d90 msgr2=0x7f617814ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6178153d90 0x7f617814ce80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f617000ca20 tx=0x7f617000cee0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 -- 172.21.15.78:0/2209511717 shutdown_connections 2023-10-14T09:19:37.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6178153d90 0x7f617814ce80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f61780c4030 0x7f617814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f61580664d0 0x7f6158068990 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 --2- 172.21.15.78:0/2209511717 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f617806cc50 0x7f61780bd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 -- 172.21.15.78:0/2209511717 >> 172.21.15.78:0/2209511717 conn(0x7f61780ab240 msgr2=0x7f61781517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:37.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 -- 172.21.15.78:0/2209511717 shutdown_connections 2023-10-14T09:19:37.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.589+0000 7f617d6d6640 1 -- 172.21.15.78:0/2209511717 wait complete. 2023-10-14T09:19:37.615 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T09:19:37.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:19:37.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.745+0000 7f48b9017640 1 Processor -- start 2023-10-14T09:19:37.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.745+0000 7f48b9017640 1 -- start start 2023-10-14T09:19:37.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.745+0000 7f48b9017640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f48b4157370 0x7f48b41549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.745+0000 7f48b9017640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48b40be950 0x7f48b4071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.745+0000 7f48b9017640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b41578e0 con 0x7f48b40be570 2023-10-14T09:19:37.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.745+0000 7f48b9017640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b406ffd0 con 0x7f48b4157370 2023-10-14T09:19:37.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.745+0000 7f48b9017640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40bee00 con 0x7f48b40be950 2023-10-14T09:19:37.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48b359e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48b40be950 0x7f48b4071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48abfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f48b4157370 0x7f48b41549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48b2d9d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f48b40be570 0x7f48b4071120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.78:35686/0 (socket says 172.21.15.78:35686) 2023-10-14T09:19:37.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48b2d9d640 1 -- 172.21.15.78:0/1218123564 learned_addr learned my addr 172.21.15.78:0/1218123564 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-10-14T09:19:37.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48b259c640 1 -- 172.21.15.78:0/1218123564 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757857045 0 0) 0x7f48b41578e0 con 0x7f48b40be570 2023-10-14T09:19:37.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48b259c640 1 -- 172.21.15.78:0/1218123564 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a0003530 con 0x7f48b40be570 2023-10-14T09:19:37.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48abfff640 1 -- 172.21.15.78:0/1218123564 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48b40be950 msgr2=0x7f48b4071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:19:37.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48abfff640 1 --2- 172.21.15.78:0/1218123564 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48b40be950 0x7f48b4071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48abfff640 1 -- 172.21.15.78:0/1218123564 >> v1:172.21.15.157:6789/0 conn(0x7f48b40be570 legacy=0x7f48b4071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48abfff640 1 -- 172.21.15.78:0/1218123564 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4157bc0 con 0x7f48b4157370 2023-10-14T09:19:37.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48b359e640 1 --2- 172.21.15.78:0/1218123564 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48b40be950 0x7f48b4071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:19:37.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48abfff640 1 --2- 172.21.15.78:0/1218123564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48b4157370 0x7f48b41549c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f489c0097c0 tx=0x7f489c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12cd6eeb0f24a5de server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:37.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48b259c640 1 -- 172.21.15.78:0/1218123564 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c0ab650 con 0x7f48b4157370 2023-10-14T09:19:37.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48b259c640 1 -- 172.21.15.78:0/1218123564 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f489c0ab7b0 con 0x7f48b4157370 2023-10-14T09:19:37.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.749+0000 7f48b259c640 1 -- 172.21.15.78:0/1218123564 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c0abb60 con 0x7f48b4157370 2023-10-14T09:19:37.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 -- 172.21.15.78:0/1218123564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48b4157370 msgr2=0x7f48b41549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 --2- 172.21.15.78:0/1218123564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48b4157370 0x7f48b41549c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f489c0097c0 tx=0x7f489c01c450 comp rx=0 tx=0).stop 2023-10-14T09:19:37.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 -- 172.21.15.78:0/1218123564 shutdown_connections 2023-10-14T09:19:37.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 --2- 172.21.15.78:0/1218123564 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48b40be950 0x7f48b4071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 --2- 172.21.15.78:0/1218123564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48b4157370 0x7f48b41549c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 -- 172.21.15.78:0/1218123564 >> 172.21.15.78:0/1218123564 conn(0x7f48b40c1cc0 msgr2=0x7f48b40c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:37.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 -- 172.21.15.78:0/1218123564 shutdown_connections 2023-10-14T09:19:37.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 -- 172.21.15.78:0/1218123564 wait complete. 2023-10-14T09:19:37.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 Processor -- start 2023-10-14T09:19:37.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 -- start start 2023-10-14T09:19:37.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48b40be570 0x7f48b40c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48b40be950 0x7f48b412f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48b4157370 0x7f48b413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40c3160 con 0x7f48b40be950 2023-10-14T09:19:37.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40c2e10 con 0x7f48b4157370 2023-10-14T09:19:37.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b9017640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40c4e40 con 0x7f48b40be570 2023-10-14T09:19:37.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48abfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48b40be950 0x7f48b412f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b2d9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48b40be570 0x7f48b40c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48b359e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48b4157370 0x7f48b413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48abfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48b40be950 0x7f48b412f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43816/0 (socket says 172.21.15.78:43816) 2023-10-14T09:19:37.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48abfff640 1 -- 172.21.15.78:0/3303627714 learned_addr learned my addr 172.21.15.78:0/3303627714 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-10-14T09:19:37.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48abfff640 1 -- 172.21.15.78:0/3303627714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48b40be570 msgr2=0x7f48b40c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48abfff640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48b40be570 0x7f48b40c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.753+0000 7f48abfff640 1 -- 172.21.15.78:0/3303627714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48b4157370 msgr2=0x7f48b413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48abfff640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48b4157370 0x7f48b413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48abfff640 1 -- 172.21.15.78:0/3303627714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac009a70 con 0x7f48b40be950 2023-10-14T09:19:37.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48abfff640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48b40be950 0x7f48b412f950 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f489c01a080 tx=0x7f489c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:37.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48ab7fe640 1 -- 172.21.15.78:0/3303627714 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c0abdb0 con 0x7f48b40be950 2023-10-14T09:19:37.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48ab7fe640 1 -- 172.21.15.78:0/3303627714 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f489c0bf450 con 0x7f48b40be950 2023-10-14T09:19:37.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48ab7fe640 1 -- 172.21.15.78:0/3303627714 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c0bf820 con 0x7f48b40be950 2023-10-14T09:19:37.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48b9017640 1 -- 172.21.15.78:0/3303627714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c009420 con 0x7f48b40be950 2023-10-14T09:19:37.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48b9017640 1 -- 172.21.15.78:0/3303627714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b4151990 con 0x7f48b40be950 2023-10-14T09:19:37.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48b9017640 1 -- 172.21.15.78:0/3303627714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b4074180 con 0x7f48b40be950 2023-10-14T09:19:37.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48ab7fe640 1 -- 172.21.15.78:0/3303627714 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f489c0bf980 con 0x7f48b40be950 2023-10-14T09:19:37.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48ab7fe640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f48940664a0 0x7f4894068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:19:37.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48ab7fe640 1 -- 172.21.15.78:0/3303627714 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f489c11e450 con 0x7f48b40be950 2023-10-14T09:19:37.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.757+0000 7f48b2d9d640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f48940664a0 0x7f4894068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:19:37.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.761+0000 7f48b2d9d640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f48940664a0 0x7f4894068960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f48a40011f0 tx=0x7f48a4007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:19:37.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.761+0000 7f48ab7fe640 1 -- 172.21.15.78:0/3303627714 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f489c0ebbc0 con 0x7f48b40be950 2023-10-14T09:19:37.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.949+0000 7f48b9017640 1 -- 172.21.15.78:0/3303627714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48b413c790 con 0x7f48b40be950 2023-10-14T09:19:37.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.949+0000 7f48ab7fe640 1 -- 172.21.15.78:0/3303627714 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f489c0ef1e0 con 0x7f48b40be950 2023-10-14T09:19:37.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-10-14T09:19:37.959 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5002,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/2822193022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":2822193022},{"type":"v1","addr":"172.21.15.157:6833","nonce":2822193022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5005,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/488302185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":488302185},{"type":"v1","addr":"172.21.15.157:6835","nonce":488302185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3378161275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3378161275},{"type":"v1","addr":"172.21.15.78:6835","nonce":3378161275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5571,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2519877620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":2519877620},{"type":"v1","addr":"172.21.15.78:6837","nonce":2519877620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-10-14T09:19:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 19 2023-10-14T09:19:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 -- 172.21.15.78:0/3303627714 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f48940664a0 msgr2=0x7f4894068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f48940664a0 0x7f4894068960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f48a40011f0 tx=0x7f48a4007d40 comp rx=0 tx=0).stop 2023-10-14T09:19:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 -- 172.21.15.78:0/3303627714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48b40be950 msgr2=0x7f48b412f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:19:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48b40be950 0x7f48b412f950 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f489c01a080 tx=0x7f489c0191f0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 -- 172.21.15.78:0/3303627714 shutdown_connections 2023-10-14T09:19:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48b4157370 0x7f48b413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48b40be950 0x7f48b412f950 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.78:6832/3520689651,v1:172.21.15.78:6833/3520689651] conn(0x7f48940664a0 0x7f4894068960 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 --2- 172.21.15.78:0/3303627714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48b40be570 0x7f48b40c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:19:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 -- 172.21.15.78:0/3303627714 >> 172.21.15.78:0/3303627714 conn(0x7f48b40c1cc0 msgr2=0x7f48b40c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:19:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 -- 172.21.15.78:0/3303627714 shutdown_connections 2023-10-14T09:19:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-10-14T09:19:37.953+0000 7f48b9017640 1 -- 172.21.15.78:0/3303627714 wait complete. 2023-10-14T09:19:37.979 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-14T09:19:37.979 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T09:19:37.980 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T09:19:37.980 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:37.990 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T09:19:37.991 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T09:19:37.991 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:38.045 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T09:19:38.046 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T09:19:38.047 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:38.061 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T09:19:38.062 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T09:19:38.062 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:38.119 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T09:19:38.120 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T09:19:38.120 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T09:19:38.121 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:38.201 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T09:19:38.201 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T09:19:38.202 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:38.296 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T09:19:38.297 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T09:19:38.297 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:38.385 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T09:19:38.385 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-14T09:19:38.386 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:38.468 INFO:tasks.ceph.osd.3:Stopped 2023-10-14T09:19:38.469 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-14T09:19:38.469 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:38.546 INFO:tasks.ceph.osd.4:Stopped 2023-10-14T09:19:38.547 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-14T09:19:38.547 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:38.614 INFO:tasks.ceph.osd.5:Stopped 2023-10-14T09:19:38.616 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-14T09:19:38.616 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:44.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-14T09:19:44.718 INFO:tasks.ceph.osd.6:Stopped 2023-10-14T09:19:44.719 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-14T09:19:44.719 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:44.779 INFO:tasks.ceph.osd.7:Stopped 2023-10-14T09:19:44.780 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T09:19:44.780 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-14T09:19:44.781 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:44.837 INFO:tasks.ceph.mgr.y:Stopped 2023-10-14T09:19:44.838 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T09:19:44.838 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:44.891 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T09:19:44.891 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T09:19:44.892 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T09:19:44.892 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:44.912 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T09:19:44.912 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-14T09:19:44.913 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:44.930 INFO:tasks.ceph.mon.b:Stopped 2023-10-14T09:19:44.931 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-14T09:19:44.931 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T09:19:44.991 INFO:tasks.ceph.mon.c:Stopped 2023-10-14T09:19:44.992 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T09:19:44.992 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v '\(MDS_INSUFFICIENT_STANDBY\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(FS_DEGRADED\)' | head -n 1 2023-10-14T09:19:45.027 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:19:45.028 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T09:19:45.353 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:19:45.354 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T09:19:45.497 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:19:45.497 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T09:19:45.640 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:19:45.641 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-14T09:19:45.789 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:19:45.790 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-14T09:19:45.905 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:19:45.905 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-14T09:19:46.042 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:19:46.043 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-14T09:19:46.178 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:19:46.178 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-14T09:19:46.325 INFO:tasks.ceph:Archiving mon data... 2023-10-14T09:19:46.326 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143/data/mon.a.tgz 2023-10-14T09:19:46.327 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-10-14T09:19:46.336 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.i7wXszNZUP 2023-10-14T09:19:46.337 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.i7wXszNZUP 2023-10-14T09:19:46.452 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.i7wXszNZUP 2023-10-14T09:19:46.527 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.i7wXszNZUP is 283KB 2023-10-14T09:19:46.596 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.i7wXszNZUP 2023-10-14T09:19:46.605 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143/data/mon.b.tgz 2023-10-14T09:19:46.605 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2023-10-14T09:19:46.615 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.Pz623jkzKm 2023-10-14T09:19:46.615 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Pz623jkzKm 2023-10-14T09:19:46.754 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.Pz623jkzKm 2023-10-14T09:19:46.833 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.Pz623jkzKm is 377KB 2023-10-14T09:19:46.895 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.Pz623jkzKm 2023-10-14T09:19:46.904 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143/data/mon.c.tgz 2023-10-14T09:19:46.905 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2023-10-14T09:19:46.957 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.QCbvyS85MU 2023-10-14T09:19:46.958 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QCbvyS85MU 2023-10-14T09:19:47.095 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.QCbvyS85MU 2023-10-14T09:19:47.170 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.QCbvyS85MU is 377KB 2023-10-14T09:19:47.231 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.QCbvyS85MU 2023-10-14T09:19:47.242 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T09:19:47.242 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T09:19:47.246 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T09:19:47.305 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T09:19:47.306 DEBUG:teuthology.orchestra.run.smithi078:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T09:19:47.312 DEBUG:teuthology.orchestra.run.smithi157:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T09:19:47.344 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T09:19:47.388 INFO:teuthology.orchestra.run.smithi157.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T09:19:47.395 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T09:19:47.396 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143/remote/smithi078/crash 2023-10-14T09:19:47.398 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T09:19:47.419 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143/remote/smithi157/crash 2023-10-14T09:19:47.420 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T09:19:47.460 INFO:tasks.ceph:Shutting down logrotate 2023-10-14T09:19:47.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:19:47.465 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T09:19:47.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T09:19:47.578 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T09:19:47.598 INFO:tasks.ceph:Compressing logs... 2023-10-14T09:19:47.599 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T09:19:47.625 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T09:19:47.646 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47737.log 2023-10-14T09:19:47.647 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47503.log 2023-10-14T09:19:47.648 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44537.log 2023-10-14T09:19:47.648 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47737.log.gz 2023-10-14T09:19:47.649 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44459.log 2023-10-14T09:19:47.649 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47503.log.gz 2023-10-14T09:19:47.651 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47659.log 2023-10-14T09:19:47.652 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44537.log.gz 2023-10-14T09:19:47.652 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45254.log 2023-10-14T09:19:47.652 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44459.log.gz 2023-10-14T09:19:47.653 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43502.log 2023-10-14T09:19:47.653 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47659.log.gz 2023-10-14T09:19:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45254.log: gzip -5 --verbose 88.6% -- -- replaced with /var/log/ceph/ceph-client.admin.45254.log.gz /var/log/ceph/ceph-client.admin.46041.log 2023-10-14T09:19:47.654 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-10-14T09:19:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45358.log 2023-10-14T09:19:47.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43502.log.gz 2023-10-14T09:19:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46041.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46041.log.gz 2023-10-14T09:19:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44303.log 2023-10-14T09:19:47.657 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47399.log 2023-10-14T09:19:47.657 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45358.log.gz 2023-10-14T09:19:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44303.log: gzip -5 88.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44303.log.gz -- 2023-10-14T09:19:47.658 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.44754.log 2023-10-14T09:19:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45988.log 2023-10-14T09:19:47.659 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47399.log.gz 2023-10-14T09:19:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47309.log 2023-10-14T09:19:47.660 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44754.log.gz 2023-10-14T09:19:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41899.log 2023-10-14T09:19:47.661 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45988.log.gz 2023-10-14T09:19:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47309.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47309.log.gz 2023-10-14T09:19:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-14T09:19:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44121.log 2023-10-14T09:19:47.663 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41899.log.gz 2023-10-14T09:19:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46225.log 2023-10-14T09:19:47.667 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44121.log: gzip -5 89.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44121.log.gz 2023-10-14T09:19:47.667 INFO:teuthology.orchestra.run.smithi078.stderr: -- /var/log/ceph/ceph-client.admin.43246.log 2023-10-14T09:19:47.668 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2023-10-14T09:19:47.668 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46225.log.gz 2023-10-14T09:19:47.668 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42118.log 2023-10-14T09:19:47.669 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43246.log.gz 2023-10-14T09:19:47.669 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45332.log 2023-10-14T09:19:47.669 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2023-10-14T09:19:47.671 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47257.log 2023-10-14T09:19:47.671 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42118.log.gz 2023-10-14T09:19:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45332.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T09:19:47.672 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45332.log.gz 2023-10-14T09:19:47.672 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47922.log 2023-10-14T09:19:47.673 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47257.log.gz 2023-10-14T09:19:47.673 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45306.log 2023-10-14T09:19:47.674 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-14T09:19:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47922.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47922.log.gz 2023-10-14T09:19:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46764.log 2023-10-14T09:19:47.676 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43632.log 2023-10-14T09:19:47.677 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45306.log.gz 2023-10-14T09:19:47.677 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46662.log 2023-10-14T09:19:47.677 INFO:teuthology.orchestra.run.smithi078.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.46764.log.gz 2023-10-14T09:19:47.678 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43632.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43632.log.gz 2023-10-14T09:19:47.678 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43736.log 2023-10-14T09:19:47.682 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-14T09:19:47.683 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38254.log 2023-10-14T09:19:47.683 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-14T09:19:47.683 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.38254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38131.log 2023-10-14T09:19:47.684 INFO:teuthology.orchestra.run.smithi157.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38254.log.gz 2023-10-14T09:19:47.684 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38155.log 2023-10-14T09:19:47.684 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.38131.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38131.log.gz 2023-10-14T09:19:47.684 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42133.log 2023-10-14T09:19:47.685 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.38155.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T09:19:47.685 INFO:teuthology.orchestra.run.smithi157.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38155.log.gz 2023-10-14T09:19:47.688 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46662.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46662.log.gz 2023-10-14T09:19:47.689 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44968.log 2023-10-14T09:19:47.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43244.log 2023-10-14T09:19:47.689 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43736.log.gz 2023-10-14T09:19:47.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44968.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44968.log.gz 2023-10-14T09:19:47.690 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45514.log 2023-10-14T09:19:47.690 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43244.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43244.log.gz 2023-10-14T09:19:47.690 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45280.log 2023-10-14T09:19:47.691 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45514.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45514.log.gz 2023-10-14T09:19:47.691 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42358.log 2023-10-14T09:19:47.691 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46121.log 2023-10-14T09:19:47.691 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45280.log.gz 2023-10-14T09:19:47.692 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42358.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42358.log.gz 2023-10-14T09:19:47.692 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44433.log 2023-10-14T09:19:47.692 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43606.log 2023-10-14T09:19:47.692 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46121.log.gz 2023-10-14T09:19:47.693 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44433.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44433.log.gz 2023-10-14T09:19:47.693 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47607.log 2023-10-14T09:19:47.693 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42601.log 2023-10-14T09:19:47.694 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43606.log.gz 2023-10-14T09:19:47.694 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47607.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47607.log.gz 2023-10-14T09:19:47.694 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47335.log 2023-10-14T09:19:47.698 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.1.42133.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T09:19:47.698 INFO:teuthology.orchestra.run.smithi157.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.1.42133.log.gz 2023-10-14T09:19:47.699 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38182.log 2023-10-14T09:19:47.699 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-14T09:19:47.699 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.38182.log: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T09:19:47.699 INFO:teuthology.orchestra.run.smithi157.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T09:19:47.700 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38182.log.gz 2023-10-14T09:19:47.700 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38206.log 2023-10-14T09:19:47.700 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T09:19:47.701 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.38206.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-14T09:19:47.701 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38206.log.gz 2023-10-14T09:19:47.701 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38302.log 2023-10-14T09:19:47.701 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38278.log 2023-10-14T09:19:47.702 INFO:teuthology.orchestra.run.smithi157.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T09:19:47.702 INFO:teuthology.orchestra.run.smithi157.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz/var/log/ceph/ceph-client.admin.38302.log: 2023-10-14T09:19:47.702 INFO:teuthology.orchestra.run.smithi157.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38302.log.gz 2023-10-14T09:19:47.703 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-14T09:19:47.703 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.38278.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38278.log.gz 2023-10-14T09:19:47.703 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-14T09:19:47.706 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-14T09:19:47.706 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38230.log 2023-10-14T09:19:47.706 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.38230.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38230.log.gz 2023-10-14T09:19:47.710 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44833.log 2023-10-14T09:19:47.710 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42601.log.gz 2023-10-14T09:19:47.710 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47335.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47335.log.gz 2023-10-14T09:19:47.711 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42196.log 2023-10-14T09:19:47.711 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44833.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44833.log.gz 2023-10-14T09:19:47.711 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45742.log 2023-10-14T09:19:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42196.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42196.log.gz 2023-10-14T09:19:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44485.log 2023-10-14T09:19:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45742.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45742.log.gz 2023-10-14T09:19:47.712 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43788.log 2023-10-14T09:19:47.713 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44485.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44485.log.gz 2023-10-14T09:19:47.713 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45716.log 2023-10-14T09:19:47.713 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42620.log 2023-10-14T09:19:47.714 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43788.log.gz 2023-10-14T09:19:47.714 INFO:teuthology.orchestra.run.smithi078.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-14T09:19:47.714 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45716.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45716.log.gz 2023-10-14T09:19:47.714 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46609.log 2023-10-14T09:19:47.715 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42620.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T09:19:47.715 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42620.log.gz 2023-10-14T09:19:47.715 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42091.log 2023-10-14T09:19:47.716 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46609.log.gz 2023-10-14T09:19:47.716 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45663.log 2023-10-14T09:19:47.716 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46251.log 2023-10-14T09:19:47.716 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42091.log.gz 2023-10-14T09:19:47.717 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45663.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45663.log.gz 2023-10-14T09:19:47.717 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47893.log 2023-10-14T09:19:47.717 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47711.log 2023-10-14T09:19:47.718 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46251.log.gz 2023-10-14T09:19:47.718 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47893.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47893.log.gz 2023-10-14T09:19:47.718 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43239.log 2023-10-14T09:19:47.718 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46301.log 2023-10-14T09:19:47.719 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47711.log.gz 2023-10-14T09:19:47.719 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43239.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43239.log.gz 2023-10-14T09:19:47.719 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T09:19:47.720 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47841.log 2023-10-14T09:19:47.720 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46301.log.gz 2023-10-14T09:19:47.721 INFO:teuthology.orchestra.run.smithi157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-14T09:19:47.725 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42332.log 2023-10-14T09:19:47.725 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47841.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47841.log.gz 2023-10-14T09:19:47.725 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44807.log 2023-10-14T09:19:47.726 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42000.log 2023-10-14T09:19:47.726 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42332.log.gz 2023-10-14T09:19:47.726 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44807.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44807.log.gz 2023-10-14T09:19:47.726 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42612.log 2023-10-14T09:19:47.727 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45176.log 2023-10-14T09:19:47.727 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42000.log.gz 2023-10-14T09:19:47.727 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42612.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42612.log.gz 2023-10-14T09:19:47.728 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47815.log 2023-10-14T09:19:47.728 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42540.log 2023-10-14T09:19:47.728 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45176.log.gz 2023-10-14T09:19:47.728 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47815.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47815.log.gz 2023-10-14T09:19:47.729 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42278.log 2023-10-14T09:19:47.729 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47477.log 2023-10-14T09:19:47.729 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42540.log.gz 2023-10-14T09:19:47.730 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42278.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42278.log.gz 2023-10-14T09:19:47.730 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42823.log 2023-10-14T09:19:47.730 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45436.log 2023-10-14T09:19:47.731 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47477.log.gz 2023-10-14T09:19:47.731 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42823.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42823.log.gz 2023-10-14T09:19:47.731 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42170.log 2023-10-14T09:19:47.734 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44700.log 2023-10-14T09:19:47.734 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45436.log.gz 2023-10-14T09:19:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42170.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42170.log.gz 2023-10-14T09:19:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45020.log 2023-10-14T09:19:47.735 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45846.log 2023-10-14T09:19:47.736 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44700.log.gz 2023-10-14T09:19:47.736 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45020.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45020.log.gz 2023-10-14T09:19:47.736 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43216.log 2023-10-14T09:19:47.736 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47283.log 2023-10-14T09:19:47.737 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45846.log.gz 2023-10-14T09:19:47.737 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43216.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43216.log.gz 2023-10-14T09:19:47.737 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43869.log 2023-10-14T09:19:47.738 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45926.log 2023-10-14T09:19:47.738 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47283.log.gz 2023-10-14T09:19:47.738 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43869.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43869.log.gz 2023-10-14T09:19:47.739 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43476.log 2023-10-14T09:19:47.741 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2023-10-14T09:19:47.741 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45926.log.gz 2023-10-14T09:19:47.742 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43476.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43476.log.gz 2023-10-14T09:19:47.742 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43035.log 2023-10-14T09:19:47.742 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45124.log 2023-10-14T09:19:47.743 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2023-10-14T09:19:47.743 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43035.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43035.log.gz 2023-10-14T09:19:47.743 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47763.log 2023-10-14T09:19:47.743 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45768.log 2023-10-14T09:19:47.744 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45124.log.gz 2023-10-14T09:19:47.744 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47763.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47763.log.gz 2023-10-14T09:19:47.744 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46583.log 2023-10-14T09:19:47.746 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45768.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-14T09:19:47.746 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45768.log.gz 2023-10-14T09:19:47.746 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46583.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46583.log.gz 2023-10-14T09:19:47.747 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43031.log 2023-10-14T09:19:47.747 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44780.log 2023-10-14T09:19:47.747 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43031.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43031.log.gz 2023-10-14T09:19:47.748 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46095.log 2023-10-14T09:19:47.749 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42306.log 2023-10-14T09:19:47.749 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44780.log.gz 2023-10-14T09:19:47.750 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43580.log 2023-10-14T09:19:47.750 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46095.log.gz 2023-10-14T09:19:47.750 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42306.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42306.log.gz 2023-10-14T09:19:47.751 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44674.log 2023-10-14T09:19:47.751 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44069.log 2023-10-14T09:19:47.752 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43580.log.gz 2023-10-14T09:19:47.752 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44674.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44674.log.gz 2023-10-14T09:19:47.753 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46173.log 2023-10-14T09:19:47.754 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45820.log 2023-10-14T09:19:47.754 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44069.log.gz 2023-10-14T09:19:47.755 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44225.log 2023-10-14T09:19:47.755 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46173.log.gz 2023-10-14T09:19:47.756 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43021.log 2023-10-14T09:19:47.756 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45820.log.gz 2023-10-14T09:19:47.757 INFO:teuthology.orchestra.run.smithi157.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-14T09:19:47.757 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44225.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44225.log.gz 2023-10-14T09:19:47.758 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42410.log 2023-10-14T09:19:47.759 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44277.log 2023-10-14T09:19:47.759 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43021.log.gz 2023-10-14T09:19:47.759 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42410.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42410.log.gz 2023-10-14T09:19:47.760 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42250.log 2023-10-14T09:19:47.761 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.44277.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47231.log 2023-10-14T09:19:47.761 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44277.log.gz 2023-10-14T09:19:47.762 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42250.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42250.log.gz 2023-10-14T09:19:47.763 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45150.log 2023-10-14T09:19:47.763 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45046.log 2023-10-14T09:19:47.764 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47231.log.gz 2023-10-14T09:19:47.764 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45150.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45150.log.gz 2023-10-14T09:19:47.765 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42820.log 2023-10-14T09:19:47.766 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45046.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45046.log.gz 2023-10-14T09:19:47.766 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42488.log 2023-10-14T09:19:47.767 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42820.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42820.log.gz 2023-10-14T09:19:47.768 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T09:19:47.769 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42488.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42488.log.gz 2023-10-14T09:19:47.769 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46457.log 2023-10-14T09:19:47.770 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42436.log 2023-10-14T09:19:47.773 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44095.log 2023-10-14T09:19:47.773 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46457.log.gz 2023-10-14T09:19:47.774 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42436.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42436.log.gz 2023-10-14T09:19:47.774 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47581.log 2023-10-14T09:19:47.775 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46533.log 2023-10-14T09:19:47.775 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44095.log.gz 2023-10-14T09:19:47.777 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43993.log 2023-10-14T09:19:47.777 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47581.log.gz 2023-10-14T09:19:47.778 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47789.log 2023-10-14T09:19:47.779 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46533.log.gz 2023-10-14T09:19:47.780 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.43993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42615.log 2023-10-14T09:19:47.781 INFO:teuthology.orchestra.run.smithi078.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.0.43993.log.gz 2023-10-14T09:19:47.781 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47789.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47789.log.gz 2023-10-14T09:19:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46014.log 2023-10-14T09:19:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42615.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42615.log.gz 2023-10-14T09:19:47.783 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47108.log 2023-10-14T09:19:47.784 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46900.log 2023-10-14T09:19:47.784 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46014.log.gz 2023-10-14T09:19:47.785 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43710.log 2023-10-14T09:19:47.786 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47108.log.gz 2023-10-14T09:19:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47972.log 2023-10-14T09:19:47.787 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46900.log.gz 2023-10-14T09:19:47.788 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44563.log 2023-10-14T09:19:47.789 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43710.log.gz 2023-10-14T09:19:47.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42827.log 2023-10-14T09:19:47.790 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47972.log.gz 2023-10-14T09:19:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44563.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44563.log.gz 2023-10-14T09:19:47.792 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47685.log 2023-10-14T09:19:47.793 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46327.log 2023-10-14T09:19:47.793 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42827.log.gz 2023-10-14T09:19:47.794 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46147.log 2023-10-14T09:19:47.795 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47685.log.gz 2023-10-14T09:19:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46327.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.46327.log.gz -5 2023-10-14T09:19:47.796 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38231.log 2023-10-14T09:19:47.797 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41967.log 2023-10-14T09:19:47.798 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46147.log.gz 2023-10-14T09:19:47.798 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38231.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38231.log.gz 2023-10-14T09:19:47.799 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46842.log 2023-10-14T09:19:47.800 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45384.log 2023-10-14T09:19:47.801 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41967.log.gz 2023-10-14T09:19:47.802 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45098.log 2023-10-14T09:19:47.803 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46842.log.gz 2023-10-14T09:19:47.803 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45384.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45384.log.gz 2023-10-14T09:19:47.804 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T09:19:47.804 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45098.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45098.log.gz 2023-10-14T09:19:47.805 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45637.log 2023-10-14T09:19:47.807 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42384.log 2023-10-14T09:19:47.807 INFO:teuthology.orchestra.run.smithi078.stderr: 85.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T09:19:47.808 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45637.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45637.log.gz 2023-10-14T09:19:47.809 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42384.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42384.log.gz 2023-10-14T09:19:47.810 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42462.log 2023-10-14T09:19:47.811 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43528.log 2023-10-14T09:19:47.813 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44173.log 2023-10-14T09:19:47.813 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42462.log.gz 2023-10-14T09:19:47.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43658.log 2023-10-14T09:19:47.815 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43528.log.gz 2023-10-14T09:19:47.815 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-14T09:19:47.816 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44641.log 2023-10-14T09:19:47.816 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44173.log.gz 2023-10-14T09:19:47.817 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44407.log 2023-10-14T09:19:47.818 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43658.log.gz 2023-10-14T09:19:47.819 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42812.log 2023-10-14T09:19:47.819 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44641.log.gz 2023-10-14T09:19:47.820 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44407.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44407.log.gz 2023-10-14T09:19:47.821 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44355.log 2023-10-14T09:19:47.822 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46816.log 2023-10-14T09:19:47.822 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42812.log.gz 2023-10-14T09:19:47.823 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46688.log 2023-10-14T09:19:47.823 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44355.log.gz 2023-10-14T09:19:47.824 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46816.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46816.log.gz 2023-10-14T09:19:47.825 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2023-10-14T09:19:47.826 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46688.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33217.log 2023-10-14T09:19:47.827 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46688.log.gz 2023-10-14T09:19:47.827 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43762.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2023-10-14T09:19:47.828 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47867.log 2023-10-14T09:19:47.829 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.tmp-client.admin.33217.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33217.log.gz 2023-10-14T09:19:47.829 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47194.log 2023-10-14T09:19:47.831 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47867.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47867.log.gz 2023-10-14T09:19:47.831 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47004.log 2023-10-14T09:19:47.832 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43232.log 2023-10-14T09:19:47.833 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47194.log.gz 2023-10-14T09:19:47.834 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45072.log 2023-10-14T09:19:47.834 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47004.log.gz 2023-10-14T09:19:47.835 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43232.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43232.log.gz 2023-10-14T09:19:47.836 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45072.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45072.log.gz 2023-10-14T09:19:47.837 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46978.log 2023-10-14T09:19:47.838 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42065.log 2023-10-14T09:19:47.840 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47030.log 2023-10-14T09:19:47.840 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46978.log.gz 2023-10-14T09:19:47.841 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45689.log 2023-10-14T09:19:47.842 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42065.log.gz 2023-10-14T09:19:47.843 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42617.log 2023-10-14T09:19:47.843 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47030.log.gz 2023-10-14T09:19:47.844 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44042.log 2023-10-14T09:19:47.845 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45689.log.gz 2023-10-14T09:19:47.845 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42617.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42617.log.gz 2023-10-14T09:19:47.846 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45228.log 2023-10-14T09:19:47.848 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44042.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44042.log.gz 2023-10-14T09:19:47.848 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43450.log 2023-10-14T09:19:47.849 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45228.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45228.log.gz 2023-10-14T09:19:47.849 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43008.log 2023-10-14T09:19:47.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43450.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43450.log.gz 2023-10-14T09:19:47.851 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43554.log 2023-10-14T09:19:47.852 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43008.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43008.log.gz 2023-10-14T09:19:47.853 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44994.log 2023-10-14T09:19:47.854 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43220.log 2023-10-14T09:19:47.854 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43554.log.gz 2023-10-14T09:19:47.855 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44911.log 2023-10-14T09:19:47.856 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44994.log.gz 2023-10-14T09:19:47.857 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43220.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.43220.log.gz 2023-10-14T09:19:47.857 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44251.log 2023-10-14T09:19:47.858 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44911.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44911.log.gz 2023-10-14T09:19:47.859 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43034.log 2023-10-14T09:19:47.860 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44251.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T09:19:47.860 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44251.log.gz 2023-10-14T09:19:47.862 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47056.log 2023-10-14T09:19:47.862 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43034.log.gz 2023-10-14T09:19:47.863 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-14T09:19:47.864 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47056.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T09:19:47.865 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47056.log.gz 2023-10-14T09:19:47.870 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38130.log 2023-10-14T09:19:47.871 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45872.log 2023-10-14T09:19:47.873 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46199.log 2023-10-14T09:19:47.873 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38130.log.gz 2023-10-14T09:19:47.874 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45872.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-14T09:19:47.875 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45872.log.gz 2023-10-14T09:19:47.877 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47373.log 2023-10-14T09:19:47.878 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47134.log 2023-10-14T09:19:47.879 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47082.log 2023-10-14T09:19:47.879 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-14T09:19:47.880 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% 87.9% 91.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-14T09:19:47.881 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46199.log.gz 2023-10-14T09:19:47.881 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47134.log: -- replaced with /var/log/ceph/ceph-client.admin.47373.log.gz 2023-10-14T09:19:47.882 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47134.log.gz 2023-10-14T09:19:47.882 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45572.log 2023-10-14T09:19:47.883 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45488.log 2023-10-14T09:19:47.883 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47082.log.gz 2023-10-14T09:19:47.884 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45572.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45572.log.gz 2023-10-14T09:19:47.885 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45410.log 2023-10-14T09:19:47.886 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45488.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45488.log.gz 2023-10-14T09:19:47.886 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44511.log 2023-10-14T09:19:47.888 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43238.log 2023-10-14T09:19:47.888 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45410.log.gz 2023-10-14T09:19:47.889 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44511.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44511.log.gz 2023-10-14T09:19:47.890 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44199.log 2023-10-14T09:19:47.890 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43238.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43238.log.gz 2023-10-14T09:19:47.891 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42222.log 2023-10-14T09:19:47.893 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45540.log 2023-10-14T09:19:47.893 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44199.log.gz 2023-10-14T09:19:47.894 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42619.log 88.8% 2023-10-14T09:19:47.894 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42222.log.gz 2023-10-14T09:19:47.895 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45540.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45540.log.gz 2023-10-14T09:19:47.896 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46507.log 2023-10-14T09:19:47.897 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46353.log 2023-10-14T09:19:47.897 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42619.log.gz 2023-10-14T09:19:47.898 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46507.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46507.log.gz 2023-10-14T09:19:47.899 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43022.log 2023-10-14T09:19:47.900 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44942.log 2023-10-14T09:19:47.900 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46353.log.gz 2023-10-14T09:19:47.902 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47633.log 2023-10-14T09:19:47.902 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43022.log.gz 2023-10-14T09:19:47.903 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44942.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44942.log.gz 2023-10-14T09:19:47.903 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47160.log 2023-10-14T09:19:47.904 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44589.log 2023-10-14T09:19:47.905 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47633.log.gz 2023-10-14T09:19:47.906 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47160.log: gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.47555.log 2023-10-14T09:19:47.906 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47160.log.gz 2023-10-14T09:19:47.907 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44589.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44589.log.gz 2023-10-14T09:19:47.907 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46431.log 2023-10-14T09:19:47.909 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47555.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47555.log.gz 2023-10-14T09:19:47.909 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2023-10-14T09:19:47.910 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46431.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46431.log.gz 2023-10-14T09:19:47.911 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42808.log 2023-10-14T09:19:47.912 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45954.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.46379.log 2023-10-14T09:19:47.912 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2023-10-14T09:19:47.913 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44381.log 2023-10-14T09:19:47.914 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42808.log.gz 2023-10-14T09:19:47.915 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2023-10-14T09:19:47.916 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46379.log.gz 2023-10-14T09:19:47.916 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44381.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44381.log.gz 2023-10-14T09:19:47.918 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44147.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2023-10-14T09:19:47.918 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45202.log 2023-10-14T09:19:47.920 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2023-10-14T09:19:47.921 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45202.log: gzip -5 88.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.45202.log.gz -- 2023-10-14T09:19:47.922 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.45794.log 2023-10-14T09:19:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46069.log 2023-10-14T09:19:47.924 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz/var/log/ceph/ceph-client.admin.45794.log: 2023-10-14T09:19:47.924 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45794.log.gz 2023-10-14T09:19:47.925 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2023-10-14T09:19:47.926 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42607.log 2023-10-14T09:19:47.926 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46069.log.gz 2023-10-14T09:19:47.927 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42603.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2023-10-14T09:19:47.928 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45898.log 2023-10-14T09:19:47.929 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47451.log 2023-10-14T09:19:47.929 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42607.log.gz 2023-10-14T09:19:47.930 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44728.log 2023-10-14T09:19:47.931 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45898.log.gz 2023-10-14T09:19:47.932 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46926.log 2023-10-14T09:19:47.932 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47451.log.gz 2023-10-14T09:19:47.933 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44728.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44728.log.gz 2023-10-14T09:19:47.933 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43242.log 2023-10-14T09:19:47.935 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46926.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46926.log.gz 2023-10-14T09:19:47.935 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42514.log 2023-10-14T09:19:47.937 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43242.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43242.log.gz -5 2023-10-14T09:19:47.937 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44885.log 2023-10-14T09:19:47.938 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47425.log 2023-10-14T09:19:47.938 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42514.log.gz 2023-10-14T09:19:47.939 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44885.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44885.log.gz 2023-10-14T09:19:47.939 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43027.log 2023-10-14T09:19:47.941 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42144.log 2023-10-14T09:19:47.941 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47425.log.gz 2023-10-14T09:19:47.943 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38009.log 2023-10-14T09:19:47.943 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43027.log.gz 2023-10-14T09:19:47.944 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42144.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.42144.log.gz /var/log/ceph/ceph-client.admin.43684.log 2023-10-14T09:19:47.944 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-10-14T09:19:47.945 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46952.log 2023-10-14T09:19:47.946 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38009.log.gz 2023-10-14T09:19:47.947 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43684.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43684.log.gz 2023-10-14T09:19:47.947 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47529.log 2023-10-14T09:19:47.948 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46952.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46952.log.gz 2023-10-14T09:19:47.949 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43036.log 2023-10-14T09:19:47.950 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47946.log 2023-10-14T09:19:47.950 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47529.log.gz 2023-10-14T09:19:47.951 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43036.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43036.log.gz 2023-10-14T09:19:47.952 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42814.log 2023-10-14T09:19:47.953 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47946.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47946.log.gz 2023-10-14T09:19:47.954 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42566.log 2023-10-14T09:19:47.954 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42814.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42814.log.gz 2023-10-14T09:19:47.955 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44615.log 2023-10-14T09:19:47.956 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42826.log 2023-10-14T09:19:47.957 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42566.log.gz 2023-10-14T09:19:47.958 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42828.log 2023-10-14T09:19:47.958 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44615.log.gz 2023-10-14T09:19:47.959 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44859.log 2023-10-14T09:19:47.960 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42826.log.gz 2023-10-14T09:19:47.961 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42828.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42828.log.gz 2023-10-14T09:19:47.962 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44329.log 2023-10-14T09:19:47.962 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44859.log.gz 2023-10-14T09:19:47.963 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45462.log 2023-10-14T09:19:47.965 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44329.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44329.log.gz 2023-10-14T09:19:47.966 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45462.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45462.log.gz 2023-10-14T09:19:47.975 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T09:19:48.287 INFO:teuthology.orchestra.run.smithi157.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-14T09:19:48.307 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T09:19:48.316 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T09:19:48.320 INFO:teuthology.orchestra.run.smithi157.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-14T09:19:48.406 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T09:19:48.411 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-14T09:19:48.413 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-10-14T09:19:48.413 INFO:teuthology.orchestra.run.smithi078.stderr:real 0m0.785s 2023-10-14T09:19:48.413 INFO:teuthology.orchestra.run.smithi078.stderr:user 0m2.914s 2023-10-14T09:19:48.414 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m0.659s 2023-10-14T09:19:48.440 INFO:teuthology.orchestra.run.smithi157.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-14T09:19:48.467 INFO:teuthology.orchestra.run.smithi157.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-14T09:19:48.468 INFO:teuthology.orchestra.run.smithi157.stderr: 2023-10-14T09:19:48.469 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m0.822s 2023-10-14T09:19:48.469 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m2.792s 2023-10-14T09:19:48.469 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m0.287s 2023-10-14T09:19:48.470 INFO:tasks.ceph:Archiving logs... 2023-10-14T09:19:48.471 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143/remote/smithi078/log 2023-10-14T09:19:48.472 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T09:19:48.980 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143/remote/smithi157/log 2023-10-14T09:19:48.982 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T09:19:49.359 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T09:19:49.368 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T09:19:49.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T09:19:49.372 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T09:19:49.449 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T09:19:49.460 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T09:19:49.460 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:19:49.464 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:19:49.475 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2023-10-14T09:19:49.476 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2023-10-14T09:19:49.476 INFO:teuthology.orchestra.run.smithi078.stdout:*hv01.front.sepi 44.4.53.2 2 u 35 64 77 0.085 -0.630 2.296 2023-10-14T09:19:49.476 INFO:teuthology.orchestra.run.smithi078.stdout:+hv02.front.sepi 63.231.80.2 3 u 34 64 77 0.072 +0.293 1.212 2023-10-14T09:19:49.477 INFO:teuthology.orchestra.run.smithi078.stdout:+hv03.front.sepi 74.6.168.72 3 u 31 64 77 0.081 -2.606 1.781 2023-10-14T09:19:49.477 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T09:19:49.479 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2023-10-14T09:19:49.479 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2023-10-14T09:19:49.480 INFO:teuthology.orchestra.run.smithi157.stdout:+hv01.front.sepi 44.4.53.2 2 u 29 64 77 0.102 -2.651 1.414 2023-10-14T09:19:49.480 INFO:teuthology.orchestra.run.smithi157.stdout:+hv02.front.sepi 63.231.80.2 3 u 24 64 77 0.118 +1.096 0.468 2023-10-14T09:19:49.480 INFO:teuthology.orchestra.run.smithi157.stdout:*hv03.front.sepi 74.6.168.72 3 u 34 64 77 0.083 -0.615 0.881 2023-10-14T09:19:49.481 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-14T09:19:49.482 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T09:19:49.492 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T09:19:49.492 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T09:19:49.501 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T09:19:49.511 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T09:19:49.519 INFO:teuthology.task.internal:Duration was 878.296549 seconds 2023-10-14T09:19:49.520 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T09:19:49.529 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T09:19:49.529 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T09:19:49.533 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T09:19:49.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-14T09:19:49.635 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T09:19:49.636 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2023-10-14T09:19:49.636 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T09:19:49.659 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2023-10-14T09:19:49.659 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T09:19:49.681 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T09:19:49.681 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T09:19:49.709 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T09:19:49.762 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T09:19:49.762 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T09:19:49.785 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T09:19:49.870 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T09:19:49.880 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T09:19:49.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T09:19:49.902 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T09:19:49.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T09:19:49.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:19:49.949 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:19:49.963 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2023-10-14T09:19:49.982 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2023-10-14T09:19:50.001 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:19:50.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:19:50.033 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:19:50.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:19:50.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T09:19:50.066 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T09:19:50.067 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143/remote/smithi078 2023-10-14T09:19:50.068 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T09:19:50.098 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143/remote/smithi157 2023-10-14T09:19:50.099 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T09:19:50.124 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T09:19:50.125 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T09:19:50.140 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T09:19:50.177 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T09:19:50.189 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T09:19:50.189 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T09:19:50.199 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T09:19:50.199 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T09:19:50.203 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T09:19:50.209 INFO:teuthology.orchestra.run.smithi078.stdout: 657962 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 09:19 /home/ubuntu/cephtest 2023-10-14T09:19:50.229 INFO:teuthology.orchestra.run.smithi157.stdout: 657964 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 09:19 /home/ubuntu/cephtest 2023-10-14T09:19:50.231 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T09:19:50.243 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T09:19:50.266 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T09:19:50.295 DEBUG:teuthology.nuke:shortname: smithi078 2023-10-14T09:19:50.296 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:19:50.323 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 08:54:09.644079', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdn8snkywa347m3Vm++j/7zGb0bP1DuqZrs03Tlk65YGWV1sN7+opB4oVBc817xO1lvLUtO36qUhJ6w+UsU+hw='} 2023-10-14T09:19:50.326 DEBUG:teuthology.nuke:shortname: smithi157 2023-10-14T09:19:50.327 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:19:50.352 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425143', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 08:54:09.646161', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVtw7vNZj/l0SLmC2AuhNX31JfCkue1KDpMCHJBMQdkODprV+rab9GcwgdALBISm5/EjTEyEraPySW/2rvK7L8='} 2023-10-14T09:19:50.383 INFO:teuthology.orchestra.console.smithi078:Power off 2023-10-14T09:19:50.384 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:19:50.406 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-10-14T09:19:50.407 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:19:50.425 INFO:teuthology.orchestra.console.smithi157:Power off 2023-10-14T09:19:50.426 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:19:50.435 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-10-14T09:19:50.447 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-10-14T09:19:50.448 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:19:50.470 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-14T09:19:54.436 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:19:54.472 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:19:54.547 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-10-14T09:19:54.584 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-14T09:19:58.550 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:19:58.585 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:19:58.661 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-10-14T09:19:58.698 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-14T09:19:58.762 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-10-14T09:20:02.702 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:20:02.813 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-14T09:20:02.914 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-10-14T09:20:03.019 INFO:teuthology.run:Summary data: description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} duration: 878.2965486049652 failure_reason: 'Test failure: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity)' flavor: default mon.a-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 mon.b-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=6e3b15ffef9343d89c613e4c5de9c870 status: fail success: false 2023-10-14T09:20:03.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:20:03.101 INFO:teuthology.run:FAIL